2023-10-08T15:51:17.605 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-08T15:51:17.605 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --name yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi --description fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs/{frag test}} --archive /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418300 --verbose -- /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418300/orig.config.yaml 2023-10-08T15:51:17.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T15:51:17.730 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418300 branch: wip-yuri-testing-2023-10-06-0949-quincy description: fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs/{frag test}} email: null first_in_suite: false job_id: '7418300' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri-testing-2023-10-06-0949-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-10-07-1508-quincy sha1: abf19fc7a04fe4fceab4e98d4013ae1da7c06006 owner: scheduled_yuriw@teuthology priority: 74 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 8174 sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri-testing-2023-10-07-1508-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: abf19fc7a04fe4fceab4e98d4013ae1da7c06006 targets: smithi133.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi190.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - check-counter: counters: mds: - mds.dir_split - workunit: clients: client.0: - libcephfs/test.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-08_15:41:30 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-08T15:51:17.731 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa; will attempt to use it 2023-10-08T15:51:17.731 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks 2023-10-08T15:51:17.731 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-08T15:51:17.733 INFO:teuthology.task.internal:Checking packages... 2023-10-08T15:51:17.755 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '08cac0187919fc3a247efdf445f652e2fb30a647' 2023-10-08T15:51:17.755 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-08T15:51:17.755 INFO:teuthology.packaging:ref: None 2023-10-08T15:51:17.755 INFO:teuthology.packaging:tag: None 2023-10-08T15:51:17.755 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-06-0949-quincy 2023-10-08T15:51:17.756 INFO:teuthology.packaging:sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T15:51:17.756 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri-testing-2023-10-06-0949-quincy 2023-10-08T15:51:17.980 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1320-g08cac018-1focal 2023-10-08T15:51:17.980 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-08T15:51:17.988 INFO:teuthology.task.internal:no buildpackages task found 2023-10-08T15:51:17.989 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-08T15:51:18.013 INFO:teuthology.task.internal:Saving configuration 2023-10-08T15:51:18.029 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-08T15:51:18.063 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T15:51:18.091 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418300', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 15:43:40.219147', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-08T15:51:18.115 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418300', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 15:43:40.217400', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-08T15:51:18.115 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-08T15:51:18.122 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-10-08T15:51:18.123 INFO:teuthology.task.internal:roles: ubuntu@smithi190.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-10-08T15:51:18.123 INFO:teuthology.run_tasks:Running task console_log... 2023-10-08T15:51:18.240 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc5458ca040>, signals=[15]) 2023-10-08T15:51:18.241 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-08T15:51:18.247 INFO:teuthology.task.internal:Opening connections... 2023-10-08T15:51:18.248 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi133.front.sepia.ceph.com 2023-10-08T15:51:18.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:51:18.299 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi190.front.sepia.ceph.com 2023-10-08T15:51:18.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:51:18.347 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-08T15:51:18.353 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2023-10-08T15:51:18.377 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2023-10-08T15:51:18.377 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-10-08T15:51:18.423 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu" 2023-10-08T15:51:18.423 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-08T15:51:18.423 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu 2023-10-08T15:51:18.423 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian 2023-10-08T15:51:18.424 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-08T15:51:18.424 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="20.04" 2023-10-08T15:51:18.424 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-08T15:51:18.424 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-08T15:51:18.424 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-08T15:51:18.424 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-08T15:51:18.424 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=focal 2023-10-08T15:51:18.424 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=focal 2023-10-08T15:51:18.425 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-10-08T15:51:18.447 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2023-10-08T15:51:18.454 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2023-10-08T15:51:18.454 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-10-08T15:51:18.460 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Ubuntu" 2023-10-08T15:51:18.460 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-08T15:51:18.460 INFO:teuthology.orchestra.run.smithi190.stdout:ID=ubuntu 2023-10-08T15:51:18.460 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE=debian 2023-10-08T15:51:18.460 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-08T15:51:18.460 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="20.04" 2023-10-08T15:51:18.460 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-08T15:51:18.461 INFO:teuthology.orchestra.run.smithi190.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-08T15:51:18.461 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-08T15:51:18.461 INFO:teuthology.orchestra.run.smithi190.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-08T15:51:18.461 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_CODENAME=focal 2023-10-08T15:51:18.461 INFO:teuthology.orchestra.run.smithi190.stdout:UBUNTU_CODENAME=focal 2023-10-08T15:51:18.461 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-10-08T15:51:18.480 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-08T15:51:18.489 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-08T15:51:18.536 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-08T15:51:18.536 DEBUG:teuthology.orchestra.run.smithi133:> test '!' -e /home/ubuntu/cephtest 2023-10-08T15:51:18.539 DEBUG:teuthology.orchestra.run.smithi190:> test '!' -e /home/ubuntu/cephtest 2023-10-08T15:51:18.544 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-08T15:51:18.600 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-08T15:51:18.600 DEBUG:teuthology.orchestra.run.smithi133:> test -z $(ls -A /var/lib/ceph) 2023-10-08T15:51:18.603 DEBUG:teuthology.orchestra.run.smithi190:> test -z $(ls -A /var/lib/ceph) 2023-10-08T15:51:18.620 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-08T15:51:18.673 INFO:teuthology.run_tasks:Running task kernel... 2023-10-08T15:51:18.705 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-08T15:51:18.705 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-08T15:51:18.706 DEBUG:teuthology.orchestra.run.smithi133:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T15:51:18.706 DEBUG:teuthology.orchestra.run.smithi190:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T15:51:18.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:51:18.712 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2023-10-08T15:51:18.712 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:51:18.713 DEBUG:teuthology.orchestra.run.smithi190:> uname -r 2023-10-08T15:51:18.759 INFO:teuthology.orchestra.run.smithi133.stdout:5.4.0-124-generic 2023-10-08T15:51:18.759 INFO:teuthology.task.kernel:Running kernel on smithi133: 5.4.0-124-generic 2023-10-08T15:51:18.759 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-get clean 2023-10-08T15:51:18.761 INFO:teuthology.orchestra.run.smithi190.stdout:5.4.0-124-generic 2023-10-08T15:51:18.761 INFO:teuthology.task.kernel:Running kernel on smithi190: 5.4.0-124-generic 2023-10-08T15:51:18.761 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get clean 2023-10-08T15:51:18.852 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get update 2023-10-08T15:51:18.908 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-get update 2023-10-08T15:51:18.994 INFO:teuthology.orchestra.run.smithi190.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-08T15:51:19.062 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T15:51:19.079 INFO:teuthology.orchestra.run.smithi190.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-08T15:51:19.083 INFO:teuthology.orchestra.run.smithi133.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-08T15:51:19.150 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-10-08T15:51:19.192 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T15:51:19.274 INFO:teuthology.orchestra.run.smithi133.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-08T15:51:19.286 INFO:teuthology.orchestra.run.smithi190.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,500 kB] 2023-10-08T15:51:19.400 INFO:teuthology.orchestra.run.smithi133.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [660 kB] 2023-10-08T15:51:19.448 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [660 kB] 2023-10-08T15:51:19.462 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [390 kB] 2023-10-08T15:51:19.465 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-10-08T15:51:19.465 INFO:teuthology.orchestra.run.smithi190.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,267 kB] 2023-10-08T15:51:19.481 INFO:teuthology.orchestra.run.smithi190.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-10-08T15:51:19.482 INFO:teuthology.orchestra.run.smithi190.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [317 kB] 2023-10-08T15:51:19.485 INFO:teuthology.orchestra.run.smithi190.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-10-08T15:51:19.485 INFO:teuthology.orchestra.run.smithi190.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [616 kB] 2023-10-08T15:51:19.490 INFO:teuthology.orchestra.run.smithi190.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [890 kB] 2023-10-08T15:51:19.495 INFO:teuthology.orchestra.run.smithi190.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [186 kB] 2023-10-08T15:51:19.497 INFO:teuthology.orchestra.run.smithi190.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-10-08T15:51:19.497 INFO:teuthology.orchestra.run.smithi190.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-10-08T15:51:19.497 INFO:teuthology.orchestra.run.smithi190.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-10-08T15:51:19.504 INFO:teuthology.orchestra.run.smithi133.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,500 kB] 2023-10-08T15:51:19.512 INFO:teuthology.orchestra.run.smithi190.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-10-08T15:51:19.512 INFO:teuthology.orchestra.run.smithi190.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-10-08T15:51:19.554 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [390 kB] 2023-10-08T15:51:19.559 INFO:teuthology.orchestra.run.smithi133.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-10-08T15:51:19.559 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,267 kB] 2023-10-08T15:51:19.571 INFO:teuthology.orchestra.run.smithi190.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [893 kB] 2023-10-08T15:51:19.582 INFO:teuthology.orchestra.run.smithi133.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-10-08T15:51:19.583 INFO:teuthology.orchestra.run.smithi133.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [317 kB] 2023-10-08T15:51:19.585 INFO:teuthology.orchestra.run.smithi133.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-10-08T15:51:19.586 INFO:teuthology.orchestra.run.smithi133.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [890 kB] 2023-10-08T15:51:19.597 INFO:teuthology.orchestra.run.smithi133.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [616 kB] 2023-10-08T15:51:19.606 INFO:teuthology.orchestra.run.smithi133.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [186 kB] 2023-10-08T15:51:19.607 INFO:teuthology.orchestra.run.smithi133.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-10-08T15:51:19.609 INFO:teuthology.orchestra.run.smithi133.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-10-08T15:51:19.610 INFO:teuthology.orchestra.run.smithi133.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-10-08T15:51:19.610 INFO:teuthology.orchestra.run.smithi133.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-10-08T15:51:19.610 INFO:teuthology.orchestra.run.smithi133.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-10-08T15:51:19.618 INFO:teuthology.orchestra.run.smithi133.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-10-08T15:51:19.639 INFO:teuthology.orchestra.run.smithi190.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,890 kB] 2023-10-08T15:51:19.680 INFO:teuthology.orchestra.run.smithi190.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [473 kB] 2023-10-08T15:51:19.680 INFO:teuthology.orchestra.run.smithi190.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-10-08T15:51:19.680 INFO:teuthology.orchestra.run.smithi190.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.6 kB] 2023-10-08T15:51:19.681 INFO:teuthology.orchestra.run.smithi190.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,383 kB] 2023-10-08T15:51:19.694 INFO:teuthology.orchestra.run.smithi190.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [334 kB] 2023-10-08T15:51:19.697 INFO:teuthology.orchestra.run.smithi190.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-10-08T15:51:19.697 INFO:teuthology.orchestra.run.smithi190.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,121 kB] 2023-10-08T15:51:19.704 INFO:teuthology.orchestra.run.smithi190.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [749 kB] 2023-10-08T15:51:19.709 INFO:teuthology.orchestra.run.smithi190.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [268 kB] 2023-10-08T15:51:19.711 INFO:teuthology.orchestra.run.smithi190.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-10-08T15:51:19.715 INFO:teuthology.orchestra.run.smithi190.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-10-08T15:51:19.715 INFO:teuthology.orchestra.run.smithi190.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-10-08T15:51:19.716 INFO:teuthology.orchestra.run.smithi190.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-10-08T15:51:19.716 INFO:teuthology.orchestra.run.smithi190.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-10-08T15:51:19.716 INFO:teuthology.orchestra.run.smithi190.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-10-08T15:51:19.716 INFO:teuthology.orchestra.run.smithi190.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-10-08T15:51:19.731 INFO:teuthology.orchestra.run.smithi190.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-10-08T15:51:19.732 INFO:teuthology.orchestra.run.smithi190.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-10-08T15:51:19.732 INFO:teuthology.orchestra.run.smithi190.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-10-08T15:51:19.732 INFO:teuthology.orchestra.run.smithi190.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-10-08T15:51:19.762 INFO:teuthology.orchestra.run.smithi133.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,890 kB] 2023-10-08T15:51:20.144 INFO:teuthology.orchestra.run.smithi133.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [893 kB] 2023-10-08T15:51:20.174 INFO:teuthology.orchestra.run.smithi133.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [473 kB] 2023-10-08T15:51:20.187 INFO:teuthology.orchestra.run.smithi133.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-10-08T15:51:20.187 INFO:teuthology.orchestra.run.smithi133.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,383 kB] 2023-10-08T15:51:20.248 INFO:teuthology.orchestra.run.smithi133.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.6 kB] 2023-10-08T15:51:20.249 INFO:teuthology.orchestra.run.smithi133.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [334 kB] 2023-10-08T15:51:20.269 INFO:teuthology.orchestra.run.smithi133.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-10-08T15:51:20.433 INFO:teuthology.orchestra.run.smithi133.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,121 kB] 2023-10-08T15:51:21.068 INFO:teuthology.orchestra.run.smithi133.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [749 kB] 2023-10-08T15:51:21.107 INFO:teuthology.orchestra.run.smithi133.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [268 kB] 2023-10-08T15:51:21.120 INFO:teuthology.orchestra.run.smithi133.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-10-08T15:51:21.121 INFO:teuthology.orchestra.run.smithi133.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-10-08T15:51:21.123 INFO:teuthology.orchestra.run.smithi133.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-10-08T15:51:21.123 INFO:teuthology.orchestra.run.smithi133.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-10-08T15:51:21.124 INFO:teuthology.orchestra.run.smithi133.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-10-08T15:51:21.124 INFO:teuthology.orchestra.run.smithi133.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-10-08T15:51:21.149 INFO:teuthology.orchestra.run.smithi133.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-10-08T15:51:21.150 INFO:teuthology.orchestra.run.smithi133.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-10-08T15:51:21.315 INFO:teuthology.orchestra.run.smithi133.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-10-08T15:51:21.479 INFO:teuthology.orchestra.run.smithi133.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-10-08T15:51:21.531 INFO:teuthology.orchestra.run.smithi133.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-10-08T15:51:23.219 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 17.6 MB in 2s (7,148 kB/s) 2023-10-08T15:51:23.596 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 17.6 MB in 3s (6,945 kB/s) 2023-10-08T15:51:24.630 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2023-10-08T15:51:24.654 DEBUG:teuthology.orchestra.run.smithi190:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-08T15:51:24.726 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2023-10-08T15:51:24.926 INFO:teuthology.orchestra.run.smithi190.stdout:Building dependency tree... 2023-10-08T15:51:24.927 INFO:teuthology.orchestra.run.smithi190.stdout:Reading state information... 2023-10-08T15:51:25.013 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2023-10-08T15:51:25.035 DEBUG:teuthology.orchestra.run.smithi133:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-08T15:51:25.111 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2023-10-08T15:51:25.112 INFO:teuthology.orchestra.run.smithi190.stdout:The following additional packages will be installed: 2023-10-08T15:51:25.112 INFO:teuthology.orchestra.run.smithi190.stdout: linux-generic linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-08T15:51:25.112 INFO:teuthology.orchestra.run.smithi190.stdout: linux-headers-generic linux-image-5.4.0-164-generic 2023-10-08T15:51:25.112 INFO:teuthology.orchestra.run.smithi190.stdout: linux-modules-5.4.0-164-generic linux-modules-extra-5.4.0-164-generic 2023-10-08T15:51:25.114 INFO:teuthology.orchestra.run.smithi190.stdout:Suggested packages: 2023-10-08T15:51:25.114 INFO:teuthology.orchestra.run.smithi190.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-10-08T15:51:25.114 INFO:teuthology.orchestra.run.smithi190.stdout:Recommended packages: 2023-10-08T15:51:25.114 INFO:teuthology.orchestra.run.smithi190.stdout: thermald 2023-10-08T15:51:25.170 INFO:teuthology.orchestra.run.smithi190.stdout:The following NEW packages will be installed: 2023-10-08T15:51:25.170 INFO:teuthology.orchestra.run.smithi190.stdout: linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-08T15:51:25.171 INFO:teuthology.orchestra.run.smithi190.stdout: linux-image-5.4.0-164-generic linux-modules-5.4.0-164-generic 2023-10-08T15:51:25.171 INFO:teuthology.orchestra.run.smithi190.stdout: linux-modules-extra-5.4.0-164-generic 2023-10-08T15:51:25.172 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages will be upgraded: 2023-10-08T15:51:25.172 INFO:teuthology.orchestra.run.smithi190.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-08T15:51:25.230 INFO:teuthology.orchestra.run.smithi190.stdout:3 upgraded, 5 newly installed, 0 to remove and 271 not upgraded. 2023-10-08T15:51:25.231 INFO:teuthology.orchestra.run.smithi190.stdout:Need to get 77.0 MB of archives. 2023-10-08T15:51:25.231 INFO:teuthology.orchestra.run.smithi190.stdout:After this operation, 380 MB of additional disk space will be used. 2023-10-08T15:51:25.231 INFO:teuthology.orchestra.run.smithi190.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-164-generic amd64 5.4.0-164.181 [14.9 MB] 2023-10-08T15:51:25.293 INFO:teuthology.orchestra.run.smithi133.stdout:Building dependency tree... 2023-10-08T15:51:25.294 INFO:teuthology.orchestra.run.smithi133.stdout:Reading state information... 2023-10-08T15:51:25.467 INFO:teuthology.orchestra.run.smithi133.stdout:The following additional packages will be installed: 2023-10-08T15:51:25.467 INFO:teuthology.orchestra.run.smithi133.stdout: linux-generic linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-08T15:51:25.467 INFO:teuthology.orchestra.run.smithi133.stdout: linux-headers-generic linux-image-5.4.0-164-generic 2023-10-08T15:51:25.468 INFO:teuthology.orchestra.run.smithi133.stdout: linux-modules-5.4.0-164-generic linux-modules-extra-5.4.0-164-generic 2023-10-08T15:51:25.468 INFO:teuthology.orchestra.run.smithi133.stdout:Suggested packages: 2023-10-08T15:51:25.468 INFO:teuthology.orchestra.run.smithi133.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-10-08T15:51:25.469 INFO:teuthology.orchestra.run.smithi133.stdout:Recommended packages: 2023-10-08T15:51:25.469 INFO:teuthology.orchestra.run.smithi133.stdout: thermald 2023-10-08T15:51:25.519 INFO:teuthology.orchestra.run.smithi133.stdout:The following NEW packages will be installed: 2023-10-08T15:51:25.519 INFO:teuthology.orchestra.run.smithi133.stdout: linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-08T15:51:25.519 INFO:teuthology.orchestra.run.smithi133.stdout: linux-image-5.4.0-164-generic linux-modules-5.4.0-164-generic 2023-10-08T15:51:25.520 INFO:teuthology.orchestra.run.smithi133.stdout: linux-modules-extra-5.4.0-164-generic 2023-10-08T15:51:25.521 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages will be upgraded: 2023-10-08T15:51:25.521 INFO:teuthology.orchestra.run.smithi133.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-08T15:51:25.575 INFO:teuthology.orchestra.run.smithi133.stdout:3 upgraded, 5 newly installed, 0 to remove and 271 not upgraded. 2023-10-08T15:51:25.575 INFO:teuthology.orchestra.run.smithi133.stdout:Need to get 77.0 MB of archives. 2023-10-08T15:51:25.575 INFO:teuthology.orchestra.run.smithi133.stdout:After this operation, 380 MB of additional disk space will be used. 2023-10-08T15:51:25.575 INFO:teuthology.orchestra.run.smithi133.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-164-generic amd64 5.4.0-164.181 [14.9 MB] 2023-10-08T15:51:25.663 INFO:teuthology.orchestra.run.smithi190.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-164-generic amd64 5.4.0-164.181 [10.5 MB] 2023-10-08T15:51:25.861 INFO:teuthology.orchestra.run.smithi190.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-164-generic amd64 5.4.0-164.181 [39.2 MB] 2023-10-08T15:51:25.903 INFO:teuthology.orchestra.run.smithi133.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-164-generic amd64 5.4.0-164.181 [10.5 MB] 2023-10-08T15:51:25.994 INFO:teuthology.orchestra.run.smithi133.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-164-generic amd64 5.4.0-164.181 [39.2 MB] 2023-10-08T15:51:26.450 INFO:teuthology.orchestra.run.smithi133.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.164.161 [1,896 B] 2023-10-08T15:51:26.450 INFO:teuthology.orchestra.run.smithi133.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.164.161 [2,592 B] 2023-10-08T15:51:26.450 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164 all 5.4.0-164.181 [11.0 MB] 2023-10-08T15:51:26.541 INFO:teuthology.orchestra.run.smithi133.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164-generic amd64 5.4.0-164.181 [1,360 kB] 2023-10-08T15:51:26.551 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.164.161 [2,468 B] 2023-10-08T15:51:26.607 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.164.161 [1,896 B] 2023-10-08T15:51:26.607 INFO:teuthology.orchestra.run.smithi190.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.164.161 [2,592 B] 2023-10-08T15:51:26.608 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164 all 5.4.0-164.181 [11.0 MB] 2023-10-08T15:51:26.721 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164-generic amd64 5.4.0-164.181 [1,360 kB] 2023-10-08T15:51:26.733 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.164.161 [2,468 B] 2023-10-08T15:51:27.240 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 77.0 MB in 1s (75.3 MB/s) 2023-10-08T15:51:27.438 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package linux-modules-5.4.0-164-generic. 2023-10-08T15:51:27.453 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 77.0 MB in 2s (49.5 MB/s) 2023-10-08T15:51:27.624 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-modules-5.4.0-164-generic. 2023-10-08T15:51:29.185 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-10-08T15:51:29.190 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../0-linux-modules-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:51:29.285 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:51:29.355 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-10-08T15:51:29.360 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../0-linux-modules-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:51:29.505 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:51:31.179 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package linux-image-5.4.0-164-generic. 2023-10-08T15:51:31.192 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../1-linux-image-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:51:31.303 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:51:31.421 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-image-5.4.0-164-generic. 2023-10-08T15:51:31.435 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../1-linux-image-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:51:31.543 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:51:32.365 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-164-generic. 2023-10-08T15:51:32.378 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:51:32.406 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:51:32.665 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-164-generic. 2023-10-08T15:51:32.678 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:51:32.715 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:51:37.217 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../3-linux-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:51:37.369 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:51:37.618 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../3-linux-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:51:37.703 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:51:37.760 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:51:37.831 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-image-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:51:38.103 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:51:38.159 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package linux-headers-5.4.0-164. 2023-10-08T15:51:38.175 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../5-linux-headers-5.4.0-164_5.4.0-164.181_all.deb ... 2023-10-08T15:51:38.217 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-08T15:51:38.230 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-image-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:51:38.591 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-headers-5.4.0-164. 2023-10-08T15:51:38.607 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../5-linux-headers-5.4.0-164_5.4.0-164.181_all.deb ... 2023-10-08T15:51:38.649 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-08T15:51:43.719 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package linux-headers-5.4.0-164-generic. 2023-10-08T15:51:43.742 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../6-linux-headers-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:51:43.785 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:51:44.650 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-headers-5.4.0-164-generic. 2023-10-08T15:51:44.672 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../6-linux-headers-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T15:51:44.716 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:51:46.466 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:51:46.619 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-headers-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:51:46.953 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-08T15:51:47.082 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:51:47.225 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:51:47.480 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T15:51:47.608 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-headers-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T15:51:47.950 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-08T15:51:48.087 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:51:48.213 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:51:48.476 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:51:49.390 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:51:49.681 INFO:teuthology.orchestra.run.smithi133.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:51:49.681 INFO:teuthology.orchestra.run.smithi133.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-164-generic 2023-10-08T15:51:50.624 INFO:teuthology.orchestra.run.smithi190.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:51:50.624 INFO:teuthology.orchestra.run.smithi190.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-164-generic 2023-10-08T15:51:51.153 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-headers-generic (5.4.0.164.161) ... 2023-10-08T15:51:51.279 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:51:51.751 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-headers-generic (5.4.0.164.161) ... 2023-10-08T15:51:51.901 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:51:52.464 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-image-generic (5.4.0.164.161) ... 2023-10-08T15:51:52.607 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-generic (5.4.0.164.161) ... 2023-10-08T15:51:52.717 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:51:52.798 INFO:teuthology.orchestra.run.smithi133.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-08T15:51:52.798 INFO:teuthology.orchestra.run.smithi133.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:51:53.103 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-image-generic (5.4.0.164.161) ... 2023-10-08T15:51:53.221 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-generic (5.4.0.164.161) ... 2023-10-08T15:51:53.372 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T15:51:53.449 INFO:teuthology.orchestra.run.smithi190.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-08T15:51:53.450 INFO:teuthology.orchestra.run.smithi190.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:52:14.518 INFO:teuthology.orchestra.run.smithi133.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-08T15:52:14.518 INFO:teuthology.orchestra.run.smithi133.stdout:Sourcing file `/etc/default/grub' 2023-10-08T15:52:14.528 INFO:teuthology.orchestra.run.smithi133.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-08T15:52:14.556 INFO:teuthology.orchestra.run.smithi133.stdout:Generating grub configuration file ... 2023-10-08T15:52:14.933 INFO:teuthology.orchestra.run.smithi133.stdout:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:52:14.958 INFO:teuthology.orchestra.run.smithi133.stdout:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:52:15.262 INFO:teuthology.orchestra.run.smithi190.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-08T15:52:15.262 INFO:teuthology.orchestra.run.smithi190.stdout:Sourcing file `/etc/default/grub' 2023-10-08T15:52:15.272 INFO:teuthology.orchestra.run.smithi190.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-08T15:52:15.289 INFO:teuthology.orchestra.run.smithi190.stdout:Generating grub configuration file ... 2023-10-08T15:52:15.397 INFO:teuthology.orchestra.run.smithi133.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-08T15:52:15.409 INFO:teuthology.orchestra.run.smithi133.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-08T15:52:15.624 INFO:teuthology.orchestra.run.smithi190.stdout:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:52:15.649 INFO:teuthology.orchestra.run.smithi190.stdout:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:52:16.047 INFO:teuthology.orchestra.run.smithi190.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-08T15:52:16.058 INFO:teuthology.orchestra.run.smithi190.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-08T15:52:17.606 INFO:teuthology.orchestra.run.smithi133.stdout:done 2023-10-08T15:52:18.036 DEBUG:teuthology.orchestra.run.smithi133:> dpkg -s linux-image-generic 2023-10-08T15:52:18.079 INFO:teuthology.orchestra.run.smithi133.stdout:Package: linux-image-generic 2023-10-08T15:52:18.080 INFO:teuthology.orchestra.run.smithi133.stdout:Status: install ok installed 2023-10-08T15:52:18.080 INFO:teuthology.orchestra.run.smithi133.stdout:Priority: optional 2023-10-08T15:52:18.080 INFO:teuthology.orchestra.run.smithi133.stdout:Section: kernel 2023-10-08T15:52:18.080 INFO:teuthology.orchestra.run.smithi133.stdout:Installed-Size: 20 2023-10-08T15:52:18.080 INFO:teuthology.orchestra.run.smithi133.stdout:Maintainer: Ubuntu Kernel Team 2023-10-08T15:52:18.080 INFO:teuthology.orchestra.run.smithi133.stdout:Architecture: amd64 2023-10-08T15:52:18.080 INFO:teuthology.orchestra.run.smithi133.stdout:Source: linux-meta 2023-10-08T15:52:18.080 INFO:teuthology.orchestra.run.smithi133.stdout:Version: 5.4.0.164.161 2023-10-08T15:52:18.080 INFO:teuthology.orchestra.run.smithi133.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-08T15:52:18.080 INFO:teuthology.orchestra.run.smithi133.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-08T15:52:18.081 INFO:teuthology.orchestra.run.smithi133.stdout:Recommends: thermald 2023-10-08T15:52:18.081 INFO:teuthology.orchestra.run.smithi133.stdout:Description: Generic Linux kernel image 2023-10-08T15:52:18.081 INFO:teuthology.orchestra.run.smithi133.stdout: This package will always depend on the latest generic kernel image 2023-10-08T15:52:18.081 INFO:teuthology.orchestra.run.smithi133.stdout: available. 2023-10-08T15:52:18.081 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-164-generic 2023-10-08T15:52:18.081 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-08T15:52:18.081 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-08T15:52:18.081 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-08T15:52:18.081 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi133.front.sepia.ceph.com, path=None, version=distro) 2023-10-08T15:52:18.082 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-get clean 2023-10-08T15:52:18.167 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-get update 2023-10-08T15:52:18.293 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T15:52:18.294 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-08T15:52:18.299 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-08T15:52:18.316 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-08T15:52:18.753 INFO:teuthology.orchestra.run.smithi190.stdout:done 2023-10-08T15:52:19.170 DEBUG:teuthology.orchestra.run.smithi190:> dpkg -s linux-image-generic 2023-10-08T15:52:19.225 INFO:teuthology.orchestra.run.smithi190.stdout:Package: linux-image-generic 2023-10-08T15:52:19.225 INFO:teuthology.orchestra.run.smithi190.stdout:Status: install ok installed 2023-10-08T15:52:19.225 INFO:teuthology.orchestra.run.smithi190.stdout:Priority: optional 2023-10-08T15:52:19.225 INFO:teuthology.orchestra.run.smithi190.stdout:Section: kernel 2023-10-08T15:52:19.225 INFO:teuthology.orchestra.run.smithi190.stdout:Installed-Size: 20 2023-10-08T15:52:19.225 INFO:teuthology.orchestra.run.smithi190.stdout:Maintainer: Ubuntu Kernel Team 2023-10-08T15:52:19.225 INFO:teuthology.orchestra.run.smithi190.stdout:Architecture: amd64 2023-10-08T15:52:19.225 INFO:teuthology.orchestra.run.smithi190.stdout:Source: linux-meta 2023-10-08T15:52:19.225 INFO:teuthology.orchestra.run.smithi190.stdout:Version: 5.4.0.164.161 2023-10-08T15:52:19.225 INFO:teuthology.orchestra.run.smithi190.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-08T15:52:19.225 INFO:teuthology.orchestra.run.smithi190.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-08T15:52:19.226 INFO:teuthology.orchestra.run.smithi190.stdout:Recommends: thermald 2023-10-08T15:52:19.226 INFO:teuthology.orchestra.run.smithi190.stdout:Description: Generic Linux kernel image 2023-10-08T15:52:19.226 INFO:teuthology.orchestra.run.smithi190.stdout: This package will always depend on the latest generic kernel image 2023-10-08T15:52:19.226 INFO:teuthology.orchestra.run.smithi190.stdout: available. 2023-10-08T15:52:19.226 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-164-generic 2023-10-08T15:52:19.226 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-08T15:52:19.226 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-08T15:52:19.226 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-10-08T15:52:19.226 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi190.front.sepia.ceph.com, path=None, version=distro) 2023-10-08T15:52:19.227 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get clean 2023-10-08T15:52:19.328 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get update 2023-10-08T15:52:19.471 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T15:52:19.480 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-08T15:52:19.500 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-08T15:52:19.584 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-08T15:52:20.044 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2023-10-08T15:52:20.070 DEBUG:teuthology.orchestra.run.smithi133:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-08T15:52:20.143 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2023-10-08T15:52:20.344 INFO:teuthology.orchestra.run.smithi133.stdout:Building dependency tree... 2023-10-08T15:52:20.344 INFO:teuthology.orchestra.run.smithi133.stdout:Reading state information... 2023-10-08T15:52:20.558 INFO:teuthology.orchestra.run.smithi133.stdout:linux-image-generic is already the newest version (5.4.0.164.161). 2023-10-08T15:52:20.558 INFO:teuthology.orchestra.run.smithi133.stdout:0 upgraded, 0 newly installed, 0 to remove and 271 not upgraded. 2023-10-08T15:52:20.560 DEBUG:teuthology.orchestra.run.smithi133:> dpkg -s linux-image-generic 2023-10-08T15:52:20.581 INFO:teuthology.orchestra.run.smithi133.stdout:Package: linux-image-generic 2023-10-08T15:52:20.581 INFO:teuthology.orchestra.run.smithi133.stdout:Status: install ok installed 2023-10-08T15:52:20.581 INFO:teuthology.orchestra.run.smithi133.stdout:Priority: optional 2023-10-08T15:52:20.581 INFO:teuthology.orchestra.run.smithi133.stdout:Section: kernel 2023-10-08T15:52:20.581 INFO:teuthology.orchestra.run.smithi133.stdout:Installed-Size: 20 2023-10-08T15:52:20.581 INFO:teuthology.orchestra.run.smithi133.stdout:Maintainer: Ubuntu Kernel Team 2023-10-08T15:52:20.581 INFO:teuthology.orchestra.run.smithi133.stdout:Architecture: amd64 2023-10-08T15:52:20.582 INFO:teuthology.orchestra.run.smithi133.stdout:Source: linux-meta 2023-10-08T15:52:20.582 INFO:teuthology.orchestra.run.smithi133.stdout:Version: 5.4.0.164.161 2023-10-08T15:52:20.582 INFO:teuthology.orchestra.run.smithi133.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-08T15:52:20.582 INFO:teuthology.orchestra.run.smithi133.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-08T15:52:20.582 INFO:teuthology.orchestra.run.smithi133.stdout:Recommends: thermald 2023-10-08T15:52:20.582 INFO:teuthology.orchestra.run.smithi133.stdout:Description: Generic Linux kernel image 2023-10-08T15:52:20.582 INFO:teuthology.orchestra.run.smithi133.stdout: This package will always depend on the latest generic kernel image 2023-10-08T15:52:20.582 INFO:teuthology.orchestra.run.smithi133.stdout: available. 2023-10-08T15:52:20.582 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2023-10-08T15:52:20.628 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.RsY6lumUo4 2023-10-08T15:52:20.628 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /boot/grub/grub.cfg /tmp/tmp.RsY6lumUo4 2023-10-08T15:52:20.643 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.RsY6lumUo4 2023-10-08T15:52:20.681 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.RsY6lumUo4 is 9KB 2023-10-08T15:52:20.696 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.RsY6lumUo4 2023-10-08T15:52:20.702 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-08T15:52:20.756 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-08T15:52:20.757 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-08T15:52:20.757 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-08T15:52:20.791 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-164-generic 2023-10-08T15:52:20.791 DEBUG:teuthology.orchestra.run.smithi133:> sudo update-grub 2023-10-08T15:52:21.211 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2023-10-08T15:52:21.236 DEBUG:teuthology.orchestra.run.smithi190:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-08T15:52:21.301 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2023-10-08T15:52:21.500 INFO:teuthology.orchestra.run.smithi190.stdout:Building dependency tree... 2023-10-08T15:52:21.501 INFO:teuthology.orchestra.run.smithi190.stdout:Reading state information... 2023-10-08T15:52:21.713 INFO:teuthology.orchestra.run.smithi190.stdout:linux-image-generic is already the newest version (5.4.0.164.161). 2023-10-08T15:52:21.713 INFO:teuthology.orchestra.run.smithi190.stdout:0 upgraded, 0 newly installed, 0 to remove and 271 not upgraded. 2023-10-08T15:52:21.714 DEBUG:teuthology.orchestra.run.smithi190:> dpkg -s linux-image-generic 2023-10-08T15:52:21.736 INFO:teuthology.orchestra.run.smithi190.stdout:Package: linux-image-generic 2023-10-08T15:52:21.736 INFO:teuthology.orchestra.run.smithi190.stdout:Status: install ok installed 2023-10-08T15:52:21.736 INFO:teuthology.orchestra.run.smithi190.stdout:Priority: optional 2023-10-08T15:52:21.736 INFO:teuthology.orchestra.run.smithi190.stdout:Section: kernel 2023-10-08T15:52:21.736 INFO:teuthology.orchestra.run.smithi190.stdout:Installed-Size: 20 2023-10-08T15:52:21.736 INFO:teuthology.orchestra.run.smithi190.stdout:Maintainer: Ubuntu Kernel Team 2023-10-08T15:52:21.736 INFO:teuthology.orchestra.run.smithi190.stdout:Architecture: amd64 2023-10-08T15:52:21.736 INFO:teuthology.orchestra.run.smithi190.stdout:Source: linux-meta 2023-10-08T15:52:21.737 INFO:teuthology.orchestra.run.smithi190.stdout:Version: 5.4.0.164.161 2023-10-08T15:52:21.737 INFO:teuthology.orchestra.run.smithi190.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-08T15:52:21.737 INFO:teuthology.orchestra.run.smithi190.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-08T15:52:21.737 INFO:teuthology.orchestra.run.smithi190.stdout:Recommends: thermald 2023-10-08T15:52:21.737 INFO:teuthology.orchestra.run.smithi190.stdout:Description: Generic Linux kernel image 2023-10-08T15:52:21.737 INFO:teuthology.orchestra.run.smithi190.stdout: This package will always depend on the latest generic kernel image 2023-10-08T15:52:21.737 INFO:teuthology.orchestra.run.smithi190.stdout: available. 2023-10-08T15:52:21.737 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2023-10-08T15:52:21.741 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.SvGPX9cugP 2023-10-08T15:52:21.741 DEBUG:teuthology.orchestra.run.smithi190:> sudo cp /boot/grub/grub.cfg /tmp/tmp.SvGPX9cugP 2023-10-08T15:52:21.799 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.SvGPX9cugP 2023-10-08T15:52:21.837 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.SvGPX9cugP is 9KB 2023-10-08T15:52:21.851 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.SvGPX9cugP 2023-10-08T15:52:21.857 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-08T15:52:21.913 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-08T15:52:21.913 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-08T15:52:21.913 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-08T15:52:21.950 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-164-generic 2023-10-08T15:52:21.950 DEBUG:teuthology.orchestra.run.smithi190:> sudo update-grub 2023-10-08T15:52:22.165 INFO:teuthology.orchestra.run.smithi133.stderr:Sourcing file `/etc/default/grub' 2023-10-08T15:52:22.177 INFO:teuthology.orchestra.run.smithi133.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-08T15:52:22.185 INFO:teuthology.orchestra.run.smithi133.stderr:Generating grub configuration file ... 2023-10-08T15:52:22.481 INFO:teuthology.orchestra.run.smithi133.stderr:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:52:22.492 INFO:teuthology.orchestra.run.smithi133.stderr:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:52:22.905 INFO:teuthology.orchestra.run.smithi133.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-08T15:52:22.916 INFO:teuthology.orchestra.run.smithi133.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-08T15:52:23.354 INFO:teuthology.orchestra.run.smithi190.stderr:Sourcing file `/etc/default/grub' 2023-10-08T15:52:23.362 INFO:teuthology.orchestra.run.smithi190.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-08T15:52:23.371 INFO:teuthology.orchestra.run.smithi190.stderr:Generating grub configuration file ... 2023-10-08T15:52:23.619 INFO:teuthology.orchestra.run.smithi190.stderr:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-08T15:52:23.631 INFO:teuthology.orchestra.run.smithi190.stderr:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-08T15:52:23.971 INFO:teuthology.orchestra.run.smithi133.stderr:done 2023-10-08T15:52:23.973 DEBUG:teuthology.orchestra.run.smithi133:> sudo shutdown -r now 2023-10-08T15:52:23.987 INFO:teuthology.orchestra.run.smithi190.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-08T15:52:23.999 INFO:teuthology.orchestra.run.smithi190.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-08T15:52:25.682 INFO:teuthology.orchestra.run.smithi190.stderr:done 2023-10-08T15:52:25.684 DEBUG:teuthology.orchestra.run.smithi190:> sudo shutdown -r now 2023-10-08T15:52:54.004 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-08T15:52:54.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-10-08T15:52:54.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:52:55.689 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-08T15:52:55.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-10-08T15:52:55.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:53:12.574 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-10-08T15:53:14.106 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-10-08T15:53:21.583 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-10-08T15:53:21.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:53:23.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-10-08T15:53:23.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:53:24.634 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-10-08T15:53:26.174 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-10-08T15:53:36.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-10-08T15:53:36.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:53:38.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-10-08T15:53:38.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:53:56.602 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-10-08T15:54:08.338 DEBUG:teuthology.orchestra.run.smithi133:> true 2023-10-08T15:54:08.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-10-08T15:54:08.930 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-164-generic"... 2023-10-08T15:54:08.930 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2023-10-08T15:54:08.936 INFO:teuthology.orchestra.run.smithi133.stdout:5.4.0-164-generic 2023-10-08T15:54:08.936 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-164-generic vs 5.4.0-164-generic 2023-10-08T15:54:08.937 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-08T15:54:08.937 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-08T15:54:09.938 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-08T15:54:09.938 DEBUG:teuthology.orchestra.run.smithi133:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-08T15:54:10.032 INFO:teuthology.orchestra.run.smithi133.stdout:ttyS1 2023-10-08T15:54:10.057 DEBUG:teuthology.parallel:result is None 2023-10-08T15:54:12.495 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-10-08T15:54:12.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:54:12.703 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-10-08T15:54:13.259 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-10-08T15:54:13.259 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-164-generic"... 2023-10-08T15:54:13.259 DEBUG:teuthology.orchestra.run.smithi190:> uname -r 2023-10-08T15:54:13.266 INFO:teuthology.orchestra.run.smithi190.stdout:5.4.0-164-generic 2023-10-08T15:54:13.266 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-164-generic vs 5.4.0-164-generic 2023-10-08T15:54:13.266 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-08T15:54:13.266 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-08T15:54:14.267 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-08T15:54:14.267 DEBUG:teuthology.orchestra.run.smithi190:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-08T15:54:14.357 INFO:teuthology.orchestra.run.smithi190.stdout:ttyS1 2023-10-08T15:54:14.382 DEBUG:teuthology.parallel:result is None 2023-10-08T15:54:14.383 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-08T15:54:14.390 INFO:teuthology.task.internal:Creating test directory... 2023-10-08T15:54:14.391 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T15:54:14.393 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T15:54:14.400 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-08T15:54:14.406 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-08T15:54:14.416 INFO:teuthology.task.internal:Creating archive directory... 2023-10-08T15:54:14.417 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T15:54:14.419 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T15:54:14.441 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-08T15:54:14.448 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-08T15:54:14.448 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T15:54:14.481 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T15:54:14.499 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:54:14.503 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:54:14.510 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:54:14.514 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:54:14.516 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-08T15:54:14.523 INFO:teuthology.task.internal:Configuring sudo... 2023-10-08T15:54:14.523 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T15:54:14.525 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T15:54:14.540 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-08T15:54:14.549 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-08T15:54:14.550 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T15:54:14.552 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T15:54:14.558 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T15:54:14.605 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T15:54:14.612 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-08T15:54:14.612 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T15:54:14.637 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T15:54:14.644 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T15:54:14.651 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-08T15:54:14.652 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T15:54:14.672 DEBUG:teuthology.orchestra.run.smithi133:> sudo service rsyslog restart 2023-10-08T15:54:14.680 DEBUG:teuthology.orchestra.run.smithi190:> sudo service rsyslog restart 2023-10-08T15:54:14.776 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-08T15:54:14.784 INFO:teuthology.task.internal:Starting timer... 2023-10-08T15:54:14.784 INFO:teuthology.run_tasks:Running task pcp... 2023-10-08T15:54:14.796 INFO:teuthology.run_tasks:Running task selinux... 2023-10-08T15:54:14.805 DEBUG:teuthology.task.selinux:Excluding smithi133: OS 'ubuntu' does not support SELinux 2023-10-08T15:54:14.805 DEBUG:teuthology.task.selinux:Excluding smithi190: OS 'ubuntu' does not support SELinux 2023-10-08T15:54:14.805 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-08T15:54:14.805 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-10-08T15:54:14.806 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-08T15:54:14.806 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-08T15:54:14.816 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-08T15:54:14.816 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-08T15:54:14.832 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-08T15:54:14.833 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi133.front.sepia.ceph.com,smithi190.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-08T16:00:11.963 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi133.front.sepia.ceph.com'), Remote(name='ubuntu@smithi190.front.sepia.ceph.com')] 2023-10-08T16:00:11.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-10-08T16:00:11.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T16:00:12.015 DEBUG:teuthology.orchestra.run.smithi133:> true 2023-10-08T16:00:12.140 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-10-08T16:00:12.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-10-08T16:00:12.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T16:00:12.188 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-10-08T16:00:12.316 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-10-08T16:00:12.316 INFO:teuthology.run_tasks:Running task clock... 2023-10-08T16:00:12.330 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-08T16:00:12.330 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T16:00:12.330 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T16:00:12.332 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T16:00:12.333 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T16:00:12.363 INFO:teuthology.orchestra.run.smithi133.stdout: 8 Oct 16:00:12 ntpd[22912]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-08T16:00:12.364 INFO:teuthology.orchestra.run.smithi133.stdout: 8 Oct 16:00:12 ntpd[22912]: Command line: ntpd -gq 2023-10-08T16:00:12.364 INFO:teuthology.orchestra.run.smithi133.stdout: 8 Oct 16:00:12 ntpd[22912]: proto: precision = 0.087 usec (-23) 2023-10-08T16:00:12.365 INFO:teuthology.orchestra.run.smithi133.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T16:00:12.365 INFO:teuthology.orchestra.run.smithi133.stdout: 8 Oct 16:00:12 ntpd[22912]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T16:00:12.365 INFO:teuthology.orchestra.run.smithi133.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-08T16:00:12.366 INFO:teuthology.orchestra.run.smithi133.stdout: 8 Oct 16:00:12 ntpd[22912]: restrict ::: KOD does nothing without LIMITED. 2023-10-08T16:00:12.366 INFO:teuthology.orchestra.run.smithi133.stdout: 8 Oct 16:00:12 ntpd[22912]: Listen and drop on 0 v6wildcard [::]:123 2023-10-08T16:00:12.367 INFO:teuthology.orchestra.run.smithi133.stdout: 8 Oct 16:00:12 ntpd[22912]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-08T16:00:12.367 INFO:teuthology.orchestra.run.smithi133.stdout: 8 Oct 16:00:12 ntpd[22912]: Listen normally on 2 lo 127.0.0.1:123 2023-10-08T16:00:12.367 INFO:teuthology.orchestra.run.smithi133.stdout: 8 Oct 16:00:12 ntpd[22912]: Listen normally on 3 enp3s0f1 172.21.15.133:123 2023-10-08T16:00:12.367 INFO:teuthology.orchestra.run.smithi133.stdout: 8 Oct 16:00:12 ntpd[22912]: Listen normally on 4 lo [::1]:123 2023-10-08T16:00:12.367 INFO:teuthology.orchestra.run.smithi133.stdout: 8 Oct 16:00:12 ntpd[22912]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8087%5]:123 2023-10-08T16:00:12.367 INFO:teuthology.orchestra.run.smithi133.stdout: 8 Oct 16:00:12 ntpd[22912]: Listening on routing socket on fd #22 for interface updates 2023-10-08T16:00:12.367 INFO:teuthology.orchestra.run.smithi190.stdout: 8 Oct 16:00:12 ntpd[22875]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-08T16:00:12.368 INFO:teuthology.orchestra.run.smithi190.stdout: 8 Oct 16:00:12 ntpd[22875]: Command line: ntpd -gq 2023-10-08T16:00:12.368 INFO:teuthology.orchestra.run.smithi190.stdout: 8 Oct 16:00:12 ntpd[22875]: proto: precision = 0.064 usec (-24) 2023-10-08T16:00:12.368 INFO:teuthology.orchestra.run.smithi190.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T16:00:12.368 INFO:teuthology.orchestra.run.smithi190.stdout: 8 Oct 16:00:12 ntpd[22875]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T16:00:12.369 INFO:teuthology.orchestra.run.smithi190.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-08T16:00:12.369 INFO:teuthology.orchestra.run.smithi190.stdout: 8 Oct 16:00:12 ntpd[22875]: restrict ::: KOD does nothing without LIMITED. 2023-10-08T16:00:12.370 INFO:teuthology.orchestra.run.smithi190.stdout: 8 Oct 16:00:12 ntpd[22875]: Listen and drop on 0 v6wildcard [::]:123 2023-10-08T16:00:12.370 INFO:teuthology.orchestra.run.smithi190.stdout: 8 Oct 16:00:12 ntpd[22875]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-08T16:00:12.370 INFO:teuthology.orchestra.run.smithi190.stdout: 8 Oct 16:00:12 ntpd[22875]: Listen normally on 2 lo 127.0.0.1:123 2023-10-08T16:00:12.370 INFO:teuthology.orchestra.run.smithi190.stdout: 8 Oct 16:00:12 ntpd[22875]: Listen normally on 3 enp3s0f1 172.21.15.190:123 2023-10-08T16:00:12.370 INFO:teuthology.orchestra.run.smithi190.stdout: 8 Oct 16:00:12 ntpd[22875]: Listen normally on 4 lo [::1]:123 2023-10-08T16:00:12.370 INFO:teuthology.orchestra.run.smithi190.stdout: 8 Oct 16:00:12 ntpd[22875]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7763%5]:123 2023-10-08T16:00:12.370 INFO:teuthology.orchestra.run.smithi190.stdout: 8 Oct 16:00:12 ntpd[22875]: Listening on routing socket on fd #22 for interface updates 2023-10-08T16:00:13.365 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:13 ntpd[22912]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:13.365 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:13 ntpd[22912]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:13.365 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:13 ntpd[22912]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:13.365 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:13 ntpd[22912]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:13.365 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:13 ntpd[22912]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:13.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:13 ntpd[22912]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:13.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:13 ntpd[22912]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:13.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:13 ntpd[22912]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:13.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:13 ntpd[22912]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:00:13.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:13 ntpd[22912]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:00:13.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:13 ntpd[22912]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:13.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:13 ntpd[22912]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:13.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:13 ntpd[22912]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:00:13.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:13 ntpd[22912]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:00:13.367 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:13 ntpd[22875]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:13.367 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:13 ntpd[22875]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:14.364 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:14 ntpd[22912]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:14.365 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:14 ntpd[22912]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:14.365 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:14 ntpd[22912]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:14.365 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:14 ntpd[22912]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:14.365 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:14 ntpd[22912]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:00:14.365 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:14 ntpd[22912]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:00:14.366 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:14 ntpd[22875]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:14.366 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:14 ntpd[22875]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:14.366 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:14 ntpd[22875]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:14.366 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:14 ntpd[22875]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:14.366 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:14 ntpd[22875]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:00:14.366 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:14 ntpd[22875]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:00:15.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:15 ntpd[22912]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:15.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:15 ntpd[22912]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:15.367 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:15 ntpd[22912]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:15.367 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:15 ntpd[22912]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:15.367 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:15 ntpd[22912]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:15.367 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:15 ntpd[22912]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:15.367 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:15 ntpd[22912]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:00:15.367 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:15 ntpd[22912]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:00:15.368 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:15 ntpd[22912]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:15.368 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:15 ntpd[22912]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:15.368 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:15 ntpd[22912]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:00:15.368 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:15 ntpd[22912]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:00:15.370 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:15 ntpd[22875]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:15.370 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:15 ntpd[22875]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:15.371 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:15 ntpd[22875]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:15.371 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:15 ntpd[22875]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:15.371 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:15 ntpd[22875]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:15.371 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:15 ntpd[22875]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:15.371 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:15 ntpd[22875]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:00:15.371 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:15 ntpd[22875]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:00:15.372 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:15 ntpd[22875]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:15.372 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:15 ntpd[22875]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:15.372 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:15 ntpd[22875]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:00:15.372 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:15 ntpd[22875]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:00:16.365 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:16 ntpd[22912]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:16.365 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:16 ntpd[22912]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:16.365 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:16 ntpd[22912]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:16.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:16 ntpd[22912]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:16.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:16 ntpd[22912]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:00:16.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:16 ntpd[22912]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:00:16.367 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:16 ntpd[22875]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:16.367 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:16 ntpd[22875]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:16.367 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:16 ntpd[22875]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:16.367 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:16 ntpd[22875]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:16.368 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:16 ntpd[22875]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:00:16.368 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:16 ntpd[22875]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:00:17.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:17 ntpd[22912]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:17.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:17 ntpd[22912]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:17.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:17 ntpd[22912]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:17.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:17 ntpd[22912]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:17.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:17 ntpd[22912]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:17.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:17 ntpd[22912]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:17.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:17 ntpd[22912]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:00:17.367 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:17 ntpd[22912]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:00:17.367 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:17 ntpd[22912]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:17.367 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:17 ntpd[22912]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:17.370 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:17 ntpd[22912]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:00:17.370 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:17 ntpd[22912]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:00:17.373 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:17 ntpd[22875]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:17.373 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:17 ntpd[22875]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:17.373 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:17 ntpd[22875]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:17.373 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:17 ntpd[22875]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:17.374 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:17 ntpd[22875]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:17.374 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:17 ntpd[22875]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:17.374 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:17 ntpd[22875]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:00:17.374 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:17 ntpd[22875]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:00:17.374 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:17 ntpd[22875]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:17.375 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:17 ntpd[22875]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:17.375 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:17 ntpd[22875]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:00:17.375 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:17 ntpd[22875]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:00:18.364 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:18 ntpd[22912]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:18.364 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:18 ntpd[22912]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:18.365 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:18 ntpd[22912]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:18.365 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:18 ntpd[22912]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:18.365 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:18 ntpd[22912]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:00:18.365 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:18 ntpd[22912]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:00:18.366 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:18 ntpd[22875]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:18.366 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:18 ntpd[22875]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:18.366 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:18 ntpd[22875]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:18.367 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:18 ntpd[22875]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:18.367 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:18 ntpd[22875]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:00:18.367 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:18 ntpd[22875]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:00:19.365 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:19 ntpd[22912]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:19.365 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:19 ntpd[22912]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:19.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:19 ntpd[22912]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:19.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:19 ntpd[22912]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:19.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:19 ntpd[22912]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:19.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:19 ntpd[22912]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:19.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:19 ntpd[22912]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:00:19.366 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:19 ntpd[22912]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:00:19.367 INFO:teuthology.orchestra.run.smithi133.stdout: 8 Oct 16:00:19 ntpd[22912]: ntpd: time slew +0.007599 s 2023-10-08T16:00:19.367 INFO:teuthology.orchestra.run.smithi133.stdout:ntpd: time slew +0.007599s 2023-10-08T16:00:19.367 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:19 ntpd[22912]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-08T16:00:19.368 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Oct 16:00:19 ntpd[22912]: can't open /var/log/ntpstats/loopstats.20231008: Permission denied 2023-10-08T16:00:19.369 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:19 ntpd[22875]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:19.369 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:19 ntpd[22875]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:19.369 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:19 ntpd[22875]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:19.369 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:19 ntpd[22875]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:19.369 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:19 ntpd[22875]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:19.369 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:19 ntpd[22875]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:19.369 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:19 ntpd[22875]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:00:19.369 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:19 ntpd[22875]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:00:19.369 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:19 ntpd[22875]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:19.369 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:19 ntpd[22875]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:19.369 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:19 ntpd[22875]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:00:19.370 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:19 ntpd[22875]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:00:19.439 INFO:teuthology.orchestra.run.smithi133.stdout: remote refid st t when poll reach delay offset jitter 2023-10-08T16:00:19.439 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================== 2023-10-08T16:00:19.439 INFO:teuthology.orchestra.run.smithi133.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T16:00:19.439 INFO:teuthology.orchestra.run.smithi133.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T16:00:19.439 INFO:teuthology.orchestra.run.smithi133.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T16:00:19.439 INFO:teuthology.orchestra.run.smithi133.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T16:00:20.366 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:20 ntpd[22875]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:20.366 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:20 ntpd[22875]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:20.366 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:20 ntpd[22875]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T16:00:20.366 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:20 ntpd[22875]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T16:00:20.366 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:20 ntpd[22875]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T16:00:20.367 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:20 ntpd[22875]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T16:00:20.367 INFO:teuthology.orchestra.run.smithi190.stdout: 8 Oct 16:00:20 ntpd[22875]: ntpd: time slew +0.002968 s 2023-10-08T16:00:20.367 INFO:teuthology.orchestra.run.smithi190.stdout:ntpd: time slew +0.002968s 2023-10-08T16:00:20.367 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:20 ntpd[22875]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-08T16:00:20.367 INFO:teuthology.orchestra.run.smithi190.stderr: 8 Oct 16:00:20 ntpd[22875]: can't open /var/log/ntpstats/loopstats.20231008: Permission denied 2023-10-08T16:00:20.432 INFO:teuthology.orchestra.run.smithi190.stdout: remote refid st t when poll reach delay offset jitter 2023-10-08T16:00:20.432 INFO:teuthology.orchestra.run.smithi190.stdout:============================================================================== 2023-10-08T16:00:20.432 INFO:teuthology.orchestra.run.smithi190.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T16:00:20.433 INFO:teuthology.orchestra.run.smithi190.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T16:00:20.433 INFO:teuthology.orchestra.run.smithi190.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T16:00:20.433 INFO:teuthology.orchestra.run.smithi190.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T16:00:20.433 INFO:teuthology.run_tasks:Running task install... 2023-10-08T16:00:20.452 DEBUG:teuthology.task.install:project ceph 2023-10-08T16:00:20.453 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}} 2023-10-08T16:00:20.453 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'} 2023-10-08T16:00:20.453 INFO:teuthology.task.install:Using flavor: default 2023-10-08T16:00:20.458 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-08T16:00:20.459 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-08T16:00:20.459 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-key list | grep Ceph 2023-10-08T16:00:20.459 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-key list | grep Ceph 2023-10-08T16:00:20.561 INFO:teuthology.orchestra.run.smithi133.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-08T16:00:20.575 INFO:teuthology.orchestra.run.smithi190.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-08T16:00:20.625 INFO:teuthology.orchestra.run.smithi133.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-08T16:00:20.625 INFO:teuthology.orchestra.run.smithi133.stdout:uid [ unknown] Ceph.com (release key) 2023-10-08T16:00:20.626 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-08T16:00:20.626 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-10-08T16:00:20.626 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T16:00:20.636 INFO:teuthology.orchestra.run.smithi190.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-08T16:00:20.636 INFO:teuthology.orchestra.run.smithi190.stdout:uid [ unknown] Ceph.com (release key) 2023-10-08T16:00:20.637 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-08T16:00:20.637 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-10-08T16:00:20.638 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T16:00:20.768 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default/ 2023-10-08T16:00:20.768 INFO:teuthology.task.install.deb:Package version is 17.2.6-1320-g08cac018-1focal 2023-10-08T16:00:20.780 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default/ 2023-10-08T16:00:20.780 INFO:teuthology.task.install.deb:Package version is 17.2.6-1320-g08cac018-1focal 2023-10-08T16:00:21.131 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-08T16:00:21.131 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-08T16:00:21.143 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-08T16:00:21.143 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-08T16:00:21.148 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-get update 2023-10-08T16:00:21.159 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get update 2023-10-08T16:00:21.299 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T16:00:21.304 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-08T16:00:21.321 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-08T16:00:21.364 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-08T16:00:21.378 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-08T16:00:21.409 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T16:00:21.490 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-08T16:00:21.540 INFO:teuthology.orchestra.run.smithi133.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal InRelease 2023-10-08T16:00:21.572 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-08T16:00:21.608 INFO:teuthology.orchestra.run.smithi190.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal InRelease 2023-10-08T16:00:21.610 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-08T16:00:21.684 INFO:teuthology.orchestra.run.smithi133.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal Release.gpg 2023-10-08T16:00:21.695 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-08T16:00:21.754 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-08T16:00:21.783 INFO:teuthology.orchestra.run.smithi190.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal Release.gpg 2023-10-08T16:00:21.842 INFO:teuthology.orchestra.run.smithi133.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main i386 Packages [3,366 B] 2023-10-08T16:00:21.870 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main i386 Packages [3,366 B] 2023-10-08T16:00:21.979 INFO:teuthology.orchestra.run.smithi190.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-08T16:00:22.021 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 28.4 kB in 1s (40.2 kB/s) 2023-10-08T16:00:22.074 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 28.4 kB in 1s (37.5 kB/s) 2023-10-08T16:00:23.067 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2023-10-08T16:00:23.092 DEBUG:teuthology.orchestra.run.smithi133:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1320-g08cac018-1focal cephadm=17.2.6-1320-g08cac018-1focal ceph-mds=17.2.6-1320-g08cac018-1focal ceph-mgr=17.2.6-1320-g08cac018-1focal ceph-common=17.2.6-1320-g08cac018-1focal ceph-fuse=17.2.6-1320-g08cac018-1focal ceph-test=17.2.6-1320-g08cac018-1focal ceph-volume=17.2.6-1320-g08cac018-1focal radosgw=17.2.6-1320-g08cac018-1focal python3-rados=17.2.6-1320-g08cac018-1focal python3-rgw=17.2.6-1320-g08cac018-1focal python3-cephfs=17.2.6-1320-g08cac018-1focal python3-rbd=17.2.6-1320-g08cac018-1focal libcephfs2=17.2.6-1320-g08cac018-1focal libcephfs-dev=17.2.6-1320-g08cac018-1focal librados2=17.2.6-1320-g08cac018-1focal librbd1=17.2.6-1320-g08cac018-1focal rbd-fuse=17.2.6-1320-g08cac018-1focal python3-cephfs=17.2.6-1320-g08cac018-1focal cephfs-shell=17.2.6-1320-g08cac018-1focal cephfs-top=17.2.6-1320-g08cac018-1focal cephfs-mirror=17.2.6-1320-g08cac018-1focal 2023-10-08T16:00:23.109 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2023-10-08T16:00:23.135 DEBUG:teuthology.orchestra.run.smithi190:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1320-g08cac018-1focal cephadm=17.2.6-1320-g08cac018-1focal ceph-mds=17.2.6-1320-g08cac018-1focal ceph-mgr=17.2.6-1320-g08cac018-1focal ceph-common=17.2.6-1320-g08cac018-1focal ceph-fuse=17.2.6-1320-g08cac018-1focal ceph-test=17.2.6-1320-g08cac018-1focal ceph-volume=17.2.6-1320-g08cac018-1focal radosgw=17.2.6-1320-g08cac018-1focal python3-rados=17.2.6-1320-g08cac018-1focal python3-rgw=17.2.6-1320-g08cac018-1focal python3-cephfs=17.2.6-1320-g08cac018-1focal python3-rbd=17.2.6-1320-g08cac018-1focal libcephfs2=17.2.6-1320-g08cac018-1focal libcephfs-dev=17.2.6-1320-g08cac018-1focal librados2=17.2.6-1320-g08cac018-1focal librbd1=17.2.6-1320-g08cac018-1focal rbd-fuse=17.2.6-1320-g08cac018-1focal python3-cephfs=17.2.6-1320-g08cac018-1focal cephfs-shell=17.2.6-1320-g08cac018-1focal cephfs-top=17.2.6-1320-g08cac018-1focal cephfs-mirror=17.2.6-1320-g08cac018-1focal 2023-10-08T16:00:23.161 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2023-10-08T16:00:23.209 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2023-10-08T16:00:23.340 INFO:teuthology.orchestra.run.smithi133.stdout:Building dependency tree... 2023-10-08T16:00:23.341 INFO:teuthology.orchestra.run.smithi133.stdout:Reading state information... 2023-10-08T16:00:23.410 INFO:teuthology.orchestra.run.smithi190.stdout:Building dependency tree... 2023-10-08T16:00:23.411 INFO:teuthology.orchestra.run.smithi190.stdout:Reading state information... 2023-10-08T16:00:23.515 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T16:00:23.519 INFO:teuthology.orchestra.run.smithi133.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-08T16:00:23.520 INFO:teuthology.orchestra.run.smithi133.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T16:00:23.520 INFO:teuthology.orchestra.run.smithi133.stdout:The following additional packages will be installed: 2023-10-08T16:00:23.520 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-08T16:00:23.520 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-08T16:00:23.520 INFO:teuthology.orchestra.run.smithi133.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-08T16:00:23.520 INFO:teuthology.orchestra.run.smithi133.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-08T16:00:23.520 INFO:teuthology.orchestra.run.smithi133.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-08T16:00:23.520 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-08T16:00:23.520 INFO:teuthology.orchestra.run.smithi133.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-10-08T16:00:23.520 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-08T16:00:23.521 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-10-08T16:00:23.521 INFO:teuthology.orchestra.run.smithi133.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-08T16:00:23.521 INFO:teuthology.orchestra.run.smithi133.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-08T16:00:23.521 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-08T16:00:23.521 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-08T16:00:23.521 INFO:teuthology.orchestra.run.smithi133.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-08T16:00:23.521 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-08T16:00:23.521 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-08T16:00:23.522 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-10-08T16:00:23.522 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-10-08T16:00:23.522 INFO:teuthology.orchestra.run.smithi133.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-08T16:00:23.522 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-08T16:00:23.522 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-08T16:00:23.522 INFO:teuthology.orchestra.run.smithi133.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-08T16:00:23.522 INFO:teuthology.orchestra.run.smithi133.stdout:Suggested packages: 2023-10-08T16:00:23.522 INFO:teuthology.orchestra.run.smithi133.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-08T16:00:23.522 INFO:teuthology.orchestra.run.smithi133.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-08T16:00:23.522 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-08T16:00:23.523 INFO:teuthology.orchestra.run.smithi133.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-08T16:00:23.523 INFO:teuthology.orchestra.run.smithi133.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-08T16:00:23.523 INFO:teuthology.orchestra.run.smithi133.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-08T16:00:23.523 INFO:teuthology.orchestra.run.smithi133.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-08T16:00:23.523 INFO:teuthology.orchestra.run.smithi133.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-08T16:00:23.523 INFO:teuthology.orchestra.run.smithi133.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-08T16:00:23.523 INFO:teuthology.orchestra.run.smithi133.stdout:Recommended packages: 2023-10-08T16:00:23.523 INFO:teuthology.orchestra.run.smithi133.stdout: btrfs-tools 2023-10-08T16:00:23.588 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T16:00:23.589 INFO:teuthology.orchestra.run.smithi190.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-08T16:00:23.589 INFO:teuthology.orchestra.run.smithi190.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T16:00:23.589 INFO:teuthology.orchestra.run.smithi190.stdout:The following additional packages will be installed: 2023-10-08T16:00:23.590 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-08T16:00:23.590 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-08T16:00:23.590 INFO:teuthology.orchestra.run.smithi190.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-08T16:00:23.590 INFO:teuthology.orchestra.run.smithi190.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-08T16:00:23.590 INFO:teuthology.orchestra.run.smithi190.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-08T16:00:23.592 INFO:teuthology.orchestra.run.smithi190.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-08T16:00:23.592 INFO:teuthology.orchestra.run.smithi190.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-10-08T16:00:23.592 INFO:teuthology.orchestra.run.smithi190.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-08T16:00:23.592 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-10-08T16:00:23.592 INFO:teuthology.orchestra.run.smithi190.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-08T16:00:23.592 INFO:teuthology.orchestra.run.smithi190.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-08T16:00:23.592 INFO:teuthology.orchestra.run.smithi190.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-08T16:00:23.592 INFO:teuthology.orchestra.run.smithi190.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-08T16:00:23.593 INFO:teuthology.orchestra.run.smithi190.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-08T16:00:23.593 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-08T16:00:23.593 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-08T16:00:23.593 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-10-08T16:00:23.593 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-10-08T16:00:23.593 INFO:teuthology.orchestra.run.smithi190.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-08T16:00:23.593 INFO:teuthology.orchestra.run.smithi190.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-08T16:00:23.593 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-08T16:00:23.593 INFO:teuthology.orchestra.run.smithi190.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-08T16:00:23.593 INFO:teuthology.orchestra.run.smithi190.stdout:Suggested packages: 2023-10-08T16:00:23.593 INFO:teuthology.orchestra.run.smithi190.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-08T16:00:23.593 INFO:teuthology.orchestra.run.smithi190.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-08T16:00:23.594 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-08T16:00:23.594 INFO:teuthology.orchestra.run.smithi190.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-08T16:00:23.594 INFO:teuthology.orchestra.run.smithi190.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-08T16:00:23.594 INFO:teuthology.orchestra.run.smithi190.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-08T16:00:23.594 INFO:teuthology.orchestra.run.smithi190.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-08T16:00:23.594 INFO:teuthology.orchestra.run.smithi190.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-08T16:00:23.594 INFO:teuthology.orchestra.run.smithi190.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-08T16:00:23.594 INFO:teuthology.orchestra.run.smithi190.stdout:Recommended packages: 2023-10-08T16:00:23.594 INFO:teuthology.orchestra.run.smithi190.stdout: btrfs-tools 2023-10-08T16:00:23.642 INFO:teuthology.orchestra.run.smithi133.stdout:The following NEW packages will be installed: 2023-10-08T16:00:23.642 INFO:teuthology.orchestra.run.smithi133.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-08T16:00:23.642 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-08T16:00:23.642 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-08T16:00:23.642 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-08T16:00:23.643 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-08T16:00:23.643 INFO:teuthology.orchestra.run.smithi133.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-08T16:00:23.643 INFO:teuthology.orchestra.run.smithi133.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-08T16:00:23.643 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-08T16:00:23.643 INFO:teuthology.orchestra.run.smithi133.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-10-08T16:00:23.643 INFO:teuthology.orchestra.run.smithi133.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-08T16:00:23.644 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-10-08T16:00:23.644 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-10-08T16:00:23.644 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-10-08T16:00:23.644 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-08T16:00:23.644 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-08T16:00:23.645 INFO:teuthology.orchestra.run.smithi133.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-08T16:00:23.645 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-08T16:00:23.645 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-08T16:00:23.645 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-08T16:00:23.645 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-08T16:00:23.645 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-08T16:00:23.646 INFO:teuthology.orchestra.run.smithi133.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-08T16:00:23.646 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-08T16:00:23.646 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-08T16:00:23.646 INFO:teuthology.orchestra.run.smithi133.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-08T16:00:23.646 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages will be upgraded: 2023-10-08T16:00:23.647 INFO:teuthology.orchestra.run.smithi133.stdout: librados2 librbd1 2023-10-08T16:00:23.708 INFO:teuthology.orchestra.run.smithi133.stdout:2 upgraded, 114 newly installed, 0 to remove and 253 not upgraded. 2023-10-08T16:00:23.708 INFO:teuthology.orchestra.run.smithi133.stdout:Need to get 210 MB of archives. 2023-10-08T16:00:23.708 INFO:teuthology.orchestra.run.smithi133.stdout:After this operation, 981 MB of additional disk space will be used. 2023-10-08T16:00:23.708 INFO:teuthology.orchestra.run.smithi133.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-08T16:00:23.711 INFO:teuthology.orchestra.run.smithi190.stdout:The following NEW packages will be installed: 2023-10-08T16:00:23.712 INFO:teuthology.orchestra.run.smithi190.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-08T16:00:23.712 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-08T16:00:23.712 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-08T16:00:23.712 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-08T16:00:23.713 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-08T16:00:23.713 INFO:teuthology.orchestra.run.smithi190.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-08T16:00:23.713 INFO:teuthology.orchestra.run.smithi190.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-08T16:00:23.713 INFO:teuthology.orchestra.run.smithi190.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-08T16:00:23.713 INFO:teuthology.orchestra.run.smithi190.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-10-08T16:00:23.714 INFO:teuthology.orchestra.run.smithi190.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-08T16:00:23.714 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-10-08T16:00:23.714 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-10-08T16:00:23.714 INFO:teuthology.orchestra.run.smithi190.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-10-08T16:00:23.714 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-08T16:00:23.714 INFO:teuthology.orchestra.run.smithi190.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-08T16:00:23.714 INFO:teuthology.orchestra.run.smithi190.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-08T16:00:23.714 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-08T16:00:23.714 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-08T16:00:23.714 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-08T16:00:23.714 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-08T16:00:23.714 INFO:teuthology.orchestra.run.smithi190.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-08T16:00:23.715 INFO:teuthology.orchestra.run.smithi190.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-08T16:00:23.715 INFO:teuthology.orchestra.run.smithi190.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-08T16:00:23.715 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-08T16:00:23.715 INFO:teuthology.orchestra.run.smithi190.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-08T16:00:23.715 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages will be upgraded: 2023-10-08T16:00:23.715 INFO:teuthology.orchestra.run.smithi190.stdout: librados2 librbd1 2023-10-08T16:00:23.727 INFO:teuthology.orchestra.run.smithi133.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-08T16:00:23.735 INFO:teuthology.orchestra.run.smithi133.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-08T16:00:23.762 INFO:teuthology.orchestra.run.smithi133.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-08T16:00:23.778 INFO:teuthology.orchestra.run.smithi190.stdout:2 upgraded, 114 newly installed, 0 to remove and 253 not upgraded. 2023-10-08T16:00:23.790 INFO:teuthology.orchestra.run.smithi190.stdout:Need to get 210 MB of archives. 2023-10-08T16:00:23.790 INFO:teuthology.orchestra.run.smithi190.stdout:After this operation, 981 MB of additional disk space will be used. 2023-10-08T16:00:23.790 INFO:teuthology.orchestra.run.smithi190.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-08T16:00:23.791 INFO:teuthology.orchestra.run.smithi133.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-08T16:00:23.792 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-08T16:00:23.797 INFO:teuthology.orchestra.run.smithi190.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-08T16:00:23.801 INFO:teuthology.orchestra.run.smithi133.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-08T16:00:23.804 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-08T16:00:23.804 INFO:teuthology.orchestra.run.smithi190.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-08T16:00:23.821 INFO:teuthology.orchestra.run.smithi133.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-08T16:00:23.823 INFO:teuthology.orchestra.run.smithi133.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-08T16:00:23.828 INFO:teuthology.orchestra.run.smithi133.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-08T16:00:23.830 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-08T16:00:23.855 INFO:teuthology.orchestra.run.smithi133.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-08T16:00:23.856 INFO:teuthology.orchestra.run.smithi133.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-08T16:00:23.858 INFO:teuthology.orchestra.run.smithi190.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-08T16:00:23.860 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-08T16:00:23.862 INFO:teuthology.orchestra.run.smithi133.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-08T16:00:23.864 INFO:teuthology.orchestra.run.smithi133.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-08T16:00:23.864 INFO:teuthology.orchestra.run.smithi133.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-08T16:00:23.866 INFO:teuthology.orchestra.run.smithi133.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-08T16:00:23.867 INFO:teuthology.orchestra.run.smithi133.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-08T16:00:23.867 INFO:teuthology.orchestra.run.smithi133.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-08T16:00:23.868 INFO:teuthology.orchestra.run.smithi133.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-08T16:00:23.870 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-08T16:00:23.872 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-08T16:00:23.877 INFO:teuthology.orchestra.run.smithi133.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-08T16:00:23.878 INFO:teuthology.orchestra.run.smithi133.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-08T16:00:23.889 INFO:teuthology.orchestra.run.smithi190.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-08T16:00:23.891 INFO:teuthology.orchestra.run.smithi190.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-08T16:00:23.894 INFO:teuthology.orchestra.run.smithi133.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-08T16:00:23.894 INFO:teuthology.orchestra.run.smithi133.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-08T16:00:23.895 INFO:teuthology.orchestra.run.smithi190.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-08T16:00:23.896 INFO:teuthology.orchestra.run.smithi133.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-08T16:00:23.896 INFO:teuthology.orchestra.run.smithi133.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-08T16:00:23.897 INFO:teuthology.orchestra.run.smithi133.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-08T16:00:23.898 INFO:teuthology.orchestra.run.smithi133.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-08T16:00:23.898 INFO:teuthology.orchestra.run.smithi133.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-08T16:00:23.900 INFO:teuthology.orchestra.run.smithi133.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-08T16:00:23.911 INFO:teuthology.orchestra.run.smithi133.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-08T16:00:23.911 INFO:teuthology.orchestra.run.smithi133.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-08T16:00:23.922 INFO:teuthology.orchestra.run.smithi190.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-08T16:00:23.924 INFO:teuthology.orchestra.run.smithi190.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-08T16:00:23.928 INFO:teuthology.orchestra.run.smithi133.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-08T16:00:23.928 INFO:teuthology.orchestra.run.smithi133.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-08T16:00:23.929 INFO:teuthology.orchestra.run.smithi133.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-08T16:00:23.930 INFO:teuthology.orchestra.run.smithi190.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-08T16:00:23.930 INFO:teuthology.orchestra.run.smithi133.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-08T16:00:23.931 INFO:teuthology.orchestra.run.smithi190.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-08T16:00:23.932 INFO:teuthology.orchestra.run.smithi133.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-08T16:00:23.932 INFO:teuthology.orchestra.run.smithi190.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-08T16:00:23.934 INFO:teuthology.orchestra.run.smithi190.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-08T16:00:23.934 INFO:teuthology.orchestra.run.smithi190.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-08T16:00:23.935 INFO:teuthology.orchestra.run.smithi190.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-08T16:00:23.935 INFO:teuthology.orchestra.run.smithi133.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-08T16:00:23.936 INFO:teuthology.orchestra.run.smithi190.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-08T16:00:23.937 INFO:teuthology.orchestra.run.smithi133.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-08T16:00:23.938 INFO:teuthology.orchestra.run.smithi133.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-08T16:00:23.944 INFO:teuthology.orchestra.run.smithi190.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-08T16:00:23.944 INFO:teuthology.orchestra.run.smithi190.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-08T16:00:23.945 INFO:teuthology.orchestra.run.smithi133.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-08T16:00:23.946 INFO:teuthology.orchestra.run.smithi133.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-08T16:00:23.961 INFO:teuthology.orchestra.run.smithi190.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-08T16:00:23.961 INFO:teuthology.orchestra.run.smithi190.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-08T16:00:23.962 INFO:teuthology.orchestra.run.smithi133.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-08T16:00:23.962 INFO:teuthology.orchestra.run.smithi133.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-08T16:00:23.962 INFO:teuthology.orchestra.run.smithi190.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-08T16:00:23.963 INFO:teuthology.orchestra.run.smithi133.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-08T16:00:23.963 INFO:teuthology.orchestra.run.smithi190.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-08T16:00:23.963 INFO:teuthology.orchestra.run.smithi190.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-08T16:00:23.965 INFO:teuthology.orchestra.run.smithi190.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-08T16:00:23.965 INFO:teuthology.orchestra.run.smithi190.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-08T16:00:23.967 INFO:teuthology.orchestra.run.smithi190.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-08T16:00:23.978 INFO:teuthology.orchestra.run.smithi190.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-08T16:00:23.978 INFO:teuthology.orchestra.run.smithi190.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-08T16:00:23.994 INFO:teuthology.orchestra.run.smithi190.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-08T16:00:23.995 INFO:teuthology.orchestra.run.smithi190.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-08T16:00:23.995 INFO:teuthology.orchestra.run.smithi190.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-08T16:00:23.996 INFO:teuthology.orchestra.run.smithi190.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-08T16:00:23.997 INFO:teuthology.orchestra.run.smithi190.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-08T16:00:24.001 INFO:teuthology.orchestra.run.smithi190.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-08T16:00:24.002 INFO:teuthology.orchestra.run.smithi190.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-08T16:00:24.002 INFO:teuthology.orchestra.run.smithi190.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-08T16:00:24.011 INFO:teuthology.orchestra.run.smithi190.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-08T16:00:24.012 INFO:teuthology.orchestra.run.smithi190.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-08T16:00:24.028 INFO:teuthology.orchestra.run.smithi190.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-08T16:00:24.028 INFO:teuthology.orchestra.run.smithi190.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-08T16:00:24.029 INFO:teuthology.orchestra.run.smithi190.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-08T16:00:24.047 INFO:teuthology.orchestra.run.smithi133.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-08T16:00:24.062 INFO:teuthology.orchestra.run.smithi133.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-08T16:00:24.109 INFO:teuthology.orchestra.run.smithi190.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-08T16:00:24.130 INFO:teuthology.orchestra.run.smithi133.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-08T16:00:24.149 INFO:teuthology.orchestra.run.smithi133.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1320-g08cac018-1focal [3,501 kB] 2023-10-08T16:00:24.149 INFO:teuthology.orchestra.run.smithi133.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-08T16:00:24.149 INFO:teuthology.orchestra.run.smithi133.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-08T16:00:24.150 INFO:teuthology.orchestra.run.smithi133.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-08T16:00:24.150 INFO:teuthology.orchestra.run.smithi133.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-08T16:00:24.150 INFO:teuthology.orchestra.run.smithi133.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-08T16:00:24.151 INFO:teuthology.orchestra.run.smithi133.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-08T16:00:24.151 INFO:teuthology.orchestra.run.smithi133.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-08T16:00:24.152 INFO:teuthology.orchestra.run.smithi133.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-08T16:00:24.152 INFO:teuthology.orchestra.run.smithi133.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-08T16:00:24.167 INFO:teuthology.orchestra.run.smithi133.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-08T16:00:24.170 INFO:teuthology.orchestra.run.smithi133.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-08T16:00:24.184 INFO:teuthology.orchestra.run.smithi133.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-08T16:00:24.186 INFO:teuthology.orchestra.run.smithi133.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-08T16:00:24.187 INFO:teuthology.orchestra.run.smithi133.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-08T16:00:24.190 INFO:teuthology.orchestra.run.smithi133.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-08T16:00:24.191 INFO:teuthology.orchestra.run.smithi190.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-08T16:00:24.192 INFO:teuthology.orchestra.run.smithi190.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-08T16:00:24.193 INFO:teuthology.orchestra.run.smithi133.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-08T16:00:24.194 INFO:teuthology.orchestra.run.smithi133.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-08T16:00:24.207 INFO:teuthology.orchestra.run.smithi190.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-08T16:00:24.207 INFO:teuthology.orchestra.run.smithi190.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-08T16:00:24.208 INFO:teuthology.orchestra.run.smithi190.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-08T16:00:24.208 INFO:teuthology.orchestra.run.smithi190.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-08T16:00:24.208 INFO:teuthology.orchestra.run.smithi190.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-08T16:00:24.209 INFO:teuthology.orchestra.run.smithi190.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-08T16:00:24.209 INFO:teuthology.orchestra.run.smithi190.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-08T16:00:24.210 INFO:teuthology.orchestra.run.smithi190.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-08T16:00:24.211 INFO:teuthology.orchestra.run.smithi133.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-08T16:00:24.214 INFO:teuthology.orchestra.run.smithi133.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-08T16:00:24.221 INFO:teuthology.orchestra.run.smithi190.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1320-g08cac018-1focal [3,501 kB] 2023-10-08T16:00:24.224 INFO:teuthology.orchestra.run.smithi190.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-08T16:00:24.228 INFO:teuthology.orchestra.run.smithi190.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-08T16:00:24.232 INFO:teuthology.orchestra.run.smithi190.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-08T16:00:24.233 INFO:teuthology.orchestra.run.smithi190.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-08T16:00:24.235 INFO:teuthology.orchestra.run.smithi190.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-08T16:00:24.236 INFO:teuthology.orchestra.run.smithi190.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-08T16:00:24.240 INFO:teuthology.orchestra.run.smithi190.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-08T16:00:24.242 INFO:teuthology.orchestra.run.smithi190.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-08T16:00:24.242 INFO:teuthology.orchestra.run.smithi190.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-08T16:00:24.250 INFO:teuthology.orchestra.run.smithi133.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-08T16:00:24.251 INFO:teuthology.orchestra.run.smithi133.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-08T16:00:24.251 INFO:teuthology.orchestra.run.smithi133.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-08T16:00:24.251 INFO:teuthology.orchestra.run.smithi133.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-08T16:00:24.252 INFO:teuthology.orchestra.run.smithi133.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-08T16:00:24.252 INFO:teuthology.orchestra.run.smithi133.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-08T16:00:24.257 INFO:teuthology.orchestra.run.smithi190.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-08T16:00:24.259 INFO:teuthology.orchestra.run.smithi190.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-08T16:00:24.264 INFO:teuthology.orchestra.run.smithi133.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-08T16:00:24.264 INFO:teuthology.orchestra.run.smithi133.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-08T16:00:24.264 INFO:teuthology.orchestra.run.smithi133.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-08T16:00:24.267 INFO:teuthology.orchestra.run.smithi133.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-08T16:00:24.285 INFO:teuthology.orchestra.run.smithi133.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-08T16:00:24.285 INFO:teuthology.orchestra.run.smithi133.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-08T16:00:24.286 INFO:teuthology.orchestra.run.smithi133.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-08T16:00:24.288 INFO:teuthology.orchestra.run.smithi133.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-08T16:00:24.289 INFO:teuthology.orchestra.run.smithi133.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-08T16:00:24.299 INFO:teuthology.orchestra.run.smithi190.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-08T16:00:24.300 INFO:teuthology.orchestra.run.smithi190.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-08T16:00:24.300 INFO:teuthology.orchestra.run.smithi190.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-08T16:00:24.300 INFO:teuthology.orchestra.run.smithi190.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-08T16:00:24.301 INFO:teuthology.orchestra.run.smithi190.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-08T16:00:24.302 INFO:teuthology.orchestra.run.smithi190.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-08T16:00:24.313 INFO:teuthology.orchestra.run.smithi190.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-08T16:00:24.313 INFO:teuthology.orchestra.run.smithi190.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-08T16:00:24.314 INFO:teuthology.orchestra.run.smithi190.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-08T16:00:24.316 INFO:teuthology.orchestra.run.smithi190.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-08T16:00:24.333 INFO:teuthology.orchestra.run.smithi190.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-08T16:00:24.334 INFO:teuthology.orchestra.run.smithi190.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-08T16:00:24.334 INFO:teuthology.orchestra.run.smithi190.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-08T16:00:24.337 INFO:teuthology.orchestra.run.smithi190.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-08T16:00:24.337 INFO:teuthology.orchestra.run.smithi190.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-08T16:00:24.748 INFO:teuthology.orchestra.run.smithi133.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1320-g08cac018-1focal [3,552 kB] 2023-10-08T16:00:24.962 INFO:teuthology.orchestra.run.smithi133.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1320-g08cac018-1focal [760 kB] 2023-10-08T16:00:24.987 INFO:teuthology.orchestra.run.smithi133.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1320-g08cac018-1focal [414 kB] 2023-10-08T16:00:24.993 INFO:teuthology.orchestra.run.smithi190.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1320-g08cac018-1focal [3,552 kB] 2023-10-08T16:00:25.032 INFO:teuthology.orchestra.run.smithi133.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1320-g08cac018-1focal [22.6 kB] 2023-10-08T16:00:25.032 INFO:teuthology.orchestra.run.smithi133.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1320-g08cac018-1focal [200 kB] 2023-10-08T16:00:25.039 INFO:teuthology.orchestra.run.smithi133.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1320-g08cac018-1focal [47.2 kB] 2023-10-08T16:00:25.041 INFO:teuthology.orchestra.run.smithi133.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1320-g08cac018-1focal [386 kB] 2023-10-08T16:00:25.054 INFO:teuthology.orchestra.run.smithi133.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1320-g08cac018-1focal [5,568 kB] 2023-10-08T16:00:25.370 INFO:teuthology.orchestra.run.smithi133.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1320-g08cac018-1focal [116 kB] 2023-10-08T16:00:25.373 INFO:teuthology.orchestra.run.smithi133.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1320-g08cac018-1focal [479 kB] 2023-10-08T16:00:25.386 INFO:teuthology.orchestra.run.smithi190.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1320-g08cac018-1focal [760 kB] 2023-10-08T16:00:25.425 INFO:teuthology.orchestra.run.smithi133.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1320-g08cac018-1focal [27.8 MB] 2023-10-08T16:00:25.473 INFO:teuthology.orchestra.run.smithi190.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1320-g08cac018-1focal [414 kB] 2023-10-08T16:00:25.487 INFO:teuthology.orchestra.run.smithi190.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1320-g08cac018-1focal [22.6 kB] 2023-10-08T16:00:25.487 INFO:teuthology.orchestra.run.smithi190.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1320-g08cac018-1focal [200 kB] 2023-10-08T16:00:25.559 INFO:teuthology.orchestra.run.smithi190.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1320-g08cac018-1focal [47.2 kB] 2023-10-08T16:00:25.561 INFO:teuthology.orchestra.run.smithi190.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1320-g08cac018-1focal [386 kB] 2023-10-08T16:00:25.574 INFO:teuthology.orchestra.run.smithi190.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1320-g08cac018-1focal [5,568 kB] 2023-10-08T16:00:26.263 INFO:teuthology.orchestra.run.smithi190.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1320-g08cac018-1focal [116 kB] 2023-10-08T16:00:26.359 INFO:teuthology.orchestra.run.smithi190.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1320-g08cac018-1focal [479 kB] 2023-10-08T16:00:26.433 INFO:teuthology.orchestra.run.smithi190.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1320-g08cac018-1focal [27.8 MB] 2023-10-08T16:00:27.497 INFO:teuthology.orchestra.run.smithi133.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1320-g08cac018-1focal [6,450 kB] 2023-10-08T16:00:27.969 INFO:teuthology.orchestra.run.smithi133.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1320-g08cac018-1focal [221 kB] 2023-10-08T16:00:27.999 INFO:teuthology.orchestra.run.smithi133.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1320-g08cac018-1focal [152 kB] 2023-10-08T16:00:28.002 INFO:teuthology.orchestra.run.smithi133.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1320-g08cac018-1focal [1,590 kB] 2023-10-08T16:00:28.137 INFO:teuthology.orchestra.run.smithi133.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1320-g08cac018-1focal [7,846 kB] 2023-10-08T16:00:28.779 INFO:teuthology.orchestra.run.smithi133.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1320-g08cac018-1focal [28.7 MB] 2023-10-08T16:00:30.832 INFO:teuthology.orchestra.run.smithi190.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1320-g08cac018-1focal [6,450 kB] 2023-10-08T16:00:31.235 INFO:teuthology.orchestra.run.smithi133.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1320-g08cac018-1focal [3,920 B] 2023-10-08T16:00:31.285 INFO:teuthology.orchestra.run.smithi133.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1320-g08cac018-1focal [869 kB] 2023-10-08T16:00:31.300 INFO:teuthology.orchestra.run.smithi133.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1320-g08cac018-1focal [2,408 kB] 2023-10-08T16:00:31.429 INFO:teuthology.orchestra.run.smithi133.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1320-g08cac018-1focal [79.1 kB] 2023-10-08T16:00:31.459 INFO:teuthology.orchestra.run.smithi133.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1320-g08cac018-1focal [117 kB] 2023-10-08T16:00:31.463 INFO:teuthology.orchestra.run.smithi133.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1320-g08cac018-1focal [1,760 kB] 2023-10-08T16:00:31.600 INFO:teuthology.orchestra.run.smithi133.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1320-g08cac018-1focal [7,875 kB] 2023-10-08T16:00:31.772 INFO:teuthology.orchestra.run.smithi190.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1320-g08cac018-1focal [221 kB] 2023-10-08T16:00:31.926 INFO:teuthology.orchestra.run.smithi190.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1320-g08cac018-1focal [152 kB] 2023-10-08T16:00:31.926 INFO:teuthology.orchestra.run.smithi190.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1320-g08cac018-1focal [1,590 kB] 2023-10-08T16:00:32.103 INFO:teuthology.orchestra.run.smithi190.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1320-g08cac018-1focal [7,846 kB] 2023-10-08T16:00:32.257 INFO:teuthology.orchestra.run.smithi133.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1320-g08cac018-1focal [4,040 B] 2023-10-08T16:00:32.257 INFO:teuthology.orchestra.run.smithi133.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1320-g08cac018-1focal [56.3 MB] 2023-10-08T16:00:33.560 INFO:teuthology.orchestra.run.smithi190.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1320-g08cac018-1focal [28.7 MB] 2023-10-08T16:00:41.911 INFO:teuthology.orchestra.run.smithi133.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1320-g08cac018-1focal [229 kB] 2023-10-08T16:00:41.915 INFO:teuthology.orchestra.run.smithi133.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-1320-g08cac018-1focal [240 kB] 2023-10-08T16:00:41.920 INFO:teuthology.orchestra.run.smithi133.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-1320-g08cac018-1focal [22.0 kB] 2023-10-08T16:00:41.979 INFO:teuthology.orchestra.run.smithi133.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-1320-g08cac018-1focal [13.1 kB] 2023-10-08T16:00:41.979 INFO:teuthology.orchestra.run.smithi133.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1320-g08cac018-1focal [21.9 kB] 2023-10-08T16:00:41.980 INFO:teuthology.orchestra.run.smithi133.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1320-g08cac018-1focal [17.0 MB] 2023-10-08T16:00:42.547 INFO:teuthology.orchestra.run.smithi190.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1320-g08cac018-1focal [3,920 B] 2023-10-08T16:00:42.548 INFO:teuthology.orchestra.run.smithi190.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1320-g08cac018-1focal [869 kB] 2023-10-08T16:00:42.728 INFO:teuthology.orchestra.run.smithi190.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1320-g08cac018-1focal [2,408 kB] 2023-10-08T16:00:43.494 INFO:teuthology.orchestra.run.smithi190.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1320-g08cac018-1focal [79.1 kB] 2023-10-08T16:00:43.542 INFO:teuthology.orchestra.run.smithi190.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1320-g08cac018-1focal [117 kB] 2023-10-08T16:00:43.547 INFO:teuthology.orchestra.run.smithi190.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1320-g08cac018-1focal [1,760 kB] 2023-10-08T16:00:44.136 INFO:teuthology.orchestra.run.smithi190.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1320-g08cac018-1focal [7,875 kB] 2023-10-08T16:00:45.276 INFO:teuthology.orchestra.run.smithi133.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1320-g08cac018-1focal [79.6 kB] 2023-10-08T16:00:45.897 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 210 MB in 22s (9,701 kB/s) 2023-10-08T16:00:46.019 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-08T16:00:46.078 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141736 files and directories currently installed.) 2023-10-08T16:00:46.082 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-08T16:00:46.116 INFO:teuthology.orchestra.run.smithi190.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1320-g08cac018-1focal [4,040 B] 2023-10-08T16:00:46.116 INFO:teuthology.orchestra.run.smithi190.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1320-g08cac018-1focal [56.3 MB] 2023-10-08T16:00:46.142 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-08T16:00:46.428 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-08T16:00:46.444 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-08T16:00:46.486 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-08T16:00:46.814 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cmd2. 2023-10-08T16:00:47.282 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-08T16:00:47.282 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-08T16:00:47.282 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-08T16:00:47.283 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-08T16:00:47.325 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-08T16:00:47.648 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../004-librbd1_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:00:47.763 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librbd1 (17.2.6-1320-g08cac018-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-08T16:00:48.475 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../005-librados2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:00:48.583 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librados2 (17.2.6-1320-g08cac018-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-08T16:00:49.279 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libcephfs2. 2023-10-08T16:00:49.298 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:00:49.337 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libcephfs2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:00:49.707 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rados. 2023-10-08T16:00:49.723 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../007-python3-rados_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:00:49.765 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rados (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:00:50.159 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-08T16:00:50.175 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:00:50.217 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-ceph-argparse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:00:50.446 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cephfs. 2023-10-08T16:00:50.463 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:00:50.505 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cephfs (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:00:50.858 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-08T16:00:50.875 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:00:50.916 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:00:51.263 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-prettytable. 2023-10-08T16:00:51.279 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-10-08T16:00:51.307 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-08T16:00:51.585 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rbd. 2023-10-08T16:00:51.601 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:00:51.644 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rbd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:00:52.013 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-08T16:00:52.031 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-08T16:00:52.063 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-08T16:00:52.417 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-08T16:00:52.480 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-08T16:00:52.480 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-08T16:00:52.666 INFO:teuthology.orchestra.run.smithi190.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1320-g08cac018-1focal [229 kB] 2023-10-08T16:00:52.670 INFO:teuthology.orchestra.run.smithi190.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-1320-g08cac018-1focal [240 kB] 2023-10-08T16:00:52.675 INFO:teuthology.orchestra.run.smithi190.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-1320-g08cac018-1focal [22.0 kB] 2023-10-08T16:00:52.676 INFO:teuthology.orchestra.run.smithi190.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-1320-g08cac018-1focal [13.1 kB] 2023-10-08T16:00:52.676 INFO:teuthology.orchestra.run.smithi190.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1320-g08cac018-1focal [21.9 kB] 2023-10-08T16:00:52.677 INFO:teuthology.orchestra.run.smithi190.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1320-g08cac018-1focal [17.0 MB] 2023-10-08T16:00:52.836 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-08T16:00:52.852 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-08T16:00:52.894 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-08T16:00:53.264 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-08T16:00:53.282 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-08T16:00:53.322 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-08T16:00:53.618 INFO:teuthology.orchestra.run.smithi190.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1320-g08cac018-1focal [79.6 kB] 2023-10-08T16:00:53.633 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-08T16:00:53.653 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-08T16:00:53.734 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-08T16:00:54.221 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-08T16:00:54.239 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T16:00:54.253 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 210 MB in 30s (7,019 kB/s) 2023-10-08T16:00:54.289 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T16:00:54.400 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-08T16:00:54.457 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141736 files and directories currently installed.) 2023-10-08T16:00:54.461 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-08T16:00:54.498 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-08T16:00:54.757 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-08T16:00:54.775 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T16:00:54.807 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T16:00:54.834 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-08T16:00:54.850 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-08T16:00:54.892 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-08T16:00:55.195 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cmd2. 2023-10-08T16:00:55.214 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-08T16:00:55.253 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-08T16:00:55.539 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-08T16:00:55.556 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-08T16:00:55.631 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-08T16:00:55.835 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-08T16:00:55.852 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T16:00:55.885 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T16:00:56.280 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-08T16:00:56.296 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-08T16:00:56.338 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-08T16:00:56.680 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../004-librbd1_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:00:56.716 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librgw2. 2023-10-08T16:00:56.732 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../022-librgw2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:00:56.774 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librgw2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:00:56.802 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librbd1 (17.2.6-1320-g08cac018-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-08T16:00:57.438 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../005-librados2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:00:57.549 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librados2 (17.2.6-1320-g08cac018-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-08T16:00:57.560 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rgw. 2023-10-08T16:00:57.576 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:00:57.618 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:00:57.980 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liboath0. 2023-10-08T16:00:57.996 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-08T16:00:58.039 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-08T16:00:58.176 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libcephfs2. 2023-10-08T16:00:58.192 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:00:58.226 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libcephfs2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:00:58.358 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libradosstriper1. 2023-10-08T16:00:58.375 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:00:58.416 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libradosstriper1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:00:58.578 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rados. 2023-10-08T16:00:58.596 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../007-python3-rados_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:00:58.637 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rados (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:00:58.836 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-common. 2023-10-08T16:00:58.855 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../026-ceph-common_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:00:58.886 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:00:58.989 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-08T16:00:59.005 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:00:59.065 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-ceph-argparse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:00:59.313 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cephfs. 2023-10-08T16:00:59.329 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:00:59.372 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cephfs (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:00:59.679 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-08T16:00:59.696 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:00:59.737 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:00.054 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-prettytable. 2023-10-08T16:01:00.067 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-10-08T16:01:00.096 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-08T16:01:00.340 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rbd. 2023-10-08T16:01:00.355 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:00.398 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rbd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:00.776 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-08T16:01:00.793 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-08T16:01:00.834 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-08T16:01:01.146 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-08T16:01:01.163 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-08T16:01:01.215 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-08T16:01:01.540 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-08T16:01:01.557 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-08T16:01:01.598 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-08T16:01:01.608 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-base. 2023-10-08T16:01:01.624 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../027-ceph-base_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:01.677 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-base (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:02.001 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-08T16:01:02.020 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-08T16:01:02.060 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-08T16:01:02.388 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-08T16:01:02.405 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-08T16:01:02.446 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-08T16:01:02.654 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cryptography. 2023-10-08T16:01:02.674 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-08T16:01:02.729 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-08T16:01:02.916 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-08T16:01:02.933 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T16:01:02.985 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T16:01:03.041 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-openssl. 2023-10-08T16:01:03.059 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-08T16:01:03.090 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-08T16:01:03.385 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-08T16:01:03.401 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:01:03.444 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:03.511 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-08T16:01:03.526 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T16:01:03.569 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T16:01:03.815 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-08T16:01:03.831 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-08T16:01:03.873 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-08T16:01:03.897 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-08T16:01:03.916 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T16:01:03.955 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T16:01:04.209 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-08T16:01:04.227 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-08T16:01:04.267 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-08T16:01:04.341 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-08T16:01:04.357 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-08T16:01:04.399 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-08T16:01:04.638 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-natsort. 2023-10-08T16:01:04.655 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-10-08T16:01:04.696 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-08T16:01:04.736 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librgw2. 2023-10-08T16:01:04.755 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../022-librgw2_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:04.794 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librgw2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:05.024 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jwt. 2023-10-08T16:01:05.042 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-08T16:01:05.082 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-08T16:01:05.419 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-logutils. 2023-10-08T16:01:05.435 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-10-08T16:01:05.477 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-08T16:01:05.680 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rgw. 2023-10-08T16:01:05.699 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:05.738 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:05.755 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-08T16:01:05.772 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-08T16:01:05.804 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-08T16:01:06.083 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liboath0. 2023-10-08T16:01:06.101 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-08T16:01:06.116 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-mako. 2023-10-08T16:01:06.132 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-08T16:01:06.141 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-08T16:01:06.174 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-08T16:01:06.494 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libradosstriper1. 2023-10-08T16:01:06.502 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-08T16:01:06.514 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:06.522 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-08T16:01:06.544 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libradosstriper1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:06.562 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-08T16:01:06.897 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-08T16:01:06.913 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-08T16:01:06.955 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-08T16:01:07.023 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-common. 2023-10-08T16:01:07.040 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../026-ceph-common_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:07.080 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:07.249 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-webob. 2023-10-08T16:01:07.265 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-08T16:01:07.299 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-08T16:01:07.602 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-08T16:01:07.619 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-08T16:01:07.668 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-08T16:01:07.980 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-bs4. 2023-10-08T16:01:07.996 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-10-08T16:01:08.038 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-08T16:01:08.399 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-waitress. 2023-10-08T16:01:08.418 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-08T16:01:08.460 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-08T16:01:08.810 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-tempita. 2023-10-08T16:01:08.827 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-10-08T16:01:08.868 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-08T16:01:09.188 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-paste. 2023-10-08T16:01:09.204 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-08T16:01:09.246 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-08T16:01:09.592 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-08T16:01:09.608 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-08T16:01:09.649 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-08T16:01:09.728 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-base. 2023-10-08T16:01:09.745 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../027-ceph-base_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:09.796 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-base (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:09.977 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-08T16:01:09.997 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-08T16:01:10.035 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-08T16:01:10.355 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-webtest. 2023-10-08T16:01:10.373 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-10-08T16:01:10.413 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-08T16:01:10.724 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pecan. 2023-10-08T16:01:10.741 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-08T16:01:10.757 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cryptography. 2023-10-08T16:01:10.773 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-08T16:01:10.799 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-08T16:01:10.806 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-08T16:01:11.163 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-08T16:01:11.177 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-openssl. 2023-10-08T16:01:11.182 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-08T16:01:11.193 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-08T16:01:11.227 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-08T16:01:11.480 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-08T16:01:11.497 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:01:11.521 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-08T16:01:11.538 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:11.908 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-08T16:01:11.924 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:11.951 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-08T16:01:11.965 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:11.969 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-08T16:01:12.036 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-08T16:01:12.327 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr. 2023-10-08T16:01:12.346 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-08T16:01:12.346 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:12.362 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-08T16:01:12.385 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:12.404 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-08T16:01:12.782 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-natsort. 2023-10-08T16:01:12.800 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-10-08T16:01:12.840 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-08T16:01:12.855 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mon. 2023-10-08T16:01:12.872 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:12.905 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mon (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:13.152 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jwt. 2023-10-08T16:01:13.169 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-08T16:01:13.210 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-08T16:01:13.546 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-logutils. 2023-10-08T16:01:13.562 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-10-08T16:01:13.604 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-08T16:01:13.866 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-08T16:01:13.883 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-08T16:01:13.915 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-08T16:01:14.092 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-osd. 2023-10-08T16:01:14.108 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:14.150 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-osd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:14.220 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-mako. 2023-10-08T16:01:14.240 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-08T16:01:14.278 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-08T16:01:14.590 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-08T16:01:14.608 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-08T16:01:14.648 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-08T16:01:14.918 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-08T16:01:14.935 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-08T16:01:14.984 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-08T16:01:15.271 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-webob. 2023-10-08T16:01:15.291 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-08T16:01:15.329 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-08T16:01:15.648 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-08T16:01:15.665 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-08T16:01:15.723 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-08T16:01:16.026 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-bs4. 2023-10-08T16:01:16.042 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-10-08T16:01:16.084 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-08T16:01:16.454 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-waitress. 2023-10-08T16:01:16.472 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-08T16:01:16.516 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-08T16:01:16.857 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-tempita. 2023-10-08T16:01:16.874 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-10-08T16:01:16.915 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-08T16:01:16.919 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph. 2023-10-08T16:01:16.936 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../055-ceph_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:16.977 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:17.243 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-paste. 2023-10-08T16:01:17.255 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-fuse. 2023-10-08T16:01:17.259 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-08T16:01:17.272 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:17.301 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-08T16:01:17.305 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:17.613 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-08T16:01:17.629 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-08T16:01:17.671 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-08T16:01:17.750 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mds. 2023-10-08T16:01:17.767 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:17.808 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mds (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:18.008 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-08T16:01:18.023 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-08T16:01:18.066 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-08T16:01:18.344 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package cephadm. 2023-10-08T16:01:18.352 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-webtest. 2023-10-08T16:01:18.360 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../058-cephadm_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:18.372 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-10-08T16:01:18.402 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:18.410 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-08T16:01:18.697 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jinja2. 2023-10-08T16:01:18.706 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pecan. 2023-10-08T16:01:18.713 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-10-08T16:01:18.724 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-08T16:01:18.747 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-08T16:01:18.755 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-08T16:01:19.025 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-08T16:01:19.043 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-08T16:01:19.043 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:01:19.062 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-08T16:01:19.074 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:19.092 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-08T16:01:19.411 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-08T16:01:19.430 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-10-08T16:01:19.461 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-08T16:01:19.471 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-08T16:01:19.487 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:19.529 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:19.714 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libjs-underscore. 2023-10-08T16:01:19.729 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-08T16:01:19.772 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-08T16:01:19.883 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr. 2023-10-08T16:01:19.898 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:19.940 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:20.074 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-08T16:01:20.091 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-08T16:01:20.132 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-08T16:01:20.460 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-routes. 2023-10-08T16:01:20.476 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-10-08T16:01:20.485 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mon. 2023-10-08T16:01:20.501 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:20.518 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-08T16:01:20.543 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mon (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:20.821 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-08T16:01:20.837 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:01:20.879 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:21.366 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-decorator. 2023-10-08T16:01:21.386 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-08T16:01:21.424 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-08T16:01:21.673 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-osd. 2023-10-08T16:01:21.689 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:21.730 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-osd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:21.743 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-08T16:01:21.760 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-08T16:01:21.802 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-08T16:01:22.155 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-scipy. 2023-10-08T16:01:22.171 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-08T16:01:22.213 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-08T16:01:23.563 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-08T16:01:23.580 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-08T16:01:23.621 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-08T16:01:24.150 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-joblib. 2023-10-08T16:01:24.170 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-10-08T16:01:24.208 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-08T16:01:24.628 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-sklearn. 2023-10-08T16:01:24.641 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph. 2023-10-08T16:01:24.644 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-08T16:01:24.658 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../055-ceph_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:24.686 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-08T16:01:24.700 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:25.019 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-fuse. 2023-10-08T16:01:25.037 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:25.077 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:25.461 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-08T16:01:25.477 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:01:25.497 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mds. 2023-10-08T16:01:25.516 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:25.518 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:25.555 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mds (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:26.108 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package cephadm. 2023-10-08T16:01:26.125 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../058-cephadm_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:26.166 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:26.486 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jinja2. 2023-10-08T16:01:26.502 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-10-08T16:01:26.544 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-08T16:01:26.657 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cachetools. 2023-10-08T16:01:26.678 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-10-08T16:01:26.715 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-08T16:01:26.872 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-08T16:01:26.889 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:01:26.930 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:27.051 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-08T16:01:27.068 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-08T16:01:27.109 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-08T16:01:27.295 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-08T16:01:27.312 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-10-08T16:01:27.417 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-08T16:01:27.462 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-08T16:01:27.479 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-08T16:01:27.520 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-08T16:01:27.669 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libjs-underscore. 2023-10-08T16:01:27.685 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-08T16:01:27.728 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-08T16:01:27.864 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rsa. 2023-10-08T16:01:27.883 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-10-08T16:01:27.931 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-08T16:01:28.005 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-08T16:01:28.022 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-08T16:01:28.080 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-08T16:01:28.226 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-google-auth. 2023-10-08T16:01:28.246 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-10-08T16:01:28.284 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-08T16:01:28.399 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-routes. 2023-10-08T16:01:28.415 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-10-08T16:01:28.457 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-08T16:01:28.637 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-blinker. 2023-10-08T16:01:28.658 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-08T16:01:28.695 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-08T16:01:28.819 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-08T16:01:28.835 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:01:28.877 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:29.032 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-08T16:01:29.048 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-08T16:01:29.090 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-08T16:01:29.356 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-decorator. 2023-10-08T16:01:29.375 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-08T16:01:29.414 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-08T16:01:29.426 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-08T16:01:29.446 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-08T16:01:29.484 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-08T16:01:29.716 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-08T16:01:29.736 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-08T16:01:29.774 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-08T16:01:29.906 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-websocket. 2023-10-08T16:01:29.924 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-08T16:01:29.964 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-08T16:01:30.086 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-scipy. 2023-10-08T16:01:30.104 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-08T16:01:30.144 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-08T16:01:30.309 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-08T16:01:30.326 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-08T16:01:30.367 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-08T16:01:30.956 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-08T16:01:30.974 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:01:31.048 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:31.359 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-08T16:01:31.376 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-10-08T16:01:31.417 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-08T16:01:31.453 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-08T16:01:31.469 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-08T16:01:31.510 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-08T16:01:31.770 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-08T16:01:31.786 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T16:01:31.828 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-08T16:01:32.065 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-joblib. 2023-10-08T16:01:32.081 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-10-08T16:01:32.114 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-08T16:01:32.131 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package jq. 2023-10-08T16:01:32.148 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T16:01:32.189 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-08T16:01:32.480 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package socat. 2023-10-08T16:01:32.498 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-10-08T16:01:32.526 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-sklearn. 2023-10-08T16:01:32.538 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-08T16:01:32.542 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-08T16:01:32.584 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-08T16:01:32.883 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package xmlstarlet. 2023-10-08T16:01:32.903 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-08T16:01:32.941 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-08T16:01:33.268 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-08T16:01:33.284 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:01:33.304 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-test. 2023-10-08T16:01:33.317 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:33.323 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../089-ceph-test_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:33.362 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-test (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:34.429 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cachetools. 2023-10-08T16:01:34.446 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-10-08T16:01:34.504 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-08T16:01:34.815 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-08T16:01:34.831 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-08T16:01:34.873 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-08T16:01:35.226 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-08T16:01:35.242 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-08T16:01:35.284 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-08T16:01:35.596 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rsa. 2023-10-08T16:01:35.613 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-10-08T16:01:35.654 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-08T16:01:35.949 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-google-auth. 2023-10-08T16:01:35.968 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-10-08T16:01:35.999 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-08T16:01:36.285 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-blinker. 2023-10-08T16:01:36.304 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-08T16:01:36.343 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-08T16:01:36.680 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-08T16:01:36.696 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-08T16:01:36.738 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-08T16:01:37.075 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-08T16:01:37.093 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-08T16:01:37.133 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-08T16:01:37.513 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-websocket. 2023-10-08T16:01:37.530 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-08T16:01:37.563 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-08T16:01:37.875 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-08T16:01:37.891 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-08T16:01:37.933 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-08T16:01:38.424 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-volume. 2023-10-08T16:01:38.440 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:01:38.481 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-08T16:01:38.482 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-volume (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:38.497 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:01:38.539 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:38.867 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-08T16:01:38.885 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-10-08T16:01:38.912 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-08T16:01:38.925 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-08T16:01:38.929 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:38.970 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking cephfs-mirror (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:39.219 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-08T16:01:39.236 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T16:01:39.269 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-08T16:01:39.340 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-colorama. 2023-10-08T16:01:39.357 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-08T16:01:39.398 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-08T16:01:39.564 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package jq. 2023-10-08T16:01:39.581 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T16:01:39.622 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-08T16:01:39.663 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package cephfs-shell. 2023-10-08T16:01:39.680 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:01:39.721 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking cephfs-shell (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:39.890 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package socat. 2023-10-08T16:01:39.906 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-10-08T16:01:39.948 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-08T16:01:39.982 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package cephfs-top. 2023-10-08T16:01:40.002 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:01:40.065 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking cephfs-top (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:40.285 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package xmlstarlet. 2023-10-08T16:01:40.301 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-08T16:01:40.309 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-08T16:01:40.325 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-08T16:01:40.343 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-08T16:01:40.367 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-08T16:01:40.689 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-test. 2023-10-08T16:01:40.706 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../089-ceph-test_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:40.747 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-test (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:40.870 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-08T16:01:40.890 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:40.952 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libcephfs-dev (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:41.373 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package nvme-cli. 2023-10-08T16:01:41.389 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-08T16:01:41.457 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-08T16:01:41.769 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-08T16:01:41.787 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-08T16:01:41.849 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-08T16:01:43.871 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-08T16:01:43.892 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-08T16:01:43.937 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-08T16:01:44.298 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-08T16:01:44.315 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-08T16:01:44.348 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-08T16:01:44.676 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-attr. 2023-10-08T16:01:44.693 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-10-08T16:01:44.734 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-08T16:01:45.078 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-webencodings. 2023-10-08T16:01:45.095 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-08T16:01:45.137 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-08T16:01:45.465 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-html5lib. 2023-10-08T16:01:45.486 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-10-08T16:01:45.531 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-08T16:01:45.760 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-volume. 2023-10-08T16:01:45.776 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:01:45.817 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-volume (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:45.918 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-08T16:01:45.939 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-08T16:01:45.984 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-08T16:01:46.207 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-08T16:01:46.223 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:46.265 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking cephfs-mirror (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:46.479 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-packaging. 2023-10-08T16:01:46.497 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-10-08T16:01:46.537 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-08T16:01:46.585 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-colorama. 2023-10-08T16:01:46.601 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-08T16:01:46.667 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-08T16:01:46.865 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pastescript. 2023-10-08T16:01:46.884 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-10-08T16:01:46.923 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-08T16:01:46.924 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package cephfs-shell. 2023-10-08T16:01:46.944 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:01:46.982 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking cephfs-shell (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:47.235 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package cephfs-top. 2023-10-08T16:01:47.254 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-1320-g08cac018-1focal_all.deb ... 2023-10-08T16:01:47.269 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pluggy. 2023-10-08T16:01:47.288 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-10-08T16:01:47.293 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking cephfs-top (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:47.327 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-08T16:01:47.554 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-08T16:01:47.571 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-08T16:01:47.612 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-08T16:01:47.655 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-psutil. 2023-10-08T16:01:47.673 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-08T16:01:47.738 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-08T16:01:48.069 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-py. 2023-10-08T16:01:48.086 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-08T16:01:48.132 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-08T16:01:48.147 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-08T16:01:48.152 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:48.190 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libcephfs-dev (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:48.472 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-08T16:01:48.489 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-08T16:01:48.530 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-08T16:01:48.543 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package nvme-cli. 2023-10-08T16:01:48.561 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-08T16:01:48.619 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-08T16:01:48.866 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pytest. 2023-10-08T16:01:48.884 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-10-08T16:01:48.924 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-08T16:01:48.981 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-08T16:01:48.998 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-08T16:01:49.039 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-08T16:01:49.286 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-simplejson. 2023-10-08T16:01:49.303 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-08T16:01:49.344 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-08T16:01:49.647 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-08T16:01:49.667 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-08T16:01:49.705 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-08T16:01:50.485 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package radosgw. 2023-10-08T16:01:50.504 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../114-radosgw_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:50.534 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking radosgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:50.705 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-08T16:01:50.724 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-08T16:01:50.763 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-08T16:01:51.125 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-08T16:01:51.142 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-08T16:01:51.182 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-08T16:01:51.486 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-attr. 2023-10-08T16:01:51.502 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-10-08T16:01:51.544 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-08T16:01:51.880 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-webencodings. 2023-10-08T16:01:51.901 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-08T16:01:51.938 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-08T16:01:52.196 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package rbd-fuse. 2023-10-08T16:01:52.213 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:52.241 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-html5lib. 2023-10-08T16:01:52.259 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-10-08T16:01:52.265 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking rbd-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:52.300 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-08T16:01:52.569 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-08T16:01:52.670 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-08T16:01:52.687 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-08T16:01:52.719 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-08T16:01:52.873 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-08T16:01:52.999 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-08T16:01:53.144 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-08T16:01:53.240 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-packaging. 2023-10-08T16:01:53.260 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-10-08T16:01:53.297 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-08T16:01:53.351 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:53.601 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pastescript. 2023-10-08T16:01:53.618 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-10-08T16:01:53.659 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-08T16:01:53.981 INFO:teuthology.orchestra.run.smithi133.stdout:Adding system user cephadm....done 2023-10-08T16:01:54.004 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pluggy. 2023-10-08T16:01:54.022 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-10-08T16:01:54.062 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-08T16:01:54.167 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-08T16:01:54.293 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-08T16:01:54.341 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-psutil. 2023-10-08T16:01:54.361 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-08T16:01:54.398 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-08T16:01:54.636 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-08T16:01:54.771 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-py. 2023-10-08T16:01:54.790 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-08T16:01:54.830 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-08T16:01:54.936 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-08T16:01:55.063 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-08T16:01:55.158 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-08T16:01:55.178 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-08T16:01:55.189 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-08T16:01:55.217 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-08T16:01:55.516 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-08T16:01:55.536 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pytest. 2023-10-08T16:01:55.557 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-10-08T16:01:55.594 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-08T16:01:55.931 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-simplejson. 2023-10-08T16:01:55.943 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-08T16:01:55.949 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-08T16:01:55.989 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-08T16:01:56.236 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-08T16:01:56.292 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-08T16:01:56.308 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-08T16:01:56.350 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-08T16:01:56.570 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-08T16:01:56.855 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-08T16:01:57.122 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package radosgw. 2023-10-08T16:01:57.139 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../114-radosgw_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:57.139 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-08T16:01:57.180 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking radosgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:57.482 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-ceph-argparse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:57.791 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-08T16:01:57.917 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-08T16:01:58.201 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-08T16:01:58.487 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-08T16:01:58.805 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-08T16:01:58.930 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-08T16:01:59.033 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package rbd-fuse. 2023-10-08T16:01:59.051 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-1320-g08cac018-1focal_amd64.deb ... 2023-10-08T16:01:59.091 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking rbd-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:01:59.341 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-08T16:01:59.395 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-08T16:01:59.660 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-08T16:01:59.710 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-08T16:01:59.836 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-08T16:01:59.953 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-08T16:01:59.963 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-08T16:02:00.147 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:00.279 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-08T16:02:00.588 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-08T16:02:00.777 INFO:teuthology.orchestra.run.smithi190.stdout:Adding system user cephadm....done 2023-10-08T16:02:00.913 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-08T16:02:00.939 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-08T16:02:01.023 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-08T16:02:01.240 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-08T16:02:01.366 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-08T16:02:01.544 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-08T16:02:01.650 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-08T16:02:01.695 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-08T16:02:01.777 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-08T16:02:01.821 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-08T16:02:01.928 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-08T16:02:02.139 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-08T16:02:02.274 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-08T16:02:02.515 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-08T16:02:02.690 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-08T16:02:02.858 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-08T16:02:02.983 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-08T16:02:03.209 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-08T16:02:03.267 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-08T16:02:03.577 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-08T16:02:03.580 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-08T16:02:03.706 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:03.861 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-08T16:02:04.040 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T16:02:04.171 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-ceph-argparse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:04.175 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-08T16:02:04.463 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-08T16:02:04.534 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-08T16:02:04.581 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-08T16:02:04.644 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-08T16:02:04.790 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-08T16:02:04.857 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-08T16:02:05.087 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-08T16:02:05.150 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-08T16:02:05.405 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T16:02:05.435 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-08T16:02:05.531 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-08T16:02:05.586 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-08T16:02:05.657 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-08T16:02:05.954 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-08T16:02:06.017 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-08T16:02:06.249 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-08T16:02:06.318 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-08T16:02:06.525 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-08T16:02:06.627 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-08T16:02:06.737 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-08T16:02:06.868 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-08T16:02:07.063 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-08T16:02:07.169 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-08T16:02:07.347 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-08T16:02:07.504 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-08T16:02:07.657 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-08T16:02:07.797 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-08T16:02:08.042 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-08T16:02:08.098 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-08T16:02:08.219 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-08T16:02:08.309 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-08T16:02:08.369 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-08T16:02:08.460 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-08T16:02:08.662 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-08T16:02:08.786 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-08T16:02:09.072 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-08T16:02:09.162 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-08T16:02:09.313 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-08T16:02:09.373 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-08T16:02:09.439 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-08T16:02:09.733 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-08T16:02:09.748 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-08T16:02:10.025 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librados2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:10.129 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-08T16:02:10.175 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-08T16:02:10.255 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:10.581 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T16:02:10.716 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-08T16:02:11.050 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-08T16:02:11.152 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-08T16:02:11.278 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-08T16:02:11.554 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-08T16:02:11.648 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:11.757 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-08T16:02:11.864 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T16:02:11.883 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-08T16:02:11.998 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-08T16:02:12.124 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-08T16:02:12.301 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-08T16:02:12.451 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-08T16:02:12.627 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-08T16:02:12.743 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-08T16:02:12.928 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T16:02:13.036 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-08T16:02:13.054 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-08T16:02:13.162 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-08T16:02:13.414 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libcephfs2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:13.455 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-08T16:02:13.540 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-08T16:02:13.739 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-08T16:02:13.850 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libradosstriper1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:13.975 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-08T16:02:14.023 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-08T16:02:14.310 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-08T16:02:14.399 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-08T16:02:14.660 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-08T16:02:14.786 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-08T16:02:15.129 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-08T16:02:15.357 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librbd1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:15.472 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-08T16:02:15.474 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-08T16:02:15.620 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-08T16:02:15.625 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-08T16:02:15.732 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-08T16:02:15.751 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-08T16:02:15.885 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-08T16:02:16.050 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-08T16:02:16.212 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-08T16:02:16.337 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-08T16:02:16.367 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librados2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:16.493 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-08T16:02:16.732 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-modules-core (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:16.858 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:17.109 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T16:02:17.109 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T16:02:17.577 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libcephfs-dev (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:17.702 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-08T16:02:17.957 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:18.021 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-08T16:02:18.083 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-08T16:02:18.210 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-08T16:02:18.586 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-08T16:02:18.639 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-08T16:02:18.887 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-08T16:02:19.008 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rados (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:19.153 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librgw2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:19.197 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T16:02:19.279 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up cephfs-top (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:19.347 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-08T16:02:19.405 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rbd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:19.531 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up rbd-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:19.665 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-08T16:02:19.682 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libcephfs2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:19.808 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-08T16:02:19.950 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-08T16:02:20.127 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libradosstriper1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:20.253 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-08T16:02:20.276 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:20.411 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cephfs (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:20.570 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up cephfs-shell (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:20.587 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-08T16:02:20.696 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-08T16:02:21.633 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:21.651 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librbd1 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:21.777 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-08T16:02:21.903 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-08T16:02:22.029 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-08T16:02:22.180 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-08T16:02:22.221 INFO:teuthology.orchestra.run.smithi133.stdout:Adding group ceph....done 2023-10-08T16:02:22.481 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-08T16:02:22.580 INFO:teuthology.orchestra.run.smithi133.stdout:Adding system user ceph....done 2023-10-08T16:02:22.607 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-08T16:02:22.782 INFO:teuthology.orchestra.run.smithi133.stdout:Setting system user ceph properties....done 2023-10-08T16:02:22.803 INFO:teuthology.orchestra.run.smithi133.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-08T16:02:22.942 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-08T16:02:22.987 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-modules-core (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:23.105 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:23.258 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-08T16:02:23.332 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T16:02:23.332 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T16:02:23.790 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libcephfs-dev (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:23.795 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up cephfs-mirror (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:23.916 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-08T16:02:24.017 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T16:02:24.017 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T16:02:24.217 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-08T16:02:24.446 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-test (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:24.560 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-08T16:02:24.597 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up radosgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:24.863 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T16:02:24.863 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T16:02:24.904 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rados (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:25.064 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librgw2 (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:25.192 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up cephfs-top (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:25.318 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rbd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:25.444 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up rbd-fuse (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:25.500 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-base (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:25.579 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-08T16:02:25.863 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-08T16:02:25.874 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-08T16:02:26.148 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:26.274 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cephfs (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:26.352 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mds (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:26.400 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up cephfs-shell (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:26.542 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-08T16:02:26.598 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T16:02:26.598 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T16:02:27.037 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:27.265 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T16:02:27.265 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T16:02:27.463 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-common (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:27.721 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-osd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:28.034 INFO:teuthology.orchestra.run.smithi190.stdout:Adding group ceph....done 2023-10-08T16:02:28.207 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T16:02:28.207 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T16:02:28.419 INFO:teuthology.orchestra.run.smithi190.stdout:Adding system user ceph....done 2023-10-08T16:02:28.620 INFO:teuthology.orchestra.run.smithi190.stdout:Setting system user ceph properties....done 2023-10-08T16:02:28.641 INFO:teuthology.orchestra.run.smithi190.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-08T16:02:28.664 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:28.791 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-08T16:02:28.907 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:29.117 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-08T16:02:29.167 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mon (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:29.397 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T16:02:29.398 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T16:02:29.574 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up cephfs-mirror (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:29.804 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T16:02:29.804 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T16:02:29.835 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:30.003 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:30.129 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-dashboard (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:30.259 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-test (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:30.271 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-volume (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:30.385 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up radosgw (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:30.432 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-08T16:02:30.583 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-08T16:02:30.657 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T16:02:30.658 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T16:02:30.876 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-08T16:02:31.313 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-base (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:31.716 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-08T16:02:32.173 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mds (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:32.398 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T16:02:32.398 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T16:02:32.850 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:33.078 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T16:02:33.078 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T16:02:33.539 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-osd (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:33.854 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-08T16:02:34.016 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T16:02:34.016 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T16:02:34.555 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:34.777 INFO:teuthology.orchestra.run.smithi133.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T16:02:34.779 DEBUG:teuthology.orchestra.run.smithi133:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-10-08T16:02:34.848 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2023-10-08T16:02:35.050 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:35.051 INFO:teuthology.orchestra.run.smithi133.stdout:Building dependency tree... 2023-10-08T16:02:35.052 INFO:teuthology.orchestra.run.smithi133.stdout:Reading state information... 2023-10-08T16:02:35.231 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mon (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:35.243 INFO:teuthology.orchestra.run.smithi133.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-08T16:02:35.243 INFO:teuthology.orchestra.run.smithi133.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-08T16:02:35.243 INFO:teuthology.orchestra.run.smithi133.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-08T16:02:35.243 INFO:teuthology.orchestra.run.smithi133.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-08T16:02:35.244 INFO:teuthology.orchestra.run.smithi133.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-08T16:02:35.244 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T16:02:35.244 INFO:teuthology.orchestra.run.smithi133.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-08T16:02:35.244 INFO:teuthology.orchestra.run.smithi133.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T16:02:35.245 INFO:teuthology.orchestra.run.smithi133.stdout:The following additional packages will be installed: 2023-10-08T16:02:35.245 INFO:teuthology.orchestra.run.smithi133.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-08T16:02:35.245 INFO:teuthology.orchestra.run.smithi133.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-10-08T16:02:35.245 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-10-08T16:02:35.245 INFO:teuthology.orchestra.run.smithi133.stdout: usb-modeswitch-data wpasupplicant 2023-10-08T16:02:35.247 INFO:teuthology.orchestra.run.smithi133.stdout:Suggested packages: 2023-10-08T16:02:35.247 INFO:teuthology.orchestra.run.smithi133.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-10-08T16:02:35.247 INFO:teuthology.orchestra.run.smithi133.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-10-08T16:02:35.293 INFO:teuthology.orchestra.run.smithi133.stdout:The following NEW packages will be installed: 2023-10-08T16:02:35.294 INFO:teuthology.orchestra.run.smithi133.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-08T16:02:35.294 INFO:teuthology.orchestra.run.smithi133.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-10-08T16:02:35.294 INFO:teuthology.orchestra.run.smithi133.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-08T16:02:35.295 INFO:teuthology.orchestra.run.smithi133.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-08T16:02:35.296 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages will be upgraded: 2023-10-08T16:02:35.297 INFO:teuthology.orchestra.run.smithi133.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-08T16:02:35.354 INFO:teuthology.orchestra.run.smithi133.stdout:6 upgraded, 23 newly installed, 0 to remove and 247 not upgraded. 2023-10-08T16:02:35.354 INFO:teuthology.orchestra.run.smithi133.stdout:Need to get 10.4 MB of archives. 2023-10-08T16:02:35.354 INFO:teuthology.orchestra.run.smithi133.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-10-08T16:02:35.355 INFO:teuthology.orchestra.run.smithi133.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-08T16:02:35.438 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T16:02:35.438 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T16:02:35.504 INFO:teuthology.orchestra.run.smithi133.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-08T16:02:35.506 INFO:teuthology.orchestra.run.smithi133.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-08T16:02:35.507 INFO:teuthology.orchestra.run.smithi133.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-08T16:02:35.512 INFO:teuthology.orchestra.run.smithi133.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-08T16:02:35.513 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-08T16:02:35.532 INFO:teuthology.orchestra.run.smithi133.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-08T16:02:35.533 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-08T16:02:35.535 INFO:teuthology.orchestra.run.smithi133.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-08T16:02:35.536 INFO:teuthology.orchestra.run.smithi133.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-08T16:02:35.536 INFO:teuthology.orchestra.run.smithi133.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-08T16:02:35.543 INFO:teuthology.orchestra.run.smithi133.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-08T16:02:35.544 INFO:teuthology.orchestra.run.smithi133.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-08T16:02:35.545 INFO:teuthology.orchestra.run.smithi133.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-08T16:02:35.545 INFO:teuthology.orchestra.run.smithi133.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-08T16:02:35.562 INFO:teuthology.orchestra.run.smithi133.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-08T16:02:35.563 INFO:teuthology.orchestra.run.smithi133.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-08T16:02:35.569 INFO:teuthology.orchestra.run.smithi133.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-08T16:02:35.576 INFO:teuthology.orchestra.run.smithi133.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-08T16:02:35.576 INFO:teuthology.orchestra.run.smithi133.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-08T16:02:35.590 INFO:teuthology.orchestra.run.smithi133.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-08T16:02:35.590 INFO:teuthology.orchestra.run.smithi133.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-08T16:02:35.598 INFO:teuthology.orchestra.run.smithi133.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-08T16:02:35.609 INFO:teuthology.orchestra.run.smithi133.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-08T16:02:35.628 INFO:teuthology.orchestra.run.smithi133.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-08T16:02:35.632 INFO:teuthology.orchestra.run.smithi133.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-08T16:02:35.632 INFO:teuthology.orchestra.run.smithi133.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-08T16:02:35.632 INFO:teuthology.orchestra.run.smithi133.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-08T16:02:35.633 INFO:teuthology.orchestra.run.smithi133.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-08T16:02:35.899 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-cephadm (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:35.933 INFO:teuthology.orchestra.run.smithi133.stdout:Preconfiguring packages ... 2023-10-08T16:02:36.042 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:36.058 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 10.4 MB in 0s (31.6 MB/s) 2023-10-08T16:02:36.168 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-dashboard (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:36.310 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-volume (17.2.6-1320-g08cac018-1focal) ... 2023-10-08T16:02:36.361 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T16:02:36.366 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T16:02:36.421 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-08T16:02:36.531 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T16:02:36.564 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-08T16:02:36.841 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-08T16:02:37.711 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-08T16:02:39.174 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T16:02:39.179 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T16:02:39.303 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T16:02:39.734 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T16:02:39.767 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-08T16:02:40.226 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T16:02:40.560 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-08T16:02:40.665 INFO:teuthology.orchestra.run.smithi190.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T16:02:40.668 DEBUG:teuthology.orchestra.run.smithi190:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-10-08T16:02:40.736 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2023-10-08T16:02:40.939 INFO:teuthology.orchestra.run.smithi190.stdout:Building dependency tree... 2023-10-08T16:02:40.940 INFO:teuthology.orchestra.run.smithi190.stdout:Reading state information... 2023-10-08T16:02:40.995 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T16:02:41.000 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T16:02:41.133 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-08T16:02:41.136 INFO:teuthology.orchestra.run.smithi190.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-08T16:02:41.136 INFO:teuthology.orchestra.run.smithi190.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-08T16:02:41.136 INFO:teuthology.orchestra.run.smithi190.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-08T16:02:41.136 INFO:teuthology.orchestra.run.smithi190.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-08T16:02:41.137 INFO:teuthology.orchestra.run.smithi190.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-08T16:02:41.137 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T16:02:41.137 INFO:teuthology.orchestra.run.smithi190.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-08T16:02:41.137 INFO:teuthology.orchestra.run.smithi190.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T16:02:41.138 INFO:teuthology.orchestra.run.smithi190.stdout:The following additional packages will be installed: 2023-10-08T16:02:41.138 INFO:teuthology.orchestra.run.smithi190.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-08T16:02:41.138 INFO:teuthology.orchestra.run.smithi190.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-10-08T16:02:41.138 INFO:teuthology.orchestra.run.smithi190.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-10-08T16:02:41.138 INFO:teuthology.orchestra.run.smithi190.stdout: usb-modeswitch-data wpasupplicant 2023-10-08T16:02:41.139 INFO:teuthology.orchestra.run.smithi190.stdout:Suggested packages: 2023-10-08T16:02:41.139 INFO:teuthology.orchestra.run.smithi190.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-10-08T16:02:41.140 INFO:teuthology.orchestra.run.smithi190.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-10-08T16:02:41.184 INFO:teuthology.orchestra.run.smithi190.stdout:The following NEW packages will be installed: 2023-10-08T16:02:41.184 INFO:teuthology.orchestra.run.smithi190.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-08T16:02:41.184 INFO:teuthology.orchestra.run.smithi190.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-10-08T16:02:41.185 INFO:teuthology.orchestra.run.smithi190.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-08T16:02:41.185 INFO:teuthology.orchestra.run.smithi190.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-08T16:02:41.186 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages will be upgraded: 2023-10-08T16:02:41.187 INFO:teuthology.orchestra.run.smithi190.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-08T16:02:41.371 INFO:teuthology.orchestra.run.smithi190.stdout:6 upgraded, 23 newly installed, 0 to remove and 247 not upgraded. 2023-10-08T16:02:41.371 INFO:teuthology.orchestra.run.smithi190.stdout:Need to get 10.4 MB of archives. 2023-10-08T16:02:41.371 INFO:teuthology.orchestra.run.smithi190.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-10-08T16:02:41.372 INFO:teuthology.orchestra.run.smithi190.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-08T16:02:41.622 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T16:02:41.780 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-08T16:02:41.992 INFO:teuthology.orchestra.run.smithi190.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-08T16:02:41.994 INFO:teuthology.orchestra.run.smithi190.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-08T16:02:41.995 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-08T16:02:42.008 INFO:teuthology.orchestra.run.smithi190.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-08T16:02:42.010 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-08T16:02:42.108 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-08T16:02:42.111 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-08T16:02:42.118 INFO:teuthology.orchestra.run.smithi190.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-08T16:02:42.123 INFO:teuthology.orchestra.run.smithi190.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-08T16:02:42.124 INFO:teuthology.orchestra.run.smithi190.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-08T16:02:42.291 INFO:teuthology.orchestra.run.smithi190.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-08T16:02:42.318 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-08T16:02:42.451 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-08T16:02:42.563 INFO:teuthology.orchestra.run.smithi190.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-08T16:02:42.692 INFO:teuthology.orchestra.run.smithi190.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-08T16:02:42.697 INFO:teuthology.orchestra.run.smithi190.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-08T16:02:42.793 INFO:teuthology.orchestra.run.smithi190.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-08T16:02:42.797 INFO:teuthology.orchestra.run.smithi190.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-08T16:02:42.880 INFO:teuthology.orchestra.run.smithi190.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-08T16:02:42.954 INFO:teuthology.orchestra.run.smithi190.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-08T16:02:42.954 INFO:teuthology.orchestra.run.smithi190.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-08T16:02:42.988 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-08T16:02:43.006 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-08T16:02:43.043 INFO:teuthology.orchestra.run.smithi190.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-08T16:02:43.043 INFO:teuthology.orchestra.run.smithi190.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-08T16:02:43.072 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-08T16:02:43.238 INFO:teuthology.orchestra.run.smithi190.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-08T16:02:43.400 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package dump. 2023-10-08T16:02:43.419 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-08T16:02:43.482 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking dump (0.4b46-6) ... 2023-10-08T16:02:43.780 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package indent. 2023-10-08T16:02:43.799 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T16:02:43.838 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-08T16:02:43.878 INFO:teuthology.orchestra.run.smithi190.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-08T16:02:43.992 INFO:teuthology.orchestra.run.smithi190.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-08T16:02:44.007 INFO:teuthology.orchestra.run.smithi190.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-08T16:02:44.009 INFO:teuthology.orchestra.run.smithi190.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-08T16:02:44.011 INFO:teuthology.orchestra.run.smithi190.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-08T16:02:44.012 INFO:teuthology.orchestra.run.smithi190.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-08T16:02:44.183 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-08T16:02:44.201 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-08T16:02:44.241 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-08T16:02:44.340 INFO:teuthology.orchestra.run.smithi190.stdout:Preconfiguring packages ... 2023-10-08T16:02:44.489 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 10.4 MB in 3s (3,700 kB/s) 2023-10-08T16:02:44.594 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-08T16:02:44.613 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-08T16:02:44.653 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-08T16:02:44.712 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T16:02:44.717 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T16:02:44.861 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T16:02:44.947 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-08T16:02:44.964 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T16:02:45.005 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T16:02:46.051 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-08T16:02:46.162 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-08T16:02:46.182 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T16:02:46.404 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T16:02:47.239 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-08T16:02:47.257 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T16:02:47.297 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T16:02:47.488 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T16:02:47.493 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T16:02:47.625 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T16:02:47.658 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-08T16:02:47.677 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T16:02:47.716 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T16:02:48.048 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T16:02:48.103 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-08T16:02:48.121 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-08T16:02:48.161 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-08T16:02:48.223 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T16:02:48.506 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-08T16:02:48.526 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-08T16:02:48.547 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-08T16:02:48.564 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-08T16:02:48.967 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-08T16:02:48.984 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T16:02:48.993 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152664 files and directories currently installed.) 2023-10-08T16:02:48.998 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T16:02:49.025 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T16:02:49.130 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-08T16:02:49.328 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-08T16:02:49.347 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T16:02:49.411 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T16:02:49.593 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T16:02:49.663 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-08T16:02:49.681 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-08T16:02:49.721 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T16:02:49.895 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-08T16:02:50.224 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-08T16:02:50.225 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-08T16:02:50.242 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-10-08T16:02:50.300 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-08T16:02:50.339 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-08T16:02:50.745 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package modemmanager. 2023-10-08T16:02:50.764 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T16:02:50.814 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T16:02:51.443 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package wpasupplicant. 2023-10-08T16:02:51.459 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-08T16:02:51.500 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-08T16:02:51.837 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-08T16:02:51.858 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-08T16:02:51.990 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package network-manager. 2023-10-08T16:02:52.006 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-08T16:02:52.071 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-08T16:02:52.160 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-08T16:02:52.824 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package dump. 2023-10-08T16:02:52.845 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-08T16:02:52.874 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking dump (0.4b46-6) ... 2023-10-08T16:02:53.178 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package indent. 2023-10-08T16:02:53.195 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T16:02:53.236 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-08T16:02:53.547 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-08T16:02:53.564 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-08T16:02:53.605 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-08T16:02:53.698 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ppp. 2023-10-08T16:02:53.718 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-08T16:02:53.958 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-08T16:02:53.973 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-08T16:02:53.976 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-08T16:02:54.017 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-08T16:02:54.253 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-08T16:02:54.269 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T16:02:54.302 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T16:02:54.328 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package pptp-linux. 2023-10-08T16:02:54.348 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-08T16:02:54.386 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-08T16:02:54.672 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-08T16:02:54.689 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T16:02:54.730 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T16:02:54.756 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-08T16:02:54.775 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-08T16:02:54.832 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-08T16:02:55.008 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-08T16:02:55.027 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T16:02:55.066 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T16:02:55.093 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-08T16:02:55.111 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-08T16:02:55.151 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-08T16:02:55.377 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-08T16:02:55.395 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T16:02:55.427 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T16:02:55.537 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-08T16:02:55.557 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-08T16:02:55.606 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-08T16:02:55.738 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-08T16:02:55.758 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-08T16:02:55.796 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-08T16:02:55.900 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T16:02:56.158 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-08T16:02:56.176 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-08T16:02:56.209 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-08T16:02:56.215 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-08T16:02:56.360 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-08T16:02:56.487 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-08T16:02:56.602 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-08T16:02:56.619 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T16:02:56.660 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T16:02:56.917 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T16:02:56.918 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T16:02:56.963 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-08T16:02:56.980 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T16:02:57.012 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T16:02:57.265 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-08T16:02:57.282 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-08T16:02:57.323 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T16:02:57.389 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-08T16:02:57.515 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-08T16:02:57.666 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T16:02:57.792 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-08T16:02:57.918 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-08T16:02:58.069 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-08T16:02:58.261 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-08T16:02:58.282 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-10-08T16:02:58.544 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-08T16:02:59.132 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package modemmanager. 2023-10-08T16:02:59.149 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T16:02:59.197 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-08T16:02:59.200 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T16:02:59.433 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up dump (0.4b46-6) ... 2023-10-08T16:02:59.528 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-08T16:02:59.585 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T16:02:59.711 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-08T16:02:59.837 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package wpasupplicant. 2023-10-08T16:02:59.855 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-08T16:02:59.862 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-08T16:02:59.895 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-08T16:02:59.988 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-08T16:03:00.165 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-08T16:03:00.332 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T16:03:00.450 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T16:03:00.459 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package network-manager. 2023-10-08T16:03:00.478 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-08T16:03:00.542 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-08T16:03:00.568 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-08T16:03:00.761 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T16:03:00.896 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-08T16:03:01.282 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ppp. 2023-10-08T16:03:01.300 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-08T16:03:01.552 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-08T16:03:01.595 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:01.595 INFO:teuthology.orchestra.run.smithi133.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-08T16:03:01.595 INFO:teuthology.orchestra.run.smithi133.stdout:which means they are currently configured by ifupdown: 2023-10-08T16:03:01.595 INFO:teuthology.orchestra.run.smithi133.stdout:- enp3s0f1 2023-10-08T16:03:01.596 INFO:teuthology.orchestra.run.smithi133.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-08T16:03:01.596 INFO:teuthology.orchestra.run.smithi133.stdout:remove their configuration from /etc/network/interfaces. 2023-10-08T16:03:01.596 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:01.760 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-08T16:03:01.891 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package pptp-linux. 2023-10-08T16:03:01.910 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-08T16:03:01.954 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-08T16:03:02.094 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-08T16:03:02.265 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-08T16:03:02.283 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-08T16:03:02.341 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-08T16:03:02.593 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-08T16:03:02.611 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-08T16:03:02.622 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-08T16:03:02.659 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-08T16:03:03.046 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-08T16:03:03.064 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-08T16:03:03.107 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T16:03:03.115 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-08T16:03:03.241 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-08T16:03:03.367 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T16:03:03.421 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T16:03:03.527 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T16:03:03.670 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T16:03:03.726 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-08T16:03:03.796 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T16:03:03.900 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-08T16:03:04.088 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T16:03:04.089 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T16:03:04.460 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-08T16:03:04.598 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-08T16:03:04.699 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-08T16:03:04.853 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T16:03:04.853 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T16:03:04.858 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-08T16:03:05.001 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-08T16:03:05.286 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-08T16:03:05.323 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-08T16:03:05.441 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-08T16:03:05.583 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T16:03:05.709 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-08T16:03:05.835 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-08T16:03:05.970 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-08T16:03:06.945 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-08T16:03:07.184 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up dump (0.4b46-6) ... 2023-10-08T16:03:07.278 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-08T16:03:07.343 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T16:03:07.470 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-08T16:03:07.587 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-08T16:03:07.739 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-08T16:03:07.915 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-08T16:03:08.041 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T16:03:08.167 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T16:03:08.293 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-08T16:03:08.486 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T16:03:08.595 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-08T16:03:09.089 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-08T16:03:09.189 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-08T16:03:09.297 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:09.298 INFO:teuthology.orchestra.run.smithi190.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-08T16:03:09.298 INFO:teuthology.orchestra.run.smithi190.stdout:which means they are currently configured by ifupdown: 2023-10-08T16:03:09.298 INFO:teuthology.orchestra.run.smithi190.stdout:- enp3s0f1 2023-10-08T16:03:09.298 INFO:teuthology.orchestra.run.smithi190.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-08T16:03:09.298 INFO:teuthology.orchestra.run.smithi190.stdout:remove their configuration from /etc/network/interfaces. 2023-10-08T16:03:09.298 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:09.455 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-08T16:03:09.766 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-08T16:03:10.083 INFO:teuthology.orchestra.run.smithi133.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T16:03:10.085 DEBUG:teuthology.parallel:result is None 2023-10-08T16:03:10.317 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-08T16:03:10.815 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T16:03:10.958 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-08T16:03:11.118 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T16:03:11.264 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T16:03:11.403 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T16:03:11.529 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T16:03:11.802 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T16:03:11.802 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T16:03:12.315 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-08T16:03:12.416 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-08T16:03:12.525 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-08T16:03:12.676 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-08T16:03:12.978 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-08T16:03:16.966 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-08T16:03:17.057 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-08T16:03:17.889 INFO:teuthology.orchestra.run.smithi190.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T16:03:17.891 DEBUG:teuthology.parallel:result is None 2023-10-08T16:03:17.892 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T16:03:18.102 DEBUG:teuthology.orchestra.run.smithi133:> dpkg-query -W -f '${Version}' ceph 2023-10-08T16:03:18.126 INFO:teuthology.orchestra.run.smithi133.stdout:17.2.6-1320-g08cac018-1focal 2023-10-08T16:03:18.127 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320-g08cac018-1focal 2023-10-08T16:03:18.127 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320-g08cac018-1focal is installed. 2023-10-08T16:03:18.127 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T16:03:18.339 DEBUG:teuthology.orchestra.run.smithi190:> dpkg-query -W -f '${Version}' ceph 2023-10-08T16:03:18.364 INFO:teuthology.orchestra.run.smithi190.stdout:17.2.6-1320-g08cac018-1focal 2023-10-08T16:03:18.364 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320-g08cac018-1focal 2023-10-08T16:03:18.364 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320-g08cac018-1focal is installed. 2023-10-08T16:03:18.365 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-08T16:03:18.365 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-08T16:03:18.365 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T16:03:18.382 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-08T16:03:18.382 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T16:03:18.398 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-08T16:03:18.399 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-08T16:03:18.399 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T16:03:18.414 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T16:03:18.472 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-08T16:03:18.472 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T16:03:18.488 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T16:03:18.500 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-08T16:03:18.500 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-08T16:03:18.500 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T16:03:18.516 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T16:03:18.527 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-08T16:03:18.527 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T16:03:18.542 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T16:03:18.598 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-08T16:03:18.598 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-08T16:03:18.598 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T16:03:18.614 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T16:03:18.629 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-08T16:03:18.629 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T16:03:18.645 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T16:03:18.654 INFO:teuthology.run_tasks:Running task ceph... 2023-10-08T16:03:18.712 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-08T16:03:18.712 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 777 /var/log/ceph 2023-10-08T16:03:18.714 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 777 /var/log/ceph 2023-10-08T16:03:18.730 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-08T16:03:18.730 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T16:03:18.732 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T16:03:18.786 INFO:tasks.ceph:Creating extra log directories... 2023-10-08T16:03:18.786 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T16:03:18.788 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T16:03:18.807 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-08T16:03:18.807 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-08T16:03:18.807 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-08T16:03:18.807 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-08T16:03:18.807 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-08T16:03:18.814 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-08T16:03:18.895 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-08T16:03:18.895 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-08T16:03:18.901 DEBUG:teuthology.orchestra.run.smithi190:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-08T16:03:18.985 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-08T16:03:18.985 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-08T16:03:18.985 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418300', 'branch': 'wip-yuri-testing-2023-10-06-0949-quincy', 'description': 'fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs/{frag test}}', 'email': None, 'first_in_suite': False, 'job_id': '7418300', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-06-0949-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-10-07-1508-quincy', 'sha1': 'abf19fc7a04fe4fceab4e98d4013ae1da7c06006'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 74, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 8174, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-10-07-1508-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'abf19fc7a04fe4fceab4e98d4013ae1da7c06006', 'targets': {'smithi133.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi190.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'cluster': 'ceph'}}, {'check-counter': {'counters': {'mds': ['mds.dir_split']}}}, {'workunit': {'clients': {'client.0': ['libcephfs/test.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-08_15:41:30', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-08T16:03:18.986 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T16:03:18.988 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T16:03:18.994 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T16:03:19.038 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T16:03:19.053 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-08T16:03:19.053 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T16:03:19.057 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T16:03:19.057 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_1 2023-10-08T16:03:19.065 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T16:03:19.065 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:03:19.065 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 361 Links: 1 2023-10-08T16:03:19.065 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:03:19.065 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-10-08 15:58:45.189774117 +0000 2023-10-08T16:03:19.065 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-10-08 15:58:44.905841474 +0000 2023-10-08T16:03:19.065 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-10-08 15:58:44.905841474 +0000 2023-10-08T16:03:19.065 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-10-08T16:03:19.066 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T16:03:19.076 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-10-08T16:03:19.076 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-10-08T16:03:19.076 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000361539 s, 1.4 MB/s 2023-10-08T16:03:19.077 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T16:03:19.128 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_2 2023-10-08T16:03:19.135 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T16:03:19.135 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:03:19.135 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 366 Links: 1 2023-10-08T16:03:19.135 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:03:19.135 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-10-08 15:58:45.713650942 +0000 2023-10-08T16:03:19.135 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-10-08 15:58:45.397725223 +0000 2023-10-08T16:03:19.135 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-10-08 15:58:45.397725223 +0000 2023-10-08T16:03:19.135 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-10-08T16:03:19.136 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T16:03:19.146 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-10-08T16:03:19.146 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-10-08T16:03:19.146 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000404914 s, 1.3 MB/s 2023-10-08T16:03:19.147 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T16:03:19.197 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_3 2023-10-08T16:03:19.204 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T16:03:19.204 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:03:19.204 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 374 Links: 1 2023-10-08T16:03:19.205 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:03:19.205 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-10-08 15:58:45.973589825 +0000 2023-10-08T16:03:19.205 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-10-08 15:58:45.969590764 +0000 2023-10-08T16:03:19.205 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-10-08 15:58:45.969590764 +0000 2023-10-08T16:03:19.205 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-10-08T16:03:19.205 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T16:03:19.215 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-10-08T16:03:19.215 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-10-08T16:03:19.215 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000395035 s, 1.3 MB/s 2023-10-08T16:03:19.216 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T16:03:19.265 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_4 2023-10-08T16:03:19.271 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T16:03:19.271 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:03:19.272 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 380 Links: 1 2023-10-08T16:03:19.272 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:03:19.272 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-10-08 15:58:46.805400649 +0000 2023-10-08T16:03:19.272 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-10-08 15:58:46.517466046 +0000 2023-10-08T16:03:19.272 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-10-08 15:58:46.517466046 +0000 2023-10-08T16:03:19.272 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-10-08T16:03:19.272 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T16:03:19.283 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-10-08T16:03:19.283 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-10-08T16:03:19.283 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000411308 s, 1.2 MB/s 2023-10-08T16:03:19.284 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T16:03:19.333 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T16:03:19.333 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-08T16:03:19.333 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T16:03:19.339 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T16:03:19.340 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_1 2023-10-08T16:03:19.347 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T16:03:19.347 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:03:19.347 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 6h/6d Inode: 361 Links: 1 2023-10-08T16:03:19.347 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:03:19.347 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-10-08 15:58:43.727150488 +0000 2023-10-08T16:03:19.347 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-10-08 15:58:43.423157489 +0000 2023-10-08T16:03:19.348 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-10-08 15:58:43.423157489 +0000 2023-10-08T16:03:19.348 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2023-10-08T16:03:19.348 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T16:03:19.359 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-10-08T16:03:19.359 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-10-08T16:03:19.359 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000448586 s, 1.1 MB/s 2023-10-08T16:03:19.360 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T16:03:19.411 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_2 2023-10-08T16:03:19.418 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T16:03:19.418 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:03:19.418 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 6h/6d Inode: 364 Links: 1 2023-10-08T16:03:19.418 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:03:19.418 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-10-08 15:58:44.203139527 +0000 2023-10-08T16:03:19.418 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-10-08 15:58:43.927145883 +0000 2023-10-08T16:03:19.419 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-10-08 15:58:43.927145883 +0000 2023-10-08T16:03:19.419 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2023-10-08T16:03:19.419 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T16:03:19.434 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-10-08T16:03:19.434 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-10-08T16:03:19.434 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000381691 s, 1.3 MB/s 2023-10-08T16:03:19.435 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T16:03:19.483 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_3 2023-10-08T16:03:19.490 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T16:03:19.491 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:03:19.491 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 6h/6d Inode: 372 Links: 1 2023-10-08T16:03:19.491 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:03:19.491 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-10-08 15:58:44.707127919 +0000 2023-10-08T16:03:19.491 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-10-08 15:58:44.411134736 +0000 2023-10-08T16:03:19.491 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-10-08 15:58:44.411134736 +0000 2023-10-08T16:03:19.491 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2023-10-08T16:03:19.491 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T16:03:19.503 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-10-08T16:03:19.503 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-10-08T16:03:19.503 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000398818 s, 1.3 MB/s 2023-10-08T16:03:19.504 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T16:03:19.556 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_4 2023-10-08T16:03:19.562 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T16:03:19.563 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:03:19.563 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 6h/6d Inode: 377 Links: 1 2023-10-08T16:03:19.563 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:03:19.563 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-10-08 15:58:44.919123037 +0000 2023-10-08T16:03:19.563 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-10-08 15:58:44.915123128 +0000 2023-10-08T16:03:19.563 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-10-08 15:58:44.915123128 +0000 2023-10-08T16:03:19.563 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2023-10-08T16:03:19.563 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T16:03:19.575 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-10-08T16:03:19.575 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-10-08T16:03:19.576 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000390308 s, 1.3 MB/s 2023-10-08T16:03:19.577 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T16:03:19.586 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T16:03:19.586 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi190.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-08T16:03:19.586 INFO:tasks.ceph:Generating config... 2023-10-08T16:03:19.587 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-08T16:03:19.588 INFO:tasks.ceph:[client] debug client = 20 2023-10-08T16:03:19.588 INFO:tasks.ceph:[client] debug ms = 1 2023-10-08T16:03:19.588 INFO:tasks.ceph:[client] pid file = 2023-10-08T16:03:19.588 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-08T16:03:19.588 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-08T16:03:19.588 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-08T16:03:19.588 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-08T16:03:19.588 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2023-10-08T16:03:19.588 INFO:tasks.ceph:[mds] mds bal merge size = 5 2023-10-08T16:03:19.588 INFO:tasks.ceph:[mds] mds bal split bits = 3 2023-10-08T16:03:19.589 INFO:tasks.ceph:[mds] mds bal split size = 100 2023-10-08T16:03:19.589 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-08T16:03:19.589 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-08T16:03:19.589 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-08T16:03:19.589 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-08T16:03:19.589 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-08T16:03:19.589 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-08T16:03:19.589 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-08T16:03:19.589 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-08T16:03:19.589 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-08T16:03:19.590 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-08T16:03:19.590 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-08T16:03:19.590 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-08T16:03:19.590 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-08T16:03:19.590 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-08T16:03:19.590 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-08T16:03:19.590 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-08T16:03:19.590 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-08T16:03:19.590 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-08T16:03:19.590 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-08T16:03:19.591 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-08T16:03:19.591 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-08T16:03:19.591 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-08T16:03:19.591 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-08T16:03:19.591 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-08T16:03:19.591 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-08T16:03:19.591 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-08T16:03:19.591 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-08T16:03:19.591 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-08T16:03:19.591 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-08T16:03:19.592 INFO:tasks.ceph:Setting up mon.a... 2023-10-08T16:03:19.592 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-08T16:03:19.626 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.keyring 2023-10-08T16:03:19.629 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-08T16:03:19.660 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T16:03:19.720 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.133'), ('mon.b', '172.21.15.190'), ('mon.c', '[v2:172.21.15.190:3301,v1:172.21.15.190:6790]')] 2023-10-08T16:03:19.721 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.133,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-08T16:03:19.721 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-08T16:03:19.721 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-08T16:03:19.726 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.133 --add b 172.21.15.190 --addv c '[v2:172.21.15.190:3301,v1:172.21.15.190:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:03:19.764 INFO:teuthology.orchestra.run.smithi133.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:03:19.764 INFO:teuthology.orchestra.run.smithi133.stdout:monmaptool: generated fsid f2546191-d59e-4805-8e1b-3d8d3d1dad86 2023-10-08T16:03:19.764 INFO:teuthology.orchestra.run.smithi133.stdout:setting min_mon_release = octopus 2023-10-08T16:03:19.764 INFO:teuthology.orchestra.run.smithi133.stdout:epoch 0 2023-10-08T16:03:19.764 INFO:teuthology.orchestra.run.smithi133.stdout:fsid f2546191-d59e-4805-8e1b-3d8d3d1dad86 2023-10-08T16:03:19.764 INFO:teuthology.orchestra.run.smithi133.stdout:last_changed 2023-10-08T16:03:19.764172+0000 2023-10-08T16:03:19.765 INFO:teuthology.orchestra.run.smithi133.stdout:created 2023-10-08T16:03:19.764172+0000 2023-10-08T16:03:19.765 INFO:teuthology.orchestra.run.smithi133.stdout:min_mon_release 15 (octopus) 2023-10-08T16:03:19.765 INFO:teuthology.orchestra.run.smithi133.stdout:election_strategy: 1 2023-10-08T16:03:19.765 INFO:teuthology.orchestra.run.smithi133.stdout:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2023-10-08T16:03:19.765 INFO:teuthology.orchestra.run.smithi133.stdout:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2023-10-08T16:03:19.765 INFO:teuthology.orchestra.run.smithi133.stdout:2: [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] mon.c 2023-10-08T16:03:19.765 INFO:teuthology.orchestra.run.smithi133.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-08T16:03:19.766 DEBUG:teuthology.orchestra.run.smithi133:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-08T16:03:19.772 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f2546191-d59e-4805-8e1b-3d8d3d1dad86... 2023-10-08T16:03:19.773 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T16:03:19.814 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T16:03:19.849 INFO:teuthology.orchestra.run.smithi190.stdout:[global] 2023-10-08T16:03:19.849 INFO:teuthology.orchestra.run.smithi190.stdout: chdir = "" 2023-10-08T16:03:19.849 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T16:03:19.849 INFO:teuthology.orchestra.run.smithi190.stdout: auth supported = cephx 2023-10-08T16:03:19.849 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.849 INFO:teuthology.orchestra.run.smithi190.stdout: filestore xattr use omap = true 2023-10-08T16:03:19.850 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.850 INFO:teuthology.orchestra.run.smithi190.stdout: mon clock drift allowed = 1.000 2023-10-08T16:03:19.850 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.850 INFO:teuthology.orchestra.run.smithi190.stdout: osd crush chooseleaf type = 0 2023-10-08T16:03:19.850 INFO:teuthology.orchestra.run.smithi190.stdout: auth debug = true 2023-10-08T16:03:19.850 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.850 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on old message = true 2023-10-08T16:03:19.850 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on bug = true 2023-10-08T16:03:19.850 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.850 INFO:teuthology.orchestra.run.smithi190.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T16:03:19.850 INFO:teuthology.orchestra.run.smithi190.stdout: mon pg warn max object skew = 0 2023-10-08T16:03:19.851 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.851 INFO:teuthology.orchestra.run.smithi190.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T16:03:19.851 INFO:teuthology.orchestra.run.smithi190.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T16:03:19.851 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.851 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default size = 2 2023-10-08T16:03:19.851 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.851 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow primary affinity = true 2023-10-08T16:03:19.851 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow pg remap = true 2023-10-08T16:03:19.851 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on legacy crush tunables = false 2023-10-08T16:03:19.851 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on crush straw calc version zero = false 2023-10-08T16:03:19.851 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on no sortbitwise = false 2023-10-08T16:03:19.851 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on osd down out interval zero = false 2023-10-08T16:03:19.851 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on too few osds = false 2023-10-08T16:03:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T16:03:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T16:03:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: mon_allow_pool_size_one = true 2023-10-08T16:03:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T16:03:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: osd default data pool replay window = 5 2023-10-08T16:03:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: mon allow pool delete = true 2023-10-08T16:03:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: mon cluster log file level = debug 2023-10-08T16:03:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: debug asserts on shutdown = true 2023-10-08T16:03:19.853 INFO:teuthology.orchestra.run.smithi190.stdout: mon health detail to clog = false 2023-10-08T16:03:19.853 INFO:teuthology.orchestra.run.smithi190.stdout: mon host = "172.21.15.133,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2023-10-08T16:03:19.853 INFO:teuthology.orchestra.run.smithi190.stdout: fsid = f2546191-d59e-4805-8e1b-3d8d3d1dad86 2023-10-08T16:03:19.853 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.853 INFO:teuthology.orchestra.run.smithi190.stdout:[osd] 2023-10-08T16:03:19.853 INFO:teuthology.orchestra.run.smithi190.stdout: osd journal size = 100 2023-10-08T16:03:19.853 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.853 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub load threshold = 5.0 2023-10-08T16:03:19.853 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub max interval = 600 2023-10-08T16:03:19.853 INFO:teuthology.orchestra.run.smithi190.stdout: osd mclock profile = high_recovery_ops 2023-10-08T16:03:19.853 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.853 INFO:teuthology.orchestra.run.smithi190.stdout: osd recover clone overlap = true 2023-10-08T16:03:19.854 INFO:teuthology.orchestra.run.smithi190.stdout: osd recovery max chunk = 1048576 2023-10-08T16:03:19.854 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.854 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug shutdown = true 2023-10-08T16:03:19.854 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug op order = true 2023-10-08T16:03:19.854 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug verify stray on activate = true 2023-10-08T16:03:19.854 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.854 INFO:teuthology.orchestra.run.smithi190.stdout: osd open classes on start = true 2023-10-08T16:03:19.854 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug pg log writeout = true 2023-10-08T16:03:19.854 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.854 INFO:teuthology.orchestra.run.smithi190.stdout: osd deep scrub update digest min age = 30 2023-10-08T16:03:19.854 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.854 INFO:teuthology.orchestra.run.smithi190.stdout: osd map max advance = 10 2023-10-08T16:03:19.855 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.855 INFO:teuthology.orchestra.run.smithi190.stdout: journal zero on create = true 2023-10-08T16:03:19.855 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.855 INFO:teuthology.orchestra.run.smithi190.stdout: filestore ondisk finisher threads = 3 2023-10-08T16:03:19.855 INFO:teuthology.orchestra.run.smithi190.stdout: filestore apply finisher threads = 3 2023-10-08T16:03:19.855 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.855 INFO:teuthology.orchestra.run.smithi190.stdout: bdev debug aio = true 2023-10-08T16:03:19.855 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug misdirected ops = true 2023-10-08T16:03:19.855 INFO:teuthology.orchestra.run.smithi190.stdout: bdev async discard = True 2023-10-08T16:03:19.855 INFO:teuthology.orchestra.run.smithi190.stdout: bdev enable discard = True 2023-10-08T16:03:19.855 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore allocator = bitmap 2023-10-08T16:03:19.855 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore block size = 96636764160 2023-10-08T16:03:19.856 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore fsck on mount = True 2023-10-08T16:03:19.856 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluefs = 1/20 2023-10-08T16:03:19.856 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluestore = 1/20 2023-10-08T16:03:19.856 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2023-10-08T16:03:19.856 INFO:teuthology.orchestra.run.smithi190.stdout: debug osd = 20 2023-10-08T16:03:19.856 INFO:teuthology.orchestra.run.smithi190.stdout: debug rocksdb = 4/10 2023-10-08T16:03:19.856 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T16:03:19.856 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd full ratio = 0.9 2023-10-08T16:03:19.856 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd nearfull ratio = 0.8 2023-10-08T16:03:19.856 INFO:teuthology.orchestra.run.smithi190.stdout: osd failsafe full ratio = 0.95 2023-10-08T16:03:19.856 INFO:teuthology.orchestra.run.smithi190.stdout: osd objectstore = bluestore 2023-10-08T16:03:19.856 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2023-10-08T16:03:19.857 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.857 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr] 2023-10-08T16:03:19.857 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2023-10-08T16:03:19.857 INFO:teuthology.orchestra.run.smithi190.stdout: debug mgr = 20 2023-10-08T16:03:19.857 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2023-10-08T16:03:19.857 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2023-10-08T16:03:19.857 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2023-10-08T16:03:19.857 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2023-10-08T16:03:19.857 INFO:teuthology.orchestra.run.smithi190.stdout: mgr/telemetry/nag = false 2023-10-08T16:03:19.857 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.857 INFO:teuthology.orchestra.run.smithi190.stdout:[mon] 2023-10-08T16:03:19.857 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2023-10-08T16:03:19.857 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2023-10-08T16:03:19.858 INFO:teuthology.orchestra.run.smithi190.stdout: debug paxos = 20 2023-10-08T16:03:19.858 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2023-10-08T16:03:19.858 INFO:teuthology.orchestra.run.smithi190.stdout: mon data avail warn = 5 2023-10-08T16:03:19.858 INFO:teuthology.orchestra.run.smithi190.stdout: mon mgr mkfs grace = 240 2023-10-08T16:03:19.858 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2023-10-08T16:03:19.858 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd reporter subtree level = osd 2023-10-08T16:03:19.858 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd prime pg temp = true 2023-10-08T16:03:19.858 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2023-10-08T16:03:19.858 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.858 INFO:teuthology.orchestra.run.smithi190.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T16:03:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T16:03:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T16:03:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T16:03:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T16:03:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T16:03:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: # 1m isn't quite enough 2023-10-08T16:03:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: mon_down_mkfs_grace = 2m 2023-10-08T16:03:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_filestore_osds = false 2023-10-08T16:03:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: mon op complaint time = 120 2023-10-08T16:03:19.860 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-08T16:03:19.860 INFO:teuthology.orchestra.run.smithi190.stdout:[client] 2023-10-08T16:03:19.860 INFO:teuthology.orchestra.run.smithi190.stdout: rgw cache enabled = true 2023-10-08T16:03:19.860 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable ops log = true 2023-10-08T16:03:19.860 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable usage log = true 2023-10-08T16:03:19.860 INFO:teuthology.orchestra.run.smithi190.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T16:03:19.860 INFO:teuthology.orchestra.run.smithi190.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T16:03:19.860 INFO:teuthology.orchestra.run.smithi190.stdout: client mount timeout = 600 2023-10-08T16:03:19.860 INFO:teuthology.orchestra.run.smithi190.stdout: debug client = 20 2023-10-08T16:03:19.860 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2023-10-08T16:03:19.860 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = "" 2023-10-08T16:03:19.860 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2023-10-08T16:03:19.861 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2023-10-08T16:03:19.861 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.a] 2023-10-08T16:03:19.861 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.b] 2023-10-08T16:03:19.861 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.c] 2023-10-08T16:03:19.861 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.a] 2023-10-08T16:03:19.861 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.b] 2023-10-08T16:03:19.861 INFO:teuthology.orchestra.run.smithi190.stdout:[mds] 2023-10-08T16:03:19.861 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds = 20 2023-10-08T16:03:19.861 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2023-10-08T16:03:19.861 INFO:teuthology.orchestra.run.smithi190.stdout: mds bal fragment size max = 10000 2023-10-08T16:03:19.861 INFO:teuthology.orchestra.run.smithi190.stdout: mds bal merge size = 5 2023-10-08T16:03:19.861 INFO:teuthology.orchestra.run.smithi190.stdout: mds bal split bits = 3 2023-10-08T16:03:19.861 INFO:teuthology.orchestra.run.smithi190.stdout: mds bal split size = 100 2023-10-08T16:03:19.862 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug frag = True 2023-10-08T16:03:19.862 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug scatterstat = True 2023-10-08T16:03:19.862 INFO:teuthology.orchestra.run.smithi190.stdout: mds op complaint time = 180 2023-10-08T16:03:19.862 INFO:teuthology.orchestra.run.smithi190.stdout: mds verify scatter = True 2023-10-08T16:03:19.862 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2023-10-08T16:03:19.862 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2023-10-08T16:03:19.862 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2023-10-08T16:03:19.863 INFO:teuthology.orchestra.run.smithi133.stdout:[global] 2023-10-08T16:03:19.864 INFO:teuthology.orchestra.run.smithi133.stdout: chdir = "" 2023-10-08T16:03:19.864 INFO:teuthology.orchestra.run.smithi133.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T16:03:19.864 INFO:teuthology.orchestra.run.smithi133.stdout: auth supported = cephx 2023-10-08T16:03:19.864 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.864 INFO:teuthology.orchestra.run.smithi133.stdout: filestore xattr use omap = true 2023-10-08T16:03:19.864 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.864 INFO:teuthology.orchestra.run.smithi133.stdout: mon clock drift allowed = 1.000 2023-10-08T16:03:19.864 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.864 INFO:teuthology.orchestra.run.smithi133.stdout: osd crush chooseleaf type = 0 2023-10-08T16:03:19.864 INFO:teuthology.orchestra.run.smithi133.stdout: auth debug = true 2023-10-08T16:03:19.864 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.865 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on old message = true 2023-10-08T16:03:19.865 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on bug = true 2023-10-08T16:03:19.865 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.865 INFO:teuthology.orchestra.run.smithi133.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T16:03:19.865 INFO:teuthology.orchestra.run.smithi133.stdout: mon pg warn max object skew = 0 2023-10-08T16:03:19.865 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.865 INFO:teuthology.orchestra.run.smithi133.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T16:03:19.865 INFO:teuthology.orchestra.run.smithi133.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T16:03:19.865 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.865 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default size = 2 2023-10-08T16:03:19.865 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.865 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow primary affinity = true 2023-10-08T16:03:19.866 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow pg remap = true 2023-10-08T16:03:19.866 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on legacy crush tunables = false 2023-10-08T16:03:19.866 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on crush straw calc version zero = false 2023-10-08T16:03:19.866 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on no sortbitwise = false 2023-10-08T16:03:19.866 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on osd down out interval zero = false 2023-10-08T16:03:19.866 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on too few osds = false 2023-10-08T16:03:19.866 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T16:03:19.866 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T16:03:19.866 INFO:teuthology.orchestra.run.smithi133.stdout: mon_allow_pool_size_one = true 2023-10-08T16:03:19.866 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.866 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T16:03:19.866 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.867 INFO:teuthology.orchestra.run.smithi133.stdout: osd default data pool replay window = 5 2023-10-08T16:03:19.867 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.867 INFO:teuthology.orchestra.run.smithi133.stdout: mon allow pool delete = true 2023-10-08T16:03:19.867 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.867 INFO:teuthology.orchestra.run.smithi133.stdout: mon cluster log file level = debug 2023-10-08T16:03:19.867 INFO:teuthology.orchestra.run.smithi133.stdout: debug asserts on shutdown = true 2023-10-08T16:03:19.867 INFO:teuthology.orchestra.run.smithi133.stdout: mon health detail to clog = false 2023-10-08T16:03:19.867 INFO:teuthology.orchestra.run.smithi133.stdout: mon host = "172.21.15.133,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2023-10-08T16:03:19.867 INFO:teuthology.orchestra.run.smithi133.stdout: fsid = f2546191-d59e-4805-8e1b-3d8d3d1dad86 2023-10-08T16:03:19.867 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.867 INFO:teuthology.orchestra.run.smithi133.stdout:[osd] 2023-10-08T16:03:19.867 INFO:teuthology.orchestra.run.smithi133.stdout: osd journal size = 100 2023-10-08T16:03:19.868 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.868 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub load threshold = 5.0 2023-10-08T16:03:19.868 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub max interval = 600 2023-10-08T16:03:19.868 INFO:teuthology.orchestra.run.smithi133.stdout: osd mclock profile = high_recovery_ops 2023-10-08T16:03:19.868 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.868 INFO:teuthology.orchestra.run.smithi133.stdout: osd recover clone overlap = true 2023-10-08T16:03:19.868 INFO:teuthology.orchestra.run.smithi133.stdout: osd recovery max chunk = 1048576 2023-10-08T16:03:19.868 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.868 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug shutdown = true 2023-10-08T16:03:19.868 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug op order = true 2023-10-08T16:03:19.869 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug verify stray on activate = true 2023-10-08T16:03:19.869 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.869 INFO:teuthology.orchestra.run.smithi133.stdout: osd open classes on start = true 2023-10-08T16:03:19.870 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug pg log writeout = true 2023-10-08T16:03:19.870 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.870 INFO:teuthology.orchestra.run.smithi133.stdout: osd deep scrub update digest min age = 30 2023-10-08T16:03:19.870 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.870 INFO:teuthology.orchestra.run.smithi133.stdout: osd map max advance = 10 2023-10-08T16:03:19.870 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.870 INFO:teuthology.orchestra.run.smithi133.stdout: journal zero on create = true 2023-10-08T16:03:19.870 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.870 INFO:teuthology.orchestra.run.smithi133.stdout: filestore ondisk finisher threads = 3 2023-10-08T16:03:19.870 INFO:teuthology.orchestra.run.smithi133.stdout: filestore apply finisher threads = 3 2023-10-08T16:03:19.870 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.870 INFO:teuthology.orchestra.run.smithi133.stdout: bdev debug aio = true 2023-10-08T16:03:19.871 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug misdirected ops = true 2023-10-08T16:03:19.871 INFO:teuthology.orchestra.run.smithi133.stdout: bdev async discard = True 2023-10-08T16:03:19.871 INFO:teuthology.orchestra.run.smithi133.stdout: bdev enable discard = True 2023-10-08T16:03:19.871 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore allocator = bitmap 2023-10-08T16:03:19.871 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore block size = 96636764160 2023-10-08T16:03:19.871 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore fsck on mount = True 2023-10-08T16:03:19.871 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluefs = 1/20 2023-10-08T16:03:19.871 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluestore = 1/20 2023-10-08T16:03:19.871 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-10-08T16:03:19.871 INFO:teuthology.orchestra.run.smithi133.stdout: debug osd = 20 2023-10-08T16:03:19.871 INFO:teuthology.orchestra.run.smithi133.stdout: debug rocksdb = 4/10 2023-10-08T16:03:19.871 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T16:03:19.872 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd full ratio = 0.9 2023-10-08T16:03:19.872 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd nearfull ratio = 0.8 2023-10-08T16:03:19.872 INFO:teuthology.orchestra.run.smithi133.stdout: osd failsafe full ratio = 0.95 2023-10-08T16:03:19.872 INFO:teuthology.orchestra.run.smithi133.stdout: osd objectstore = bluestore 2023-10-08T16:03:19.872 INFO:teuthology.orchestra.run.smithi133.stdout: osd op complaint time = 180 2023-10-08T16:03:19.872 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.872 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr] 2023-10-08T16:03:19.872 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-10-08T16:03:19.872 INFO:teuthology.orchestra.run.smithi133.stdout: debug mgr = 20 2023-10-08T16:03:19.872 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2023-10-08T16:03:19.872 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2023-10-08T16:03:19.872 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2023-10-08T16:03:19.872 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2023-10-08T16:03:19.873 INFO:teuthology.orchestra.run.smithi133.stdout: mgr/telemetry/nag = false 2023-10-08T16:03:19.873 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.873 INFO:teuthology.orchestra.run.smithi133.stdout:[mon] 2023-10-08T16:03:19.873 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-10-08T16:03:19.873 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2023-10-08T16:03:19.873 INFO:teuthology.orchestra.run.smithi133.stdout: debug paxos = 20 2023-10-08T16:03:19.873 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2023-10-08T16:03:19.873 INFO:teuthology.orchestra.run.smithi133.stdout: mon data avail warn = 5 2023-10-08T16:03:19.873 INFO:teuthology.orchestra.run.smithi133.stdout: mon mgr mkfs grace = 240 2023-10-08T16:03:19.873 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2023-10-08T16:03:19.873 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd reporter subtree level = osd 2023-10-08T16:03:19.873 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd prime pg temp = true 2023-10-08T16:03:19.874 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2023-10-08T16:03:19.874 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.874 INFO:teuthology.orchestra.run.smithi133.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T16:03:19.874 INFO:teuthology.orchestra.run.smithi133.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T16:03:19.874 INFO:teuthology.orchestra.run.smithi133.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T16:03:19.874 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.874 INFO:teuthology.orchestra.run.smithi133.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T16:03:19.874 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T16:03:19.874 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T16:03:19.874 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.874 INFO:teuthology.orchestra.run.smithi133.stdout: # 1m isn't quite enough 2023-10-08T16:03:19.875 INFO:teuthology.orchestra.run.smithi133.stdout: mon_down_mkfs_grace = 2m 2023-10-08T16:03:19.875 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.875 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_filestore_osds = false 2023-10-08T16:03:19.875 INFO:teuthology.orchestra.run.smithi133.stdout: mon op complaint time = 120 2023-10-08T16:03:19.875 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:19.875 INFO:teuthology.orchestra.run.smithi133.stdout:[client] 2023-10-08T16:03:19.875 INFO:teuthology.orchestra.run.smithi133.stdout: rgw cache enabled = true 2023-10-08T16:03:19.875 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable ops log = true 2023-10-08T16:03:19.875 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable usage log = true 2023-10-08T16:03:19.875 INFO:teuthology.orchestra.run.smithi133.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T16:03:19.875 INFO:teuthology.orchestra.run.smithi133.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T16:03:19.875 INFO:teuthology.orchestra.run.smithi133.stdout: client mount timeout = 600 2023-10-08T16:03:19.875 INFO:teuthology.orchestra.run.smithi133.stdout: debug client = 20 2023-10-08T16:03:19.876 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-10-08T16:03:19.876 INFO:teuthology.orchestra.run.smithi133.stdout: pid file = "" 2023-10-08T16:03:19.876 INFO:teuthology.orchestra.run.smithi133.stdout: rados mon op timeout = 900 2023-10-08T16:03:19.876 INFO:teuthology.orchestra.run.smithi133.stdout: rados osd op timeout = 900 2023-10-08T16:03:19.876 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.a] 2023-10-08T16:03:19.876 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.b] 2023-10-08T16:03:19.876 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.c] 2023-10-08T16:03:19.876 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2023-10-08T16:03:19.876 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.b] 2023-10-08T16:03:19.876 INFO:teuthology.orchestra.run.smithi133.stdout:[mds] 2023-10-08T16:03:19.876 INFO:teuthology.orchestra.run.smithi133.stdout: debug mds = 20 2023-10-08T16:03:19.876 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-10-08T16:03:19.877 INFO:teuthology.orchestra.run.smithi133.stdout: mds bal fragment size max = 10000 2023-10-08T16:03:19.877 INFO:teuthology.orchestra.run.smithi133.stdout: mds bal merge size = 5 2023-10-08T16:03:19.877 INFO:teuthology.orchestra.run.smithi133.stdout: mds bal split bits = 3 2023-10-08T16:03:19.877 INFO:teuthology.orchestra.run.smithi133.stdout: mds bal split size = 100 2023-10-08T16:03:19.877 INFO:teuthology.orchestra.run.smithi133.stdout: mds debug frag = True 2023-10-08T16:03:19.877 INFO:teuthology.orchestra.run.smithi133.stdout: mds debug scatterstat = True 2023-10-08T16:03:19.877 INFO:teuthology.orchestra.run.smithi133.stdout: mds op complaint time = 180 2023-10-08T16:03:19.877 INFO:teuthology.orchestra.run.smithi133.stdout: mds verify scatter = True 2023-10-08T16:03:19.877 INFO:teuthology.orchestra.run.smithi133.stdout: osd op complaint time = 180 2023-10-08T16:03:19.877 INFO:teuthology.orchestra.run.smithi133.stdout: rados mon op timeout = 900 2023-10-08T16:03:19.877 INFO:teuthology.orchestra.run.smithi133.stdout: rados osd op timeout = 900 2023-10-08T16:03:19.878 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-08T16:03:19.878 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-08T16:03:19.926 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-08T16:03:19.926 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-08T16:03:19.926 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-08T16:03:19.933 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-08T16:03:19.933 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-08T16:03:19.939 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi133.front.sepia.ceph.com 2023-10-08T16:03:19.939 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-08T16:03:19.940 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T16:03:19.940 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T16:03:19.959 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-08T16:03:19.959 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:03:19.965 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi190.front.sepia.ceph.com 2023-10-08T16:03:19.966 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-08T16:03:19.966 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T16:03:19.966 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T16:03:19.990 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-08T16:03:19.990 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:03:20.036 INFO:tasks.ceph:Setting up mon nodes... 2023-10-08T16:03:20.037 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-08T16:03:20.037 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-08T16:03:20.082 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-08T16:03:20.084 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-08T16:03:20.128 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-08T16:03:20.130 INFO:tasks.ceph:Setting up mds nodes... 2023-10-08T16:03:20.131 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-08T16:03:20.174 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-08T16:03:20.176 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-08T16:03:20.187 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-08T16:03:20.236 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-08T16:03:20.238 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-08T16:03:20.251 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-08T16:03:20.251 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-08T16:03:20.287 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-08T16:03:20.299 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-08T16:03:20.299 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi190.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-08T16:03:20.300 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-08T16:03:20.356 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T16:03:20.356 INFO:tasks.ceph:role: osd.0 2023-10-08T16:03:20.356 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com 2023-10-08T16:03:20.356 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-08T16:03:20.898 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:03:20.899 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:03:20.899 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:03:20.899 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 2023-10-08T16:03:20.899 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:03:20.899 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:03:20.899 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:03:20.899 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:03:20.899 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:03:20.899 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:03:20.901 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-10-08T16:03:20.901 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-08T16:03:20.981 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-08T16:03:20.994 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T16:03:20.994 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:03:20.994 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-08T16:03:21.004 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T16:03:21.004 INFO:tasks.ceph:role: osd.1 2023-10-08T16:03:21.004 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com 2023-10-08T16:03:21.004 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-08T16:03:21.531 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:03:21.531 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:03:21.531 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:03:21.531 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 2023-10-08T16:03:21.531 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:03:21.531 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:03:21.531 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:03:21.531 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:03:21.531 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:03:21.531 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:03:21.532 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-10-08T16:03:21.533 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-08T16:03:21.578 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-08T16:03:21.588 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:03:21.588 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T16:03:21.588 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-08T16:03:21.601 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T16:03:21.602 INFO:tasks.ceph:role: osd.2 2023-10-08T16:03:21.602 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com 2023-10-08T16:03:21.602 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-08T16:03:22.055 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:03:22.055 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:03:22.055 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:03:22.055 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 2023-10-08T16:03:22.055 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:03:22.055 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:03:22.055 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:03:22.055 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:03:22.055 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:03:22.055 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:03:22.057 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-10-08T16:03:22.057 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-08T16:03:22.099 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-08T16:03:22.110 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T16:03:22.111 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:03:22.111 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-08T16:03:22.122 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T16:03:22.122 INFO:tasks.ceph:role: osd.3 2023-10-08T16:03:22.122 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi133.front.sepia.ceph.com 2023-10-08T16:03:22.122 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-08T16:03:22.640 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:03:22.641 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:03:22.641 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:03:22.641 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 2023-10-08T16:03:22.641 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:03:22.641 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:03:22.641 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:03:22.641 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:03:22.641 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:03:22.641 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:03:22.642 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-10-08T16:03:22.643 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-08T16:03:22.705 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-08T16:03:22.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:03:22.717 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T16:03:22.718 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:03:22.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:22.836+0000 7f46a93843c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-08T16:03:22.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:22.840+0000 7f46a93843c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-08T16:03:22.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:22.840+0000 7f46a93843c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T16:03:22.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:22.840+0000 7f46a93843c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T16:03:22.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:22.840+0000 7f46a93843c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T16:03:22.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:22.848+0000 7f46a93843c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-08T16:03:23.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:23.660+0000 7f46a93843c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:03:24.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:24.460+0000 7f46a93843c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:03:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:25.260+0000 7f46a93843c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:03:26.131 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-08T16:03:26.143 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:03:26.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:26.176+0000 7f7f6e5683c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-08T16:03:26.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:26.176+0000 7f7f6e5683c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-08T16:03:26.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:26.176+0000 7f7f6e5683c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T16:03:26.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:26.176+0000 7f7f6e5683c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T16:03:26.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:26.176+0000 7f7f6e5683c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T16:03:26.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:26.176+0000 7f7f6e5683c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-08T16:03:26.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:26.740+0000 7f7f6e5683c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:03:27.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:27.524+0000 7f7f6e5683c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:03:28.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:28.300+0000 7f7f6e5683c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:03:29.182 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-08T16:03:29.199 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:03:29.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:29.232+0000 7fbbd7f963c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-08T16:03:29.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:29.232+0000 7fbbd7f963c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-08T16:03:29.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:29.232+0000 7fbbd7f963c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T16:03:29.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:29.232+0000 7fbbd7f963c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T16:03:29.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:29.232+0000 7fbbd7f963c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T16:03:29.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:29.232+0000 7fbbd7f963c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-08T16:03:29.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:29.792+0000 7fbbd7f963c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:03:30.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:30.576+0000 7fbbd7f963c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:03:31.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:31.380+0000 7fbbd7f963c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:03:32.257 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-08T16:03:32.273 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:03:32.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:32.356+0000 7f01d29143c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-08T16:03:32.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:32.356+0000 7f01d29143c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-08T16:03:32.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:32.356+0000 7f01d29143c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-08T16:03:32.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:32.356+0000 7f01d29143c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-08T16:03:32.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:32.356+0000 7f01d29143c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-08T16:03:32.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:32.356+0000 7f01d29143c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-08T16:03:32.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:32.912+0000 7f01d29143c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:03:33.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:33.704+0000 7f01d29143c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:03:34.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:34.488+0000 7f01d29143c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:03:35.345 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-08T16:03:35.361 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-08T16:03:35.378 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T16:03:35.378 INFO:tasks.ceph:role: osd.4 2023-10-08T16:03:35.379 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi190.front.sepia.ceph.com 2023-10-08T16:03:35.379 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-08T16:03:35.909 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:03:35.910 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:03:35.910 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:03:35.910 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 2023-10-08T16:03:35.910 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:03:35.910 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:03:35.910 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:03:35.910 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:03:35.910 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:03:35.910 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:03:35.911 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2023-10-08T16:03:35.912 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-08T16:03:36.014 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-08T16:03:36.026 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T16:03:36.026 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:03:36.027 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-08T16:03:36.040 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T16:03:36.040 INFO:tasks.ceph:role: osd.5 2023-10-08T16:03:36.040 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi190.front.sepia.ceph.com 2023-10-08T16:03:36.041 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-08T16:03:36.564 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:03:36.564 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:03:36.564 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:03:36.565 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 2023-10-08T16:03:36.565 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:03:36.565 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:03:36.565 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:03:36.565 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:03:36.565 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:03:36.565 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:03:36.567 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2023-10-08T16:03:36.567 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-08T16:03:36.608 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-08T16:03:36.663 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T16:03:36.664 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:03:36.664 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-08T16:03:36.674 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T16:03:36.674 INFO:tasks.ceph:role: osd.6 2023-10-08T16:03:36.674 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi190.front.sepia.ceph.com 2023-10-08T16:03:36.675 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-08T16:03:37.152 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:03:37.152 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:03:37.152 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:03:37.152 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 2023-10-08T16:03:37.152 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:03:37.152 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:03:37.152 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:03:37.153 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:03:37.153 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:03:37.153 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:03:37.154 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2023-10-08T16:03:37.154 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-08T16:03:37.201 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-08T16:03:37.210 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T16:03:37.211 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:03:37.211 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-08T16:03:37.221 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T16:03:37.221 INFO:tasks.ceph:role: osd.7 2023-10-08T16:03:37.221 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi190.front.sepia.ceph.com 2023-10-08T16:03:37.221 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-08T16:03:37.746 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:03:37.747 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:03:37.747 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:03:37.747 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 2023-10-08T16:03:37.747 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:03:37.747 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:03:37.747 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:03:37.747 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:03:37.747 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:03:37.747 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:03:37.748 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2023-10-08T16:03:37.748 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-08T16:03:37.811 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-08T16:03:37.820 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:03:37.821 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T16:03:37.821 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:03:37.941 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:37.935+0000 7f80242d73c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-08T16:03:37.942 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:37.935+0000 7f80242d73c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-08T16:03:37.942 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:37.935+0000 7f80242d73c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-08T16:03:37.942 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:37.935+0000 7f80242d73c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-08T16:03:37.942 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:37.935+0000 7f80242d73c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-08T16:03:37.949 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:37.943+0000 7f80242d73c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-08T16:03:38.753 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:38.747+0000 7f80242d73c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:03:39.534 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:39.527+0000 7f80242d73c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:03:40.319 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:40.311+0000 7f80242d73c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:03:41.202 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-08T16:03:41.214 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:03:41.253 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:41.247+0000 7f1d6d1ae3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-08T16:03:41.254 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:41.247+0000 7f1d6d1ae3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-08T16:03:41.254 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:41.247+0000 7f1d6d1ae3c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-08T16:03:41.254 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:41.247+0000 7f1d6d1ae3c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-08T16:03:41.254 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:41.247+0000 7f1d6d1ae3c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-08T16:03:41.254 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:41.247+0000 7f1d6d1ae3c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-08T16:03:41.817 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:41.811+0000 7f1d6d1ae3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:03:42.596 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:42.591+0000 7f1d6d1ae3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:03:43.390 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:43.383+0000 7f1d6d1ae3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:03:44.252 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-08T16:03:44.266 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:03:44.303 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:44.295+0000 7f5b3fb9f3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-08T16:03:44.303 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:44.295+0000 7f5b3fb9f3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-08T16:03:44.303 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:44.295+0000 7f5b3fb9f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-08T16:03:44.303 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:44.295+0000 7f5b3fb9f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-08T16:03:44.303 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:44.295+0000 7f5b3fb9f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-08T16:03:44.304 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:44.299+0000 7f5b3fb9f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-08T16:03:44.871 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:44.863+0000 7f5b3fb9f3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:03:45.658 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:45.651+0000 7f5b3fb9f3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:03:46.435 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:46.427+0000 7f5b3fb9f3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:03:47.287 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-08T16:03:47.738 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:03:47.822 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:47.815+0000 7f6b7c4233c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-08T16:03:47.823 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:47.815+0000 7f6b7c4233c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-08T16:03:47.823 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:47.815+0000 7f6b7c4233c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-08T16:03:47.823 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:47.815+0000 7f6b7c4233c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-08T16:03:47.823 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:47.815+0000 7f6b7c4233c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-08T16:03:47.824 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:47.819+0000 7f6b7c4233c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-08T16:03:48.391 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:48.383+0000 7f6b7c4233c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:03:48.987 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:03:48.989 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:03:49.204 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:49.199+0000 7f6b7c4233c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:03:49.979 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:49.971+0000 7f6b7c4233c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:03:50.859 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-08T16:03:50.876 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-08T16:03:50.877 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-08T16:03:50.877 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-08T16:03:50.893 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-08T16:03:50.893 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-08T16:03:50.951 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-08T16:03:50.952 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-08T16:03:50.963 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-08T16:03:50.963 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-08T16:03:50.976 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-08T16:03:50.977 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-08T16:03:51.036 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-08T16:03:51.036 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-08T16:03:51.047 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-08T16:03:51.047 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-08T16:03:51.063 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-08T16:03:51.063 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-08T16:03:51.074 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-08T16:03:51.074 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-08T16:03:51.085 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-08T16:03:51.085 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-08T16:03:51.143 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-08T16:03:51.143 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-08T16:03:51.154 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-08T16:03:51.154 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-08T16:03:51.166 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-08T16:03:51.166 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-08T16:03:51.173 INFO:tasks.ceph:Adding keys to all mons... 2023-10-08T16:03:51.173 DEBUG:teuthology.orchestra.run.smithi133:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-08T16:03:51.218 DEBUG:teuthology.orchestra.run.smithi190:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-08T16:03:51.230 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.y] 2023-10-08T16:03:51.230 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDI0iJlH+rrBBAAoNzz7R8OalfiEv27KmALRw== 2023-10-08T16:03:51.231 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2023-10-08T16:03:51.231 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDI0iJlf2VsChAANQLF6QMp5QT7ntkMbiEObg== 2023-10-08T16:03:51.231 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.0] 2023-10-08T16:03:51.231 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDK0iJl/mEPMhAAORmwVt2zRFew7VYHI86UXw== 2023-10-08T16:03:51.231 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.1] 2023-10-08T16:03:51.231 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDO0iJls7q6ChAA+BEYvoUyxQYfKeFzI5NXEQ== 2023-10-08T16:03:51.231 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.2] 2023-10-08T16:03:51.231 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDR0iJlJa4SDhAAZAlEfA/IOxJFnbX4to1V7Q== 2023-10-08T16:03:51.231 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.3] 2023-10-08T16:03:51.231 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDU0iJlGwxZFRAAgj/kW0RMLz2H1K+FK/qzBA== 2023-10-08T16:03:51.231 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.x] 2023-10-08T16:03:51.231 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDI0iJlklyYBxAA1vzr32F6Kig/2MxhTJQKdw== 2023-10-08T16:03:51.232 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.b] 2023-10-08T16:03:51.232 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDI0iJlheIFDhAAeMcNtNaDlsPRVsLa32jSGA== 2023-10-08T16:03:51.232 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.4] 2023-10-08T16:03:51.232 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDZ0iJlYl0IOBAACsgk9QLxWH1JulKKjF8ptw== 2023-10-08T16:03:51.232 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.5] 2023-10-08T16:03:51.232 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDd0iJlhWgIDxAAI/zFS3Z0P4+TaPUnIwbFUQ== 2023-10-08T16:03:51.232 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.6] 2023-10-08T16:03:51.232 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDg0iJltYkAEhAAcZpGkvAkOUTaSRhEx42lfA== 2023-10-08T16:03:51.232 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.7] 2023-10-08T16:03:51.232 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDj0iJlNuL7MBAA8so4PAnSFrPlwpRtXYOhnw== 2023-10-08T16:03:51.232 INFO:teuthology.orchestra.run.smithi133.stdout:[client.0] 2023-10-08T16:03:51.232 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDI0iJlOxsnERAAxC3H72s48wMV+yE2UJxw6A== 2023-10-08T16:03:51.233 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr.y] 2023-10-08T16:03:51.234 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDI0iJlH+rrBBAAoNzz7R8OalfiEv27KmALRw== 2023-10-08T16:03:51.234 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.a] 2023-10-08T16:03:51.234 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDI0iJlf2VsChAANQLF6QMp5QT7ntkMbiEObg== 2023-10-08T16:03:51.234 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.0] 2023-10-08T16:03:51.234 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDK0iJl/mEPMhAAORmwVt2zRFew7VYHI86UXw== 2023-10-08T16:03:51.234 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.1] 2023-10-08T16:03:51.234 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDO0iJls7q6ChAA+BEYvoUyxQYfKeFzI5NXEQ== 2023-10-08T16:03:51.234 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.2] 2023-10-08T16:03:51.234 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDR0iJlJa4SDhAAZAlEfA/IOxJFnbX4to1V7Q== 2023-10-08T16:03:51.234 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.3] 2023-10-08T16:03:51.235 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDU0iJlGwxZFRAAgj/kW0RMLz2H1K+FK/qzBA== 2023-10-08T16:03:51.235 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr.x] 2023-10-08T16:03:51.235 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDI0iJlklyYBxAA1vzr32F6Kig/2MxhTJQKdw== 2023-10-08T16:03:51.235 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.b] 2023-10-08T16:03:51.235 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDI0iJlheIFDhAAeMcNtNaDlsPRVsLa32jSGA== 2023-10-08T16:03:51.235 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.4] 2023-10-08T16:03:51.235 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDZ0iJlYl0IOBAACsgk9QLxWH1JulKKjF8ptw== 2023-10-08T16:03:51.235 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.5] 2023-10-08T16:03:51.235 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDd0iJlhWgIDxAAI/zFS3Z0P4+TaPUnIwbFUQ== 2023-10-08T16:03:51.235 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.6] 2023-10-08T16:03:51.235 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDg0iJltYkAEhAAcZpGkvAkOUTaSRhEx42lfA== 2023-10-08T16:03:51.236 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.7] 2023-10-08T16:03:51.236 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDj0iJlNuL7MBAA8so4PAnSFrPlwpRtXYOhnw== 2023-10-08T16:03:51.236 INFO:teuthology.orchestra.run.smithi190.stdout:[client.0] 2023-10-08T16:03:51.236 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDI0iJlOxsnERAAxC3H72s48wMV+yE2UJxw6A== 2023-10-08T16:03:51.237 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T16:03:51.239 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T16:03:51.283 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:03:51.285 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:03:51.333 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:03:51.335 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:03:51.378 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:03:51.380 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:03:51.423 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:03:51.466 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:03:51.516 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:03:51.518 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:03:51.561 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T16:03:51.563 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T16:03:51.606 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:03:51.609 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:03:51.690 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:03:51.693 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:03:51.735 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:03:51.778 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:03:51.821 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:03:51.823 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:03:51.906 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:03:51.908 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:03:51.951 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T16:03:51.953 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T16:03:52.039 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-08T16:03:52.039 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-08T16:03:52.055 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T16:03:52.156 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-08T16:03:52.170 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-08T16:03:52.186 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T16:03:52.287 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-08T16:03:52.301 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-08T16:03:52.315 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T16:03:52.420 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-08T16:03:52.433 DEBUG:teuthology.orchestra.run.smithi133:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:03:52.436 DEBUG:teuthology.orchestra.run.smithi190:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:03:52.440 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-08T16:03:52.441 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-08T16:03:52.441 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-08T16:03:52.482 INFO:tasks.ceph.mon.a:Started 2023-10-08T16:03:52.482 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-08T16:03:52.482 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-08T16:03:52.484 INFO:tasks.ceph.mon.b:Started 2023-10-08T16:03:52.485 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-08T16:03:52.485 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-08T16:03:52.487 INFO:tasks.ceph.mon.c:Started 2023-10-08T16:03:52.487 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-08T16:03:52.487 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-08T16:03:52.487 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-08T16:03:52.489 INFO:tasks.ceph.mgr.y:Started 2023-10-08T16:03:52.490 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-08T16:03:52.490 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-08T16:03:52.492 INFO:tasks.ceph.mgr.x:Started 2023-10-08T16:03:52.492 INFO:tasks.ceph:Setting crush tunables to default 2023-10-08T16:03:52.492 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd crush tunables default 2023-10-08T16:03:52.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.596+0000 7fb66bd53700 1 Processor -- start 2023-10-08T16:03:52.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.596+0000 7fb66bd53700 1 -- start start 2023-10-08T16:03:52.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.596+0000 7fb66bd53700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6640ae3c0 0x7fb6640af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:52.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.596+0000 7fb66bd53700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb664143ad0 0x7fb664143f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:52.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.596+0000 7fb66bd53700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb66406e180 0x7fb66406e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:52.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.596+0000 7fb66bd53700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6640aff20 con 0x7fb6640ae3c0 2023-10-08T16:03:52.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.596+0000 7fb66bd53700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6640b0cc0 con 0x7fb664143ad0 2023-10-08T16:03:52.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.596+0000 7fb66bd53700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb664144460 con 0x7fb66406e180 2023-10-08T16:03:52.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.596+0000 7fb669aef700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6640ae3c0 0x7fb6640af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:52.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.596+0000 7fb66a2f0700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb66406e180 0x7fb66406e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:52.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.596+0000 7fb669aef700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6640ae3c0 0x7fb6640af9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35158/0 (socket says 172.21.15.133:35158) 2023-10-08T16:03:52.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.596+0000 7fb669aef700 1 -- 172.21.15.133:0/1201446797 learned_addr learned my addr 172.21.15.133:0/1201446797 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:03:52.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.596+0000 7fb6692ee700 1 --2- 172.21.15.133:0/1201446797 >> v2:172.21.15.190:3300/0 conn(0x7fb664143ad0 0x7fb664143f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:52.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.596+0000 7fb669aef700 1 -- 172.21.15.133:0/1201446797 >> v2:172.21.15.133:3300/0 conn(0x7fb6640ae3c0 msgr2=0x7fb6640af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-08T16:03:52.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.596+0000 7fb669aef700 1 -- 172.21.15.133:0/1201446797 >> v2:172.21.15.133:3300/0 conn(0x7fb6640ae3c0 msgr2=0x7fb6640af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T16:03:52.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.596+0000 7fb6692ee700 1 -- 172.21.15.133:0/1201446797 >> v2:172.21.15.190:3300/0 conn(0x7fb664143ad0 msgr2=0x7fb664143f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-08T16:03:52.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.596+0000 7fb6692ee700 1 -- 172.21.15.133:0/1201446797 >> v2:172.21.15.190:3300/0 conn(0x7fb664143ad0 msgr2=0x7fb664143f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T16:03:52.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.596+0000 7fb6692ee700 1 --2- 172.21.15.133:0/1201446797 >> v2:172.21.15.190:3300/0 conn(0x7fb664143ad0 0x7fb664143f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T16:03:52.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.596+0000 7fb669aef700 1 --2- 172.21.15.133:0/1201446797 >> v2:172.21.15.133:3300/0 conn(0x7fb6640ae3c0 0x7fb6640af9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T16:03:52.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.596+0000 7fb66a2f0700 1 -- 172.21.15.133:0/1201446797 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb66406e180 msgr2=0x7fb66406e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-08T16:03:52.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.596+0000 7fb66a2f0700 1 -- 172.21.15.133:0/1201446797 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb66406e180 msgr2=0x7fb66406e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T16:03:52.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.596+0000 7fb6692ee700 1 --2- 172.21.15.133:0/1201446797 >> v2:172.21.15.190:3300/0 conn(0x7fb664143ad0 0x7fb664143f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:03:52.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.596+0000 7fb66a2f0700 1 --2- 172.21.15.133:0/1201446797 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb66406e180 0x7fb66406e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T16:03:52.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.596+0000 7fb66a2f0700 1 --2- 172.21.15.133:0/1201446797 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb66406e180 0x7fb66406e600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:03:52.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.596+0000 7fb669aef700 1 --2- 172.21.15.133:0/1201446797 >> v2:172.21.15.133:3300/0 conn(0x7fb6640ae3c0 0x7fb6640af9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:03:52.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.800+0000 7fb669aef700 1 --2- 172.21.15.133:0/1201446797 >> v2:172.21.15.133:3300/0 conn(0x7fb6640ae3c0 0x7fb6640af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:52.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.800+0000 7fb66a2f0700 1 --2- 172.21.15.133:0/1201446797 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb66406e180 0x7fb66406e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:52.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.800+0000 7fb6692ee700 1 --2- 172.21.15.133:0/1201446797 >> v2:172.21.15.190:3300/0 conn(0x7fb664143ad0 0x7fb664143f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.800+0000 7fb66a2f0700 1 -- 172.21.15.133:0/1201446797 >> v2:172.21.15.190:3300/0 conn(0x7fb664143ad0 msgr2=0x7fb664143f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:03:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.800+0000 7fb66a2f0700 1 --2- 172.21.15.133:0/1201446797 >> v2:172.21.15.190:3300/0 conn(0x7fb664143ad0 0x7fb664143f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.800+0000 7fb66a2f0700 1 -- 172.21.15.133:0/1201446797 >> v2:172.21.15.133:3300/0 conn(0x7fb6640ae3c0 msgr2=0x7fb6640af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:03:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.800+0000 7fb66a2f0700 1 --2- 172.21.15.133:0/1201446797 >> v2:172.21.15.133:3300/0 conn(0x7fb6640ae3c0 0x7fb6640af9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.800+0000 7fb66a2f0700 1 -- 172.21.15.133:0/1201446797 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6640b0670 con 0x7fb66406e180 2023-10-08T16:03:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.800+0000 7fb6692ee700 1 --2- 172.21.15.133:0/1201446797 >> v2:172.21.15.190:3300/0 conn(0x7fb664143ad0 0x7fb664143f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:03:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.800+0000 7fb669aef700 1 --2- 172.21.15.133:0/1201446797 >> v2:172.21.15.133:3300/0 conn(0x7fb6640ae3c0 0x7fb6640af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:03:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.800+0000 7fb66a2f0700 1 --2- 172.21.15.133:0/1201446797 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb66406e180 0x7fb66406e600 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb66406f270 tx=0x7fb654008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbc90c1ea9542bc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:03:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.800+0000 7fb668aed700 1 -- 172.21.15.133:0/1201446797 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6540125f0 con 0x7fb66406e180 2023-10-08T16:03:52.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.800+0000 7fb668aed700 1 -- 172.21.15.133:0/1201446797 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb654012750 con 0x7fb66406e180 2023-10-08T16:03:52.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.800+0000 7fb668aed700 1 -- 172.21.15.133:0/1201446797 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb654012af0 con 0x7fb66406e180 2023-10-08T16:03:52.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.800+0000 7fb66bd53700 1 -- 172.21.15.133:0/1201446797 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb66406e180 msgr2=0x7fb66406e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:52.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.800+0000 7fb66bd53700 1 --2- 172.21.15.133:0/1201446797 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb66406e180 0x7fb66406e600 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb66406f270 tx=0x7fb654008040 comp rx=0 tx=0).stop 2023-10-08T16:03:52.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.800+0000 7fb66bd53700 1 -- 172.21.15.133:0/1201446797 shutdown_connections 2023-10-08T16:03:52.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.800+0000 7fb66bd53700 1 --2- 172.21.15.133:0/1201446797 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb66406e180 0x7fb66406e600 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:52.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.800+0000 7fb66bd53700 1 --2- 172.21.15.133:0/1201446797 >> v2:172.21.15.190:3300/0 conn(0x7fb664143ad0 0x7fb664143f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:52.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.800+0000 7fb66bd53700 1 --2- 172.21.15.133:0/1201446797 >> v2:172.21.15.133:3300/0 conn(0x7fb6640ae3c0 0x7fb6640af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:52.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.800+0000 7fb66bd53700 1 -- 172.21.15.133:0/1201446797 >> 172.21.15.133:0/1201446797 conn(0x7fb6640b4ba0 msgr2=0x7fb6640b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:03:52.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.800+0000 7fb66bd53700 1 -- 172.21.15.133:0/1201446797 shutdown_connections 2023-10-08T16:03:52.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.800+0000 7fb66bd53700 1 -- 172.21.15.133:0/1201446797 wait complete. 2023-10-08T16:03:52.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.804+0000 7fb66bd53700 1 Processor -- start 2023-10-08T16:03:52.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.804+0000 7fb66bd53700 1 -- start start 2023-10-08T16:03:52.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.808+0000 7fb66bd53700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb66406e180 0x7fb6640b4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:52.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.808+0000 7fb66bd53700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6640ae3c0 0x7fb6640ad690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:52.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.808+0000 7fb66bd53700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb664143ad0 0x7fb6640adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:52.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.808+0000 7fb66bd53700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6640b3a20 con 0x7fb6640ae3c0 2023-10-08T16:03:52.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.808+0000 7fb66bd53700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6640b37b0 con 0x7fb66406e180 2023-10-08T16:03:52.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.808+0000 7fb66bd53700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb664152200 con 0x7fb664143ad0 2023-10-08T16:03:52.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.808+0000 7fb6692ee700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6640ae3c0 0x7fb6640ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:52.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.808+0000 7fb669aef700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb66406e180 0x7fb6640b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:52.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.808+0000 7fb6692ee700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6640ae3c0 0x7fb6640ad690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35192/0 (socket says 172.21.15.133:35192) 2023-10-08T16:03:52.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.808+0000 7fb6692ee700 1 -- 172.21.15.133:0/841320443 learned_addr learned my addr 172.21.15.133:0/841320443 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:03:52.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.808+0000 7fb66a2f0700 1 --2- 172.21.15.133:0/841320443 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb664143ad0 0x7fb6640adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:52.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.808+0000 7fb6692ee700 1 -- 172.21.15.133:0/841320443 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb664143ad0 msgr2=0x7fb6640adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:52.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.808+0000 7fb6692ee700 1 --2- 172.21.15.133:0/841320443 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb664143ad0 0x7fb6640adbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:52.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.808+0000 7fb6692ee700 1 -- 172.21.15.133:0/841320443 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb66406e180 msgr2=0x7fb6640b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:52.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.808+0000 7fb6692ee700 1 --2- 172.21.15.133:0/841320443 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb66406e180 0x7fb6640b4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:52.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.808+0000 7fb6692ee700 1 -- 172.21.15.133:0/841320443 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb660009570 con 0x7fb6640ae3c0 2023-10-08T16:03:52.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.808+0000 7fb6692ee700 1 --2- 172.21.15.133:0/841320443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6640ae3c0 0x7fb6640ad690 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb65c0029b0 tx=0x7fb65c0097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:03:52.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.808+0000 7fb659ffb700 1 -- 172.21.15.133:0/841320443 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c00f670 con 0x7fb6640ae3c0 2023-10-08T16:03:52.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.808+0000 7fb659ffb700 1 -- 172.21.15.133:0/841320443 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65c00f7d0 con 0x7fb6640ae3c0 2023-10-08T16:03:52.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.808+0000 7fb66bd53700 1 -- 172.21.15.133:0/841320443 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb65c009a80 con 0x7fb6640ae3c0 2023-10-08T16:03:52.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.808+0000 7fb659ffb700 1 -- 172.21.15.133:0/841320443 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c00fb50 con 0x7fb6640ae3c0 2023-10-08T16:03:52.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.808+0000 7fb66bd53700 1 -- 172.21.15.133:0/841320443 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb65400e040 con 0x7fb6640ae3c0 2023-10-08T16:03:52.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.808+0000 7fb66bd53700 1 -- 172.21.15.133:0/841320443 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb664064810 con 0x7fb6640ae3c0 2023-10-08T16:03:52.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.808+0000 7fb659ffb700 1 -- 172.21.15.133:0/841320443 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb65c003040 con 0x7fb6640ae3c0 2023-10-08T16:03:52.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.808+0000 7fb659ffb700 1 -- 172.21.15.133:0/841320443 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb65c01de20 con 0x7fb6640ae3c0 2023-10-08T16:03:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.812+0000 7fb659ffb700 1 -- 172.21.15.133:0/841320443 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fb65c01d410 con 0x7fb6640ae3c0 2023-10-08T16:03:52.843 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-10-08T16:03:52.839+0000 7fa4caaa4000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:03:52.846 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-10-08T16:03:52.844+0000 7f447afd7000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:03:52.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.884+0000 7fb66bd53700 1 -- 172.21.15.133:0/841320443 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fb6640a9920 con 0x7fb6640ae3c0 2023-10-08T16:03:52.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.892+0000 7fb659ffb700 1 -- 172.21.15.133:0/841320443 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb65c0144f0 con 0x7fb6640ae3c0 2023-10-08T16:03:52.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.892+0000 7fb66bd53700 1 -- 172.21.15.133:0/841320443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6640ae3c0 msgr2=0x7fb6640ad690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:52.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.892+0000 7fb66bd53700 1 --2- 172.21.15.133:0/841320443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6640ae3c0 0x7fb6640ad690 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb65c0029b0 tx=0x7fb65c0097c0 comp rx=0 tx=0).stop 2023-10-08T16:03:52.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.892+0000 7fb66bd53700 1 -- 172.21.15.133:0/841320443 shutdown_connections 2023-10-08T16:03:52.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.892+0000 7fb66bd53700 1 --2- 172.21.15.133:0/841320443 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb664143ad0 0x7fb6640adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:52.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.892+0000 7fb66bd53700 1 --2- 172.21.15.133:0/841320443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6640ae3c0 0x7fb6640ad690 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:52.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.892+0000 7fb66bd53700 1 --2- 172.21.15.133:0/841320443 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb66406e180 0x7fb6640b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:52.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.892+0000 7fb66bd53700 1 -- 172.21.15.133:0/841320443 >> 172.21.15.133:0/841320443 conn(0x7fb6640b4ba0 msgr2=0x7fb66406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:03:52.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.892+0000 7fb66bd53700 1 -- 172.21.15.133:0/841320443 shutdown_connections 2023-10-08T16:03:52.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:52.892+0000 7fb66bd53700 1 -- 172.21.15.133:0/841320443 wait complete. 2023-10-08T16:03:52.896 INFO:teuthology.orchestra.run.smithi133.stderr:adjusted tunables profile to default 2023-10-08T16:03:52.906 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-08T16:03:52.906 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-08T16:03:52.906 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-08T16:03:52.920 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-08T16:03:52.920 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-08T16:03:52.931 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-08T16:03:52.931 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-08T16:03:52.942 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-08T16:03:52.942 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-08T16:03:53.000 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-08T16:03:53.000 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-08T16:03:53.017 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-08T16:03:53.017 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-08T16:03:53.075 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-08T16:03:53.075 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-08T16:03:53.090 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-08T16:03:53.090 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-08T16:03:53.098 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 8c5deadf-a203-4d30-aa7f-6e2e492b6ffc 0 2023-10-08T16:03:53.246 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.239+0000 7fb8b5149700 1 Processor -- start 2023-10-08T16:03:53.246 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.239+0000 7fb8b5149700 1 -- start start 2023-10-08T16:03:53.246 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.239+0000 7fb8b5149700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb8b0139aa0 0x7fb8b0139f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:53.246 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.239+0000 7fb8b5149700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8b013a440 0x7fb8b014aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:53.246 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.239+0000 7fb8b5149700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b0140dc0 con 0x7fb8b006a0d0 2023-10-08T16:03:53.246 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.239+0000 7fb8b5149700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b0141250 con 0x7fb8b0139aa0 2023-10-08T16:03:53.247 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.239+0000 7fb8b5149700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00b2d50 con 0x7fb8b013a440 2023-10-08T16:03:53.247 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.239+0000 7fb8af7fe700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb8b0139aa0 0x7fb8b0139f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:53.247 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.239+0000 7fb8affff700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fb8b006a0d0 0x7fb8b006cfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53314/0 (socket says 172.21.15.190:53314) 2023-10-08T16:03:53.247 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.239+0000 7fb8affff700 1 -- 172.21.15.190:0/2809413266 learned_addr learned my addr 172.21.15.190:0/2809413266 (peer_addr_for_me v1:172.21.15.190:0/0) 2023-10-08T16:03:53.247 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.239+0000 7fb8b4948700 1 --2- 172.21.15.190:0/2809413266 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8b013a440 0x7fb8b014aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:53.248 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.239+0000 7fb8b4948700 1 -- 172.21.15.190:0/2809413266 >> v2:172.21.15.190:3300/0 conn(0x7fb8b0139aa0 msgr2=0x7fb8b0139f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:03:53.249 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.239+0000 7fb8b4948700 1 --2- 172.21.15.190:0/2809413266 >> v2:172.21.15.190:3300/0 conn(0x7fb8b0139aa0 0x7fb8b0139f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.249 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.239+0000 7fb8b4948700 1 -- 172.21.15.190:0/2809413266 >> v1:172.21.15.190:6789/0 conn(0x7fb8b006a0d0 legacy=0x7fb8b006cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:53.249 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.239+0000 7fb8aeffd700 1 -- 172.21.15.190:0/2809413266 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1662553906 0 0) 0x7fb8b0140dc0 con 0x7fb8b006a0d0 2023-10-08T16:03:53.249 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.239+0000 7fb8b4948700 1 -- 172.21.15.190:0/2809413266 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b0140770 con 0x7fb8b013a440 2023-10-08T16:03:53.249 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.239+0000 7fb8af7fe700 1 --2- 172.21.15.190:0/2809413266 >> v2:172.21.15.190:3300/0 conn(0x7fb8b0139aa0 0x7fb8b0139f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:03:53.249 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.239+0000 7fb8b4948700 1 --2- 172.21.15.190:0/2809413266 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8b013a440 0x7fb8b014aed0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009e60 tx=0x7fb8a8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2765cfaa7cedac0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:03:53.249 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.239+0000 7fb8aeffd700 1 -- 172.21.15.190:0/2809413266 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a800e070 con 0x7fb8b013a440 2023-10-08T16:03:53.249 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.239+0000 7fb8aeffd700 1 -- 172.21.15.190:0/2809413266 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a800bb60 con 0x7fb8b013a440 2023-10-08T16:03:53.249 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.239+0000 7fb8aeffd700 1 -- 172.21.15.190:0/2809413266 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8012430 con 0x7fb8b013a440 2023-10-08T16:03:53.249 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b5149700 1 -- 172.21.15.190:0/2809413266 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8b013a440 msgr2=0x7fb8b014aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:53.250 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b5149700 1 --2- 172.21.15.190:0/2809413266 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8b013a440 0x7fb8b014aed0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009e60 tx=0x7fb8a8009780 comp rx=0 tx=0).stop 2023-10-08T16:03:53.250 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b5149700 1 -- 172.21.15.190:0/2809413266 shutdown_connections 2023-10-08T16:03:53.250 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b5149700 1 --2- 172.21.15.190:0/2809413266 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8b013a440 0x7fb8b014aed0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.250 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b5149700 1 --2- 172.21.15.190:0/2809413266 >> v2:172.21.15.190:3300/0 conn(0x7fb8b0139aa0 0x7fb8b0139f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.250 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b5149700 1 -- 172.21.15.190:0/2809413266 >> 172.21.15.190:0/2809413266 conn(0x7fb8b00b6ba0 msgr2=0x7fb8b00b6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:03:53.250 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b5149700 1 -- 172.21.15.190:0/2809413266 shutdown_connections 2023-10-08T16:03:53.250 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b5149700 1 -- 172.21.15.190:0/2809413266 wait complete. 2023-10-08T16:03:53.250 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b5149700 1 Processor -- start 2023-10-08T16:03:53.250 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b5149700 1 -- start start 2023-10-08T16:03:53.253 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b5149700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8b006a0d0 0x7fb8b01439f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:53.253 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b5149700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8b0139aa0 0x7fb8b00ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:53.253 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b5149700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8b013a440 0x7fb8b01528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:53.253 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b5149700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b0143f30 con 0x7fb8b006a0d0 2023-10-08T16:03:53.253 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b5149700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00add80 con 0x7fb8b013a440 2023-10-08T16:03:53.253 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b5149700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b013c1f0 con 0x7fb8b0139aa0 2023-10-08T16:03:53.253 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b4948700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8b013a440 0x7fb8b01528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:53.253 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b4948700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8b013a440 0x7fb8b01528c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:44944/0 (socket says 172.21.15.190:44944) 2023-10-08T16:03:53.253 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b4948700 1 -- 172.21.15.190:0/3652549194 learned_addr learned my addr 172.21.15.190:0/3652549194 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-10-08T16:03:53.253 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8af7fe700 1 --2- 172.21.15.190:0/3652549194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8b0139aa0 0x7fb8b00ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:53.253 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8affff700 1 --2- 172.21.15.190:0/3652549194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8b006a0d0 0x7fb8b01439f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:53.254 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b4948700 1 -- 172.21.15.190:0/3652549194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8b0139aa0 msgr2=0x7fb8b00ae210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:53.254 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b4948700 1 --2- 172.21.15.190:0/3652549194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8b0139aa0 0x7fb8b00ae210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.254 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b4948700 1 -- 172.21.15.190:0/3652549194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8b006a0d0 msgr2=0x7fb8b01439f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:53.254 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b4948700 1 --2- 172.21.15.190:0/3652549194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8b006a0d0 0x7fb8b01439f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.254 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b4948700 1 -- 172.21.15.190:0/3652549194 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a4009420 con 0x7fb8b013a440 2023-10-08T16:03:53.254 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8af7fe700 1 --2- 172.21.15.190:0/3652549194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8b0139aa0 0x7fb8b00ae210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:03:53.254 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b4948700 1 --2- 172.21.15.190:0/3652549194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8b013a440 0x7fb8b01528c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8012ad0 tx=0x7fb8a8019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:03:53.254 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb897fff700 1 -- 172.21.15.190:0/3652549194 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8027470 con 0x7fb8b013a440 2023-10-08T16:03:53.254 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb897fff700 1 -- 172.21.15.190:0/3652549194 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a8027610 con 0x7fb8b013a440 2023-10-08T16:03:53.255 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb897fff700 1 -- 172.21.15.190:0/3652549194 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a80279d0 con 0x7fb8b013a440 2023-10-08T16:03:53.255 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b5149700 1 -- 172.21.15.190:0/3652549194 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a8009a20 con 0x7fb8b013a440 2023-10-08T16:03:53.255 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb8b5149700 1 -- 172.21.15.190:0/3652549194 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b013add0 con 0x7fb8b013a440 2023-10-08T16:03:53.255 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb897fff700 1 -- 172.21.15.190:0/3652549194 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb8a8024070 con 0x7fb8b013a440 2023-10-08T16:03:53.255 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.243+0000 7fb897fff700 1 -- 172.21.15.190:0/3652549194 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb8a801e7e0 con 0x7fb8b013a440 2023-10-08T16:03:53.255 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.247+0000 7fb8b5149700 1 -- 172.21.15.190:0/3652549194 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b00b2230 con 0x7fb8b013a440 2023-10-08T16:03:53.256 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.251+0000 7fb897fff700 1 -- 172.21.15.190:0/3652549194 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fb8a80466d0 con 0x7fb8b013a440 2023-10-08T16:03:53.331 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.327+0000 7fb8b5149700 1 -- 172.21.15.190:0/3652549194 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8c5deadf-a203-4d30-aa7f-6e2e492b6ffc", "id": 0} v 0) v1 -- 0x7fb8b006f7a0 con 0x7fb8b013a440 2023-10-08T16:03:53.342 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.335+0000 7fb897fff700 1 -- 172.21.15.190:0/3652549194 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8c5deadf-a203-4d30-aa7f-6e2e492b6ffc", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb8b006f7a0 con 0x7fb8b013a440 2023-10-08T16:03:53.343 INFO:teuthology.orchestra.run.smithi190.stdout:0 2023-10-08T16:03:53.344 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.339+0000 7fb8b5149700 1 -- 172.21.15.190:0/3652549194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8b013a440 msgr2=0x7fb8b01528c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:53.344 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.339+0000 7fb8b5149700 1 --2- 172.21.15.190:0/3652549194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8b013a440 0x7fb8b01528c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8012ad0 tx=0x7fb8a8019000 comp rx=0 tx=0).stop 2023-10-08T16:03:53.344 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.339+0000 7fb8b5149700 1 -- 172.21.15.190:0/3652549194 shutdown_connections 2023-10-08T16:03:53.344 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.339+0000 7fb8b5149700 1 --2- 172.21.15.190:0/3652549194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8b013a440 0x7fb8b01528c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.344 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.339+0000 7fb8b5149700 1 --2- 172.21.15.190:0/3652549194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8b0139aa0 0x7fb8b00ae210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.345 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.339+0000 7fb8b5149700 1 --2- 172.21.15.190:0/3652549194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8b006a0d0 0x7fb8b01439f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.345 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.339+0000 7fb8b5149700 1 -- 172.21.15.190:0/3652549194 >> 172.21.15.190:0/3652549194 conn(0x7fb8b00b6ba0 msgr2=0x7fb8b006fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:03:53.345 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.339+0000 7fb8b5149700 1 -- 172.21.15.190:0/3652549194 shutdown_connections 2023-10-08T16:03:53.345 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.339+0000 7fb8b5149700 1 -- 172.21.15.190:0/3652549194 wait complete. 2023-10-08T16:03:53.357 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 9b081c42-c915-48c3-a1ad-410f09a78576 1 2023-10-08T16:03:53.454 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-10-08T16:03:53.447+0000 7fa4caaa4000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:03:53.466 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.459+0000 7f165262d700 1 Processor -- start 2023-10-08T16:03:53.467 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.459+0000 7f165262d700 1 -- start start 2023-10-08T16:03:53.471 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f165262d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f164c1476f0 0x7f164c149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:53.471 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f165262d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164c0af2d0 con 0x7f164c0b5ee0 2023-10-08T16:03:53.471 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f165262d700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164c0aef60 con 0x7f164c0b5b10 2023-10-08T16:03:53.471 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f165262d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164c0af760 con 0x7f164c1476f0 2023-10-08T16:03:53.471 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f164bfff700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f164c0b5b10 0x7f164c0acfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53320/0 (socket says 172.21.15.190:53320) 2023-10-08T16:03:53.471 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f164bfff700 1 -- 172.21.15.190:0/3559065124 learned_addr learned my addr 172.21.15.190:0/3559065124 (peer_addr_for_me v1:172.21.15.190:0/0) 2023-10-08T16:03:53.471 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f1650bca700 1 --2- 172.21.15.190:0/3559065124 >> v2:172.21.15.133:3300/0 conn(0x7f164c1476f0 0x7f164c149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:53.471 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f164affd700 1 -- 172.21.15.190:0/3559065124 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3832135649 0 0) 0x7f164c0aef60 con 0x7f164c0b5b10 2023-10-08T16:03:53.472 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f164affd700 1 -- 172.21.15.190:0/3559065124 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1634003570 con 0x7f164c0b5b10 2023-10-08T16:03:53.472 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f164affd700 1 -- 172.21.15.190:0/3559065124 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3423478266 0 0) 0x7f1634003570 con 0x7f164c0b5b10 2023-10-08T16:03:53.472 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f164affd700 1 -- 172.21.15.190:0/3559065124 >> v2:172.21.15.133:3300/0 conn(0x7f164c1476f0 msgr2=0x7f164c149ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:03:53.472 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f164affd700 1 --2- 172.21.15.190:0/3559065124 >> v2:172.21.15.133:3300/0 conn(0x7f164c1476f0 0x7f164c149ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.472 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f164affd700 1 -- 172.21.15.190:0/3559065124 >> v1:172.21.15.133:6789/0 conn(0x7f164c0b5ee0 legacy=0x7f164c0b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:53.472 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f164affd700 1 -- 172.21.15.190:0/3559065124 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c0b1970 con 0x7f164c0b5b10 2023-10-08T16:03:53.472 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f164affd700 1 -- 172.21.15.190:0/3559065124 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2883817959 0 0) 0x7f163c001470 con 0x7f164c0b5b10 2023-10-08T16:03:53.472 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f164affd700 1 -- 172.21.15.190:0/3559065124 >> v1:172.21.15.190:6789/0 conn(0x7f164c0b5b10 legacy=0x7f164c0acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:53.472 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f164affd700 1 --2- 172.21.15.190:0/3559065124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1634003a60 0x7f1634003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:53.472 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f164affd700 1 --2- 172.21.15.190:0/3559065124 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1634004810 0x7f1634004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:53.473 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f164affd700 1 --2- 172.21.15.190:0/3559065124 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16340051c0 0x7f163400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:53.473 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f164affd700 1 -- 172.21.15.190:0/3559065124 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c0af760 con 0x7f1634003a60 2023-10-08T16:03:53.473 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f164affd700 1 -- 172.21.15.190:0/3559065124 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163400c160 con 0x7f16340051c0 2023-10-08T16:03:53.473 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f164affd700 1 -- 172.21.15.190:0/3559065124 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163400c320 con 0x7f1634004810 2023-10-08T16:03:53.473 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f1650bca700 1 --2- 172.21.15.190:0/3559065124 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16340051c0 0x7f163400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:53.473 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f164bfff700 1 --2- 172.21.15.190:0/3559065124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1634003a60 0x7f1634003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:53.473 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f164b7fe700 1 --2- 172.21.15.190:0/3559065124 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1634004810 0x7f1634004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:53.473 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f1650bca700 1 -- 172.21.15.190:0/3559065124 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1634004810 msgr2=0x7f1634004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:03:53.473 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f1650bca700 1 --2- 172.21.15.190:0/3559065124 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1634004810 0x7f1634004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.473 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f1650bca700 1 -- 172.21.15.190:0/3559065124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1634003a60 msgr2=0x7f1634003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:03:53.473 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f1650bca700 1 --2- 172.21.15.190:0/3559065124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1634003a60 0x7f1634003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.474 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f1650bca700 1 -- 172.21.15.190:0/3559065124 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1634003570 con 0x7f16340051c0 2023-10-08T16:03:53.474 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f164b7fe700 1 --2- 172.21.15.190:0/3559065124 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1634004810 0x7f1634004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:03:53.474 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f164bfff700 1 --2- 172.21.15.190:0/3559065124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1634003a60 0x7f1634003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:03:53.474 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f1650bca700 1 -- 172.21.15.190:0/3559065124 reap_dead start 2023-10-08T16:03:53.474 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f1650bca700 1 --2- 172.21.15.190:0/3559065124 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16340051c0 0x7f163400ba60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f164400e210 tx=0x7f164400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9d5718af0cfbefd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:03:53.474 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f164affd700 1 -- 172.21.15.190:0/3559065124 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164400eac0 con 0x7f16340051c0 2023-10-08T16:03:53.474 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f164affd700 1 -- 172.21.15.190:0/3559065124 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164400f040 con 0x7f16340051c0 2023-10-08T16:03:53.474 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f164affd700 1 -- 172.21.15.190:0/3559065124 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164400ee70 con 0x7f16340051c0 2023-10-08T16:03:53.474 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f165262d700 1 -- 172.21.15.190:0/3559065124 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16340051c0 msgr2=0x7f163400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:53.474 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f165262d700 1 --2- 172.21.15.190:0/3559065124 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16340051c0 0x7f163400ba60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f164400e210 tx=0x7f164400b040 comp rx=0 tx=0).stop 2023-10-08T16:03:53.474 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f165262d700 1 -- 172.21.15.190:0/3559065124 shutdown_connections 2023-10-08T16:03:53.475 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f165262d700 1 --2- 172.21.15.190:0/3559065124 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16340051c0 0x7f163400ba60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.475 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f165262d700 1 -- 172.21.15.190:0/3559065124 >> 172.21.15.190:0/3559065124 conn(0x7f164c067a20 msgr2=0x7f164c0b5400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:03:53.475 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f165262d700 1 -- 172.21.15.190:0/3559065124 shutdown_connections 2023-10-08T16:03:53.475 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.463+0000 7f165262d700 1 -- 172.21.15.190:0/3559065124 wait complete. 2023-10-08T16:03:53.475 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-10-08T16:03:53.472+0000 7f447afd7000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:03:53.477 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f165262d700 1 Processor -- start 2023-10-08T16:03:53.477 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f165262d700 1 -- start start 2023-10-08T16:03:53.477 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f165262d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16340051c0 0x7f164c144700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:53.478 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f165262d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f164c1534a0 0x7f164c1538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:53.478 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f165262d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f164c1371f0 0x7f164c137660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:53.478 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f165262d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c145870 con 0x7f16340051c0 2023-10-08T16:03:53.478 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f165262d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c13d590 con 0x7f164c1534a0 2023-10-08T16:03:53.478 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f165262d700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164c153e30 con 0x7f164c1371f0 2023-10-08T16:03:53.478 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f1650bca700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f164c1371f0 0x7f164c137660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:53.478 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f164b7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f164c1534a0 0x7f164c1538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:53.478 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f1650bca700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f164c1371f0 0x7f164c137660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:55754/0 (socket says 172.21.15.190:55754) 2023-10-08T16:03:53.478 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f1650bca700 1 -- 172.21.15.190:0/3004428521 learned_addr learned my addr 172.21.15.190:0/3004428521 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-10-08T16:03:53.478 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f164b7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f164c1534a0 0x7f164c1538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:44968/0 (socket says 172.21.15.190:44968) 2023-10-08T16:03:53.478 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f164bfff700 1 --2- 172.21.15.190:0/3004428521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16340051c0 0x7f164c144700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:53.479 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f164b7fe700 1 -- 172.21.15.190:0/3004428521 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f164c1371f0 msgr2=0x7f164c137660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:53.479 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f164b7fe700 1 --2- 172.21.15.190:0/3004428521 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f164c1371f0 0x7f164c137660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.479 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f164b7fe700 1 -- 172.21.15.190:0/3004428521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16340051c0 msgr2=0x7f164c144700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:53.479 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f164b7fe700 1 --2- 172.21.15.190:0/3004428521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16340051c0 0x7f164c144700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.479 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f164b7fe700 1 -- 172.21.15.190:0/3004428521 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c146f60 con 0x7f164c1534a0 2023-10-08T16:03:53.479 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f164b7fe700 1 --2- 172.21.15.190:0/3004428521 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f164c1534a0 0x7f164c1538f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f16400016b0 tx=0x7f1640009040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:03:53.479 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f1633fff700 1 -- 172.21.15.190:0/3004428521 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640015070 con 0x7f164c1534a0 2023-10-08T16:03:53.479 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f1633fff700 1 -- 172.21.15.190:0/3004428521 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1640010020 con 0x7f164c1534a0 2023-10-08T16:03:53.479 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f165262d700 1 -- 172.21.15.190:0/3004428521 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164c147240 con 0x7f164c1534a0 2023-10-08T16:03:53.479 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f1633fff700 1 -- 172.21.15.190:0/3004428521 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640016550 con 0x7f164c1534a0 2023-10-08T16:03:53.479 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f165262d700 1 -- 172.21.15.190:0/3004428521 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164c145da0 con 0x7f164c1534a0 2023-10-08T16:03:53.480 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f1633fff700 1 -- 172.21.15.190:0/3004428521 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1640016bc0 con 0x7f164c1534a0 2023-10-08T16:03:53.480 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.467+0000 7f1633fff700 1 -- 172.21.15.190:0/3004428521 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f164000fcf0 con 0x7f164c1534a0 2023-10-08T16:03:53.480 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.471+0000 7f165262d700 1 -- 172.21.15.190:0/3004428521 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164c064810 con 0x7f164c1534a0 2023-10-08T16:03:53.480 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.471+0000 7f1633fff700 1 -- 172.21.15.190:0/3004428521 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f1640027060 con 0x7f164c1534a0 2023-10-08T16:03:53.513 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-10-08T16:03:53.507+0000 7fa4caaa4000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:03:53.531 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-10-08T16:03:53.528+0000 7f447afd7000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:03:53.552 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.547+0000 7f165262d700 1 -- 172.21.15.190:0/3004428521 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9b081c42-c915-48c3-a1ad-410f09a78576", "id": 1} v 0) v1 -- 0x7f164c0b3e40 con 0x7f164c1534a0 2023-10-08T16:03:53.562 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.555+0000 7f1633fff700 1 -- 172.21.15.190:0/3004428521 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9b081c42-c915-48c3-a1ad-410f09a78576", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f164000f450 con 0x7f164c1534a0 2023-10-08T16:03:53.562 INFO:teuthology.orchestra.run.smithi190.stdout:1 2023-10-08T16:03:53.564 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.559+0000 7f165262d700 1 -- 172.21.15.190:0/3004428521 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f164c1534a0 msgr2=0x7f164c1538f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:53.564 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.559+0000 7f165262d700 1 --2- 172.21.15.190:0/3004428521 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f164c1534a0 0x7f164c1538f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f16400016b0 tx=0x7f1640009040 comp rx=0 tx=0).stop 2023-10-08T16:03:53.564 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.559+0000 7f165262d700 1 -- 172.21.15.190:0/3004428521 shutdown_connections 2023-10-08T16:03:53.564 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.559+0000 7f165262d700 1 --2- 172.21.15.190:0/3004428521 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f164c1371f0 0x7f164c137660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.564 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.559+0000 7f165262d700 1 --2- 172.21.15.190:0/3004428521 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f164c1534a0 0x7f164c1538f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.564 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.559+0000 7f165262d700 1 --2- 172.21.15.190:0/3004428521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16340051c0 0x7f164c144700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.564 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.559+0000 7f165262d700 1 -- 172.21.15.190:0/3004428521 >> 172.21.15.190:0/3004428521 conn(0x7f164c067a20 msgr2=0x7f164c070830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:03:53.564 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.559+0000 7f165262d700 1 -- 172.21.15.190:0/3004428521 shutdown_connections 2023-10-08T16:03:53.565 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.559+0000 7f165262d700 1 -- 172.21.15.190:0/3004428521 wait complete. 2023-10-08T16:03:53.578 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 88ecda43-01cd-4644-ab0c-92c91fd38966 2 2023-10-08T16:03:53.636 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-10-08T16:03:53.631+0000 7fa4caaa4000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:03:53.642 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-10-08T16:03:53.640+0000 7f447afd7000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:03:53.688 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.683+0000 7f42b521e700 1 Processor -- start 2023-10-08T16:03:53.689 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.683+0000 7f42b521e700 1 -- start start 2023-10-08T16:03:53.690 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.683+0000 7f42b521e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f42b00b16b0 0x7f42b013f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:53.690 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.683+0000 7f42b521e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42b013f7c0 0x7f42b013fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:53.690 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.683+0000 7f42b521e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b00ab180 con 0x7f42b0070070 2023-10-08T16:03:53.690 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.683+0000 7f42b521e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b0140140 con 0x7f42b00b16b0 2023-10-08T16:03:53.690 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.683+0000 7f42b521e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b00ab8f0 con 0x7f42b013f7c0 2023-10-08T16:03:53.690 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.683+0000 7f42af59e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42b013f7c0 0x7f42b013fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:53.690 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.683+0000 7f42af59e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42b013f7c0 0x7f42b013fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:55762/0 (socket says 172.21.15.190:55762) 2023-10-08T16:03:53.691 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.683+0000 7f42af59e700 1 -- 172.21.15.190:0/2560422791 learned_addr learned my addr 172.21.15.190:0/2560422791 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-10-08T16:03:53.691 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.683+0000 7f42ae59c700 1 --2- 172.21.15.190:0/2560422791 >> v2:172.21.15.133:3300/0 conn(0x7f42b00b16b0 0x7f42b013f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:53.691 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.683+0000 7f42af59e700 1 -- 172.21.15.190:0/2560422791 >> v2:172.21.15.133:3300/0 conn(0x7f42b00b16b0 msgr2=0x7f42b013f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:03:53.691 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.683+0000 7f42af59e700 1 --2- 172.21.15.190:0/2560422791 >> v2:172.21.15.133:3300/0 conn(0x7f42b00b16b0 0x7f42b013f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.691 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.683+0000 7f42af59e700 1 -- 172.21.15.190:0/2560422791 >> v1:172.21.15.133:6789/0 conn(0x7f42b0070070 legacy=0x7f42b00b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:53.691 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.683+0000 7f42af59e700 1 -- 172.21.15.190:0/2560422791 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b00b5d30 con 0x7f42b013f7c0 2023-10-08T16:03:53.691 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.683+0000 7f42af59e700 1 --2- 172.21.15.190:0/2560422791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42b013f7c0 0x7f42b013fc00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f42a8009f20 tx=0x7f42a8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d8197c57821a829 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:03:53.692 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.683+0000 7f42add9b700 1 -- 172.21.15.190:0/2560422791 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a800e070 con 0x7f42b013f7c0 2023-10-08T16:03:53.692 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.683+0000 7f42add9b700 1 -- 172.21.15.190:0/2560422791 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a800b9d0 con 0x7f42b013f7c0 2023-10-08T16:03:53.692 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.683+0000 7f42add9b700 1 -- 172.21.15.190:0/2560422791 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a80092e0 con 0x7f42b013f7c0 2023-10-08T16:03:53.692 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.683+0000 7f42b521e700 1 -- 172.21.15.190:0/2560422791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42b013f7c0 msgr2=0x7f42b013fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:53.692 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.683+0000 7f42b521e700 1 --2- 172.21.15.190:0/2560422791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42b013f7c0 0x7f42b013fc00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f42a8009f20 tx=0x7f42a8009840 comp rx=0 tx=0).stop 2023-10-08T16:03:53.693 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42b521e700 1 -- 172.21.15.190:0/2560422791 shutdown_connections 2023-10-08T16:03:53.693 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42b521e700 1 --2- 172.21.15.190:0/2560422791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42b013f7c0 0x7f42b013fc00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.693 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42b521e700 1 --2- 172.21.15.190:0/2560422791 >> v2:172.21.15.133:3300/0 conn(0x7f42b00b16b0 0x7f42b013f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.693 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42b521e700 1 -- 172.21.15.190:0/2560422791 >> 172.21.15.190:0/2560422791 conn(0x7f42b0067a60 msgr2=0x7f42b00b5410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:03:53.693 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42b521e700 1 -- 172.21.15.190:0/2560422791 shutdown_connections 2023-10-08T16:03:53.693 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42b521e700 1 -- 172.21.15.190:0/2560422791 wait complete. 2023-10-08T16:03:53.695 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42b521e700 1 Processor -- start 2023-10-08T16:03:53.695 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42b521e700 1 -- start start 2023-10-08T16:03:53.695 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42b521e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42b0070070 0x7f42b0155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:53.695 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42b521e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42b00b16b0 0x7f42b006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:53.695 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42b521e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42b013f7c0 0x7f42b0151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:53.695 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42b521e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b01520e0 con 0x7f42b00b16b0 2023-10-08T16:03:53.695 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42b521e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b0155890 con 0x7f42b013f7c0 2023-10-08T16:03:53.696 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42b521e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b00b2be0 con 0x7f42b0070070 2023-10-08T16:03:53.696 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42aed9d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42b0070070 0x7f42b0155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:53.696 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42aed9d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42b0070070 0x7f42b0155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:55774/0 (socket says 172.21.15.190:55774) 2023-10-08T16:03:53.696 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42aed9d700 1 -- 172.21.15.190:0/1465110538 learned_addr learned my addr 172.21.15.190:0/1465110538 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-10-08T16:03:53.696 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42af59e700 1 --2- 172.21.15.190:0/1465110538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42b013f7c0 0x7f42b0151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:53.696 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42ae59c700 1 --2- 172.21.15.190:0/1465110538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42b00b16b0 0x7f42b006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:53.696 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42aed9d700 1 -- 172.21.15.190:0/1465110538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42b013f7c0 msgr2=0x7f42b0151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:53.696 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42aed9d700 1 --2- 172.21.15.190:0/1465110538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42b013f7c0 0x7f42b0151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.696 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42aed9d700 1 -- 172.21.15.190:0/1465110538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42b00b16b0 msgr2=0x7f42b006dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:53.696 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42aed9d700 1 --2- 172.21.15.190:0/1465110538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42b00b16b0 0x7f42b006dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.696 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42aed9d700 1 -- 172.21.15.190:0/1465110538 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a8009ae0 con 0x7f42b0070070 2023-10-08T16:03:53.697 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42ae59c700 1 --2- 172.21.15.190:0/1465110538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42b00b16b0 0x7f42b006dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:03:53.697 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42aed9d700 1 --2- 172.21.15.190:0/1465110538 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42b0070070 0x7f42b0155d20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f42a000c590 tx=0x7f42a000c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:03:53.697 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42a6ffd700 1 -- 172.21.15.190:0/1465110538 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a0011590 con 0x7f42b0070070 2023-10-08T16:03:53.697 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42a6ffd700 1 -- 172.21.15.190:0/1465110538 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a00116f0 con 0x7f42b0070070 2023-10-08T16:03:53.697 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42b521e700 1 -- 172.21.15.190:0/1465110538 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b0155240 con 0x7f42b0070070 2023-10-08T16:03:53.697 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42a6ffd700 1 -- 172.21.15.190:0/1465110538 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a0011ab0 con 0x7f42b0070070 2023-10-08T16:03:53.697 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42b521e700 1 -- 172.21.15.190:0/1465110538 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b0146dd0 con 0x7f42b0070070 2023-10-08T16:03:53.697 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42a6ffd700 1 -- 172.21.15.190:0/1465110538 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f42a001c6c0 con 0x7f42b0070070 2023-10-08T16:03:53.697 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.687+0000 7f42a6ffd700 1 -- 172.21.15.190:0/1465110538 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f42a0012850 con 0x7f42b0070070 2023-10-08T16:03:53.699 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.695+0000 7f42b521e700 1 -- 172.21.15.190:0/1465110538 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42b0064810 con 0x7f42b0070070 2023-10-08T16:03:53.704 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.699+0000 7f42a6ffd700 1 -- 172.21.15.190:0/1465110538 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f42a0017070 con 0x7f42b0070070 2023-10-08T16:03:53.780 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.775+0000 7f42b521e700 1 -- 172.21.15.190:0/1465110538 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "88ecda43-01cd-4644-ab0c-92c91fd38966", "id": 2} v 0) v1 -- 0x7f42b00abb90 con 0x7f42b0070070 2023-10-08T16:03:53.787 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.779+0000 7f42a6ffd700 1 -- 172.21.15.190:0/1465110538 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "88ecda43-01cd-4644-ab0c-92c91fd38966", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f42a001cba0 con 0x7f42b0070070 2023-10-08T16:03:53.787 INFO:teuthology.orchestra.run.smithi190.stdout:2 2023-10-08T16:03:53.788 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.783+0000 7f42b521e700 1 -- 172.21.15.190:0/1465110538 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42b0070070 msgr2=0x7f42b0155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:53.788 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.783+0000 7f42b521e700 1 --2- 172.21.15.190:0/1465110538 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42b0070070 0x7f42b0155d20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f42a000c590 tx=0x7f42a000c8a0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.789 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.783+0000 7f42b521e700 1 -- 172.21.15.190:0/1465110538 shutdown_connections 2023-10-08T16:03:53.789 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.783+0000 7f42b521e700 1 --2- 172.21.15.190:0/1465110538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42b013f7c0 0x7f42b0151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.789 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.783+0000 7f42b521e700 1 --2- 172.21.15.190:0/1465110538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42b00b16b0 0x7f42b006dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.789 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.783+0000 7f42b521e700 1 --2- 172.21.15.190:0/1465110538 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42b0070070 0x7f42b0155d20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.790 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.783+0000 7f42b521e700 1 -- 172.21.15.190:0/1465110538 >> 172.21.15.190:0/1465110538 conn(0x7f42b0067a60 msgr2=0x7f42b0147ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:03:53.790 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.783+0000 7f42b521e700 1 -- 172.21.15.190:0/1465110538 shutdown_connections 2023-10-08T16:03:53.790 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.783+0000 7f42b521e700 1 -- 172.21.15.190:0/1465110538 wait complete. 2023-10-08T16:03:53.799 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 39faf38d-b8e2-4e11-9b3b-84dc834c977c 3 2023-10-08T16:03:53.861 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-10-08T16:03:53.860+0000 7f447afd7000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:03:53.866 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-10-08T16:03:53.859+0000 7fa4caaa4000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:03:53.903 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.895+0000 7f783e149700 1 Processor -- start 2023-10-08T16:03:53.903 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.895+0000 7f783e149700 1 -- start start 2023-10-08T16:03:53.906 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f783e149700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7838070a60 0x7f78381406b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:53.906 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f783e149700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7838144120 0x7f783814af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:53.906 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f783e149700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78380af1e0 con 0x7f7838140bf0 2023-10-08T16:03:53.906 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f783e149700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f783806c030 con 0x7f7838144120 2023-10-08T16:03:53.906 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f783e149700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7838141070 con 0x7f7838070a60 2023-10-08T16:03:53.906 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f7836ffd700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f7838140bf0 0x7f7838143a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53326/0 (socket says 172.21.15.190:53326) 2023-10-08T16:03:53.906 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f7836ffd700 1 -- 172.21.15.190:0/567402376 learned_addr learned my addr 172.21.15.190:0/567402376 (peer_addr_for_me v1:172.21.15.190:0/0) 2023-10-08T16:03:53.906 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f78377fe700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7838070a60 0x7f78381406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:53.906 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f7837fff700 1 --2- 172.21.15.190:0/567402376 >> v2:172.21.15.133:3300/0 conn(0x7f7838144120 0x7f783814af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:53.907 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f78367fc700 1 -- 172.21.15.190:0/567402376 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928193081 0 0) 0x7f78380af1e0 con 0x7f7838140bf0 2023-10-08T16:03:53.907 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f78367fc700 1 -- 172.21.15.190:0/567402376 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7820003570 con 0x7f7838140bf0 2023-10-08T16:03:53.907 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f78377fe700 1 -- 172.21.15.190:0/567402376 >> v2:172.21.15.133:3300/0 conn(0x7f7838144120 msgr2=0x7f783814af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:03:53.907 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f78377fe700 1 --2- 172.21.15.190:0/567402376 >> v2:172.21.15.133:3300/0 conn(0x7f7838144120 0x7f783814af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.907 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f78377fe700 1 -- 172.21.15.190:0/567402376 >> v1:172.21.15.190:6789/0 conn(0x7f7838140bf0 legacy=0x7f7838143a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:53.907 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f78377fe700 1 -- 172.21.15.190:0/567402376 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78380af4f0 con 0x7f7838070a60 2023-10-08T16:03:53.907 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f78377fe700 1 --2- 172.21.15.190:0/567402376 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7838070a60 0x7f78381406b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f78380ac650 tx=0x7f78280091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f24eb4abd1380867 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:03:53.907 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f78367fc700 1 -- 172.21.15.190:0/567402376 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7828011630 con 0x7f7838070a60 2023-10-08T16:03:53.907 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f78367fc700 1 -- 172.21.15.190:0/567402376 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7828011790 con 0x7f7838070a60 2023-10-08T16:03:53.907 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f78367fc700 1 -- 172.21.15.190:0/567402376 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7828011b10 con 0x7f7838070a60 2023-10-08T16:03:53.908 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f783e149700 1 -- 172.21.15.190:0/567402376 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7838070a60 msgr2=0x7f78381406b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:53.908 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f783e149700 1 --2- 172.21.15.190:0/567402376 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7838070a60 0x7f78381406b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f78380ac650 tx=0x7f78280091a0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.908 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f783e149700 1 -- 172.21.15.190:0/567402376 shutdown_connections 2023-10-08T16:03:53.909 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f783e149700 1 --2- 172.21.15.190:0/567402376 >> v2:172.21.15.133:3300/0 conn(0x7f7838144120 0x7f783814af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.909 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f783e149700 1 --2- 172.21.15.190:0/567402376 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7838070a60 0x7f78381406b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.909 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f783e149700 1 -- 172.21.15.190:0/567402376 >> 172.21.15.190:0/567402376 conn(0x7f7838067a20 msgr2=0x7f78380b5400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:03:53.909 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f783e149700 1 -- 172.21.15.190:0/567402376 shutdown_connections 2023-10-08T16:03:53.909 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.899+0000 7f783e149700 1 -- 172.21.15.190:0/567402376 wait complete. 2023-10-08T16:03:53.909 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f783e149700 1 Processor -- start 2023-10-08T16:03:53.909 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f783e149700 1 -- start start 2023-10-08T16:03:53.910 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-10-08T16:03:53.908+0000 7f447afd7000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:03:53.911 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f783e149700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7838070a60 0x7f7838153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:53.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f783e149700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7838140bf0 0x7f7838150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:53.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f783e149700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7838144120 0x7f78380a9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:53.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f783e149700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78381500d0 con 0x7f7838144120 2023-10-08T16:03:53.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f783e149700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78380a8c30 con 0x7f7838140bf0 2023-10-08T16:03:53.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f783e149700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f783814faa0 con 0x7f7838070a60 2023-10-08T16:03:53.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f7836ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7838140bf0 0x7f7838150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:53.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f78377fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7838070a60 0x7f7838153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:53.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f7836ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7838140bf0 0x7f7838150560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:44998/0 (socket says 172.21.15.190:44998) 2023-10-08T16:03:53.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f7836ffd700 1 -- 172.21.15.190:0/637988265 learned_addr learned my addr 172.21.15.190:0/637988265 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-10-08T16:03:53.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f7837fff700 1 --2- 172.21.15.190:0/637988265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7838144120 0x7f78380a9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:53.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f7836ffd700 1 -- 172.21.15.190:0/637988265 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7838070a60 msgr2=0x7f7838153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:53.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f7836ffd700 1 --2- 172.21.15.190:0/637988265 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7838070a60 0x7f7838153040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.913 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f7836ffd700 1 -- 172.21.15.190:0/637988265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7838144120 msgr2=0x7f78380a9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:53.913 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f7836ffd700 1 --2- 172.21.15.190:0/637988265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7838144120 0x7f78380a9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:53.913 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f7836ffd700 1 -- 172.21.15.190:0/637988265 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7828009420 con 0x7f7838140bf0 2023-10-08T16:03:53.913 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f78377fe700 1 --2- 172.21.15.190:0/637988265 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7838070a60 0x7f7838153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:03:53.913 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f7836ffd700 1 --2- 172.21.15.190:0/637988265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7838140bf0 0x7f7838150560 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f782c0011e0 tx=0x7f782c007df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:03:53.913 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f781f7fe700 1 -- 172.21.15.190:0/637988265 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782c005b30 con 0x7f7838140bf0 2023-10-08T16:03:53.913 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f781f7fe700 1 -- 172.21.15.190:0/637988265 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782c005c90 con 0x7f7838140bf0 2023-10-08T16:03:53.913 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f783e149700 1 -- 172.21.15.190:0/637988265 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78380a6ed0 con 0x7f7838140bf0 2023-10-08T16:03:53.913 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f781f7fe700 1 -- 172.21.15.190:0/637988265 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782c007300 con 0x7f7838140bf0 2023-10-08T16:03:53.913 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f783e149700 1 -- 172.21.15.190:0/637988265 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7838141580 con 0x7f7838140bf0 2023-10-08T16:03:53.913 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f781f7fe700 1 -- 172.21.15.190:0/637988265 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f782c01c440 con 0x7f7838140bf0 2023-10-08T16:03:53.914 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.903+0000 7f781f7fe700 1 -- 172.21.15.190:0/637988265 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f782c005e00 con 0x7f7838140bf0 2023-10-08T16:03:53.914 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.907+0000 7f783e149700 1 -- 172.21.15.190:0/637988265 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7838150240 con 0x7f7838140bf0 2023-10-08T16:03:53.916 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.911+0000 7f781f7fe700 1 -- 172.21.15.190:0/637988265 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f782c017070 con 0x7f7838140bf0 2023-10-08T16:03:53.917 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-10-08T16:03:53.911+0000 7fa4caaa4000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:03:53.993 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.987+0000 7f783e149700 1 -- 172.21.15.190:0/637988265 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "39faf38d-b8e2-4e11-9b3b-84dc834c977c", "id": 3} v 0) v1 -- 0x7f7838064810 con 0x7f7838140bf0 2023-10-08T16:03:54.002 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.995+0000 7f781f7fe700 1 -- 172.21.15.190:0/637988265 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "39faf38d-b8e2-4e11-9b3b-84dc834c977c", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f782c01c8e0 con 0x7f7838140bf0 2023-10-08T16:03:54.002 INFO:teuthology.orchestra.run.smithi190.stdout:3 2023-10-08T16:03:54.003 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.995+0000 7f783e149700 1 -- 172.21.15.190:0/637988265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7838140bf0 msgr2=0x7f7838150560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:54.003 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.995+0000 7f783e149700 1 --2- 172.21.15.190:0/637988265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7838140bf0 0x7f7838150560 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f782c0011e0 tx=0x7f782c007df0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.003 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.995+0000 7f783e149700 1 -- 172.21.15.190:0/637988265 shutdown_connections 2023-10-08T16:03:54.003 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.995+0000 7f783e149700 1 --2- 172.21.15.190:0/637988265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7838144120 0x7f78380a9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.004 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.995+0000 7f783e149700 1 --2- 172.21.15.190:0/637988265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7838140bf0 0x7f7838150560 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.004 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.995+0000 7f783e149700 1 --2- 172.21.15.190:0/637988265 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7838070a60 0x7f7838153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.004 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.995+0000 7f783e149700 1 -- 172.21.15.190:0/637988265 >> 172.21.15.190:0/637988265 conn(0x7f7838067a20 msgr2=0x7f7838143360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:03:54.004 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.995+0000 7f783e149700 1 -- 172.21.15.190:0/637988265 shutdown_connections 2023-10-08T16:03:54.004 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:53.995+0000 7f783e149700 1 -- 172.21.15.190:0/637988265 wait complete. 2023-10-08T16:03:54.015 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 4c097e61-1cad-4b61-9183-4e7bc486bd32 4 2023-10-08T16:03:54.113 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.107+0000 7f5b6e23e700 1 Processor -- start 2023-10-08T16:03:54.114 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.107+0000 7f5b6e23e700 1 -- start start 2023-10-08T16:03:54.115 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.107+0000 7f5b6e23e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b680634e0 0x7f5b680b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:54.115 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.107+0000 7f5b6e23e700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5b680b47b0 0x7f5b680b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:54.115 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.107+0000 7f5b6e23e700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b680b2bf0 con 0x7f5b68145b50 2023-10-08T16:03:54.115 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.107+0000 7f5b6e23e700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b680b5160 con 0x7f5b680b47b0 2023-10-08T16:03:54.115 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.107+0000 7f5b6e23e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b680b1c90 con 0x7f5b680634e0 2023-10-08T16:03:54.115 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.107+0000 7f5b66ffd700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5b680b47b0 0x7f5b680b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:54.115 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.107+0000 7f5b66ffd700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5b680b47b0 0x7f5b680b4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:45004/0 (socket says 172.21.15.190:45004) 2023-10-08T16:03:54.115 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.107+0000 7f5b67fff700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f5b68145b50 0x7f5b68145f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53338/0 (socket says 172.21.15.190:53338) 2023-10-08T16:03:54.116 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.107+0000 7f5b66ffd700 1 -- 172.21.15.190:0/470831526 learned_addr learned my addr 172.21.15.190:0/470831526 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-10-08T16:03:54.116 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.107+0000 7f5b677fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b680634e0 0x7f5b680b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:54.117 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.111+0000 7f5b677fe700 1 -- 172.21.15.190:0/470831526 >> v2:172.21.15.190:3300/0 conn(0x7f5b680b47b0 msgr2=0x7f5b680b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:03:54.117 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.111+0000 7f5b677fe700 1 --2- 172.21.15.190:0/470831526 >> v2:172.21.15.190:3300/0 conn(0x7f5b680b47b0 0x7f5b680b4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.117 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.111+0000 7f5b677fe700 1 -- 172.21.15.190:0/470831526 >> v1:172.21.15.190:6789/0 conn(0x7f5b68145b50 legacy=0x7f5b68145f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:54.117 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.111+0000 7f5b677fe700 1 -- 172.21.15.190:0/470831526 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b680b1f70 con 0x7f5b680634e0 2023-10-08T16:03:54.117 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.111+0000 7f5b66ffd700 1 --2- 172.21.15.190:0/470831526 >> v2:172.21.15.190:3300/0 conn(0x7f5b680b47b0 0x7f5b680b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:03:54.118 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.111+0000 7f5b677fe700 1 --2- 172.21.15.190:0/470831526 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b680634e0 0x7f5b680b0930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009eb0 tx=0x7f5b60009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c493f44908c9523b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:03:54.118 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.111+0000 7f5b667fc700 1 -- 172.21.15.190:0/470831526 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6000e070 con 0x7f5b680634e0 2023-10-08T16:03:54.118 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.111+0000 7f5b667fc700 1 -- 172.21.15.190:0/470831526 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6000bc30 con 0x7f5b680634e0 2023-10-08T16:03:54.118 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.111+0000 7f5b667fc700 1 -- 172.21.15.190:0/470831526 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b60012430 con 0x7f5b680634e0 2023-10-08T16:03:54.118 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.111+0000 7f5b6e23e700 1 -- 172.21.15.190:0/470831526 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b680634e0 msgr2=0x7f5b680b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:54.118 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.111+0000 7f5b6e23e700 1 --2- 172.21.15.190:0/470831526 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b680634e0 0x7f5b680b0930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009eb0 tx=0x7f5b60009780 comp rx=0 tx=0).stop 2023-10-08T16:03:54.118 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.111+0000 7f5b6e23e700 1 -- 172.21.15.190:0/470831526 shutdown_connections 2023-10-08T16:03:54.118 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.111+0000 7f5b6e23e700 1 --2- 172.21.15.190:0/470831526 >> v2:172.21.15.190:3300/0 conn(0x7f5b680b47b0 0x7f5b680b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.118 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.111+0000 7f5b6e23e700 1 --2- 172.21.15.190:0/470831526 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b680634e0 0x7f5b680b0930 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.118 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.111+0000 7f5b6e23e700 1 -- 172.21.15.190:0/470831526 >> 172.21.15.190:0/470831526 conn(0x7f5b68067e70 msgr2=0x7f5b68062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:03:54.119 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.111+0000 7f5b6e23e700 1 -- 172.21.15.190:0/470831526 shutdown_connections 2023-10-08T16:03:54.119 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.111+0000 7f5b6e23e700 1 -- 172.21.15.190:0/470831526 wait complete. 2023-10-08T16:03:54.121 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.111+0000 7f5b6e23e700 1 Processor -- start 2023-10-08T16:03:54.121 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.111+0000 7f5b6e23e700 1 -- start start 2023-10-08T16:03:54.121 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.115+0000 7f5b6e23e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b680634e0 0x7f5b68155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:54.121 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.115+0000 7f5b6e23e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b680b47b0 0x7f5b6813e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:54.121 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.115+0000 7f5b6e23e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b68145b50 0x7f5b6813e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:54.122 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.115+0000 7f5b6e23e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6813af10 con 0x7f5b68145b50 2023-10-08T16:03:54.122 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.115+0000 7f5b6e23e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6813cdc0 con 0x7f5b680634e0 2023-10-08T16:03:54.122 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.115+0000 7f5b6e23e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6813f970 con 0x7f5b680b47b0 2023-10-08T16:03:54.122 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.115+0000 7f5b66ffd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b680b47b0 0x7f5b6813e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:54.122 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.115+0000 7f5b677fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b680634e0 0x7f5b68155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:54.122 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.115+0000 7f5b677fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b680634e0 0x7f5b68155870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:45012/0 (socket says 172.21.15.190:45012) 2023-10-08T16:03:54.122 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.115+0000 7f5b677fe700 1 -- 172.21.15.190:0/316117852 learned_addr learned my addr 172.21.15.190:0/316117852 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-10-08T16:03:54.122 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.115+0000 7f5b67fff700 1 --2- 172.21.15.190:0/316117852 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b68145b50 0x7f5b6813e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:54.122 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.115+0000 7f5b66ffd700 1 -- 172.21.15.190:0/316117852 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b680634e0 msgr2=0x7f5b68155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:54.122 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.115+0000 7f5b66ffd700 1 --2- 172.21.15.190:0/316117852 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b680634e0 0x7f5b68155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.122 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.115+0000 7f5b66ffd700 1 -- 172.21.15.190:0/316117852 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b68145b50 msgr2=0x7f5b6813e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:54.122 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.115+0000 7f5b66ffd700 1 --2- 172.21.15.190:0/316117852 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b68145b50 0x7f5b6813e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.123 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.115+0000 7f5b66ffd700 1 -- 172.21.15.190:0/316117852 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c0094f0 con 0x7f5b680b47b0 2023-10-08T16:03:54.123 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.115+0000 7f5b677fe700 1 --2- 172.21.15.190:0/316117852 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b680634e0 0x7f5b68155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:03:54.123 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.115+0000 7f5b66ffd700 1 --2- 172.21.15.190:0/316117852 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b680b47b0 0x7f5b6813e350 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c006fd0 tx=0x7f5b5c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:03:54.123 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.115+0000 7f5b4f7fe700 1 -- 172.21.15.190:0/316117852 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c00c850 con 0x7f5b680b47b0 2023-10-08T16:03:54.123 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.115+0000 7f5b4f7fe700 1 -- 172.21.15.190:0/316117852 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5c00c9b0 con 0x7f5b680b47b0 2023-10-08T16:03:54.123 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.115+0000 7f5b6e23e700 1 -- 172.21.15.190:0/316117852 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b60009a20 con 0x7f5b680b47b0 2023-10-08T16:03:54.123 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.115+0000 7f5b4f7fe700 1 -- 172.21.15.190:0/316117852 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c00cd30 con 0x7f5b680b47b0 2023-10-08T16:03:54.123 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.115+0000 7f5b6e23e700 1 -- 172.21.15.190:0/316117852 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b68148aa0 con 0x7f5b680b47b0 2023-10-08T16:03:54.123 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.115+0000 7f5b4f7fe700 1 -- 172.21.15.190:0/316117852 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f5b5c005c80 con 0x7f5b680b47b0 2023-10-08T16:03:54.123 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.115+0000 7f5b4f7fe700 1 -- 172.21.15.190:0/316117852 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f5b5c013b80 con 0x7f5b680b47b0 2023-10-08T16:03:54.124 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.115+0000 7f5b6e23e700 1 -- 172.21.15.190:0/316117852 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b68064810 con 0x7f5b680b47b0 2023-10-08T16:03:54.125 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.119+0000 7f5b4f7fe700 1 -- 172.21.15.190:0/316117852 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f5b5c020060 con 0x7f5b680b47b0 2023-10-08T16:03:54.132 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-10-08T16:03:54.127+0000 7fa4caaa4000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:03:54.146 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-10-08T16:03:54.144+0000 7f447afd7000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:03:54.192 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-10-08T16:03:54.187+0000 7fa4caaa4000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:03:54.202 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.195+0000 7f5b6e23e700 1 -- 172.21.15.190:0/316117852 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4c097e61-1cad-4b61-9183-4e7bc486bd32", "id": 4} v 0) v1 -- 0x7f5b680b25a0 con 0x7f5b680b47b0 2023-10-08T16:03:54.208 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-10-08T16:03:54.204+0000 7f447afd7000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:03:54.210 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.203+0000 7f5b4f7fe700 1 -- 172.21.15.190:0/316117852 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4c097e61-1cad-4b61-9183-4e7bc486bd32", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5b5c013e10 con 0x7f5b680b47b0 2023-10-08T16:03:54.210 INFO:teuthology.orchestra.run.smithi190.stdout:4 2023-10-08T16:03:54.211 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.203+0000 7f5b6e23e700 1 -- 172.21.15.190:0/316117852 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b680b47b0 msgr2=0x7f5b6813e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:54.211 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.203+0000 7f5b6e23e700 1 --2- 172.21.15.190:0/316117852 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b680b47b0 0x7f5b6813e350 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c006fd0 tx=0x7f5b5c009250 comp rx=0 tx=0).stop 2023-10-08T16:03:54.211 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.203+0000 7f5b6e23e700 1 -- 172.21.15.190:0/316117852 shutdown_connections 2023-10-08T16:03:54.211 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.203+0000 7f5b6e23e700 1 --2- 172.21.15.190:0/316117852 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b68145b50 0x7f5b6813e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.212 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.203+0000 7f5b6e23e700 1 --2- 172.21.15.190:0/316117852 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b680b47b0 0x7f5b6813e350 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.212 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.203+0000 7f5b6e23e700 1 --2- 172.21.15.190:0/316117852 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b680634e0 0x7f5b68155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.212 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.203+0000 7f5b6e23e700 1 -- 172.21.15.190:0/316117852 >> 172.21.15.190:0/316117852 conn(0x7f5b68067e70 msgr2=0x7f5b680b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:03:54.212 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.203+0000 7f5b6e23e700 1 -- 172.21.15.190:0/316117852 shutdown_connections 2023-10-08T16:03:54.212 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.203+0000 7f5b6e23e700 1 -- 172.21.15.190:0/316117852 wait complete. 2023-10-08T16:03:54.222 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 05f072e0-7bc0-40f0-8cb6-8e322c82d6d6 5 2023-10-08T16:03:54.256 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-10-08T16:03:54.251+0000 7fa4caaa4000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:03:54.269 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-10-08T16:03:54.268+0000 7f447afd7000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:03:54.316 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b952e7700 1 Processor -- start 2023-10-08T16:03:54.316 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b952e7700 1 -- start start 2023-10-08T16:03:54.318 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b952e7700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b900b63c0 0x7f3b9006df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:54.319 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b952e7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3b900b6790 0x7f3b90142b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:54.319 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b952e7700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3b90143080 0x7f3b90066f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:54.319 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b952e7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b9006d790 con 0x7f3b900b6790 2023-10-08T16:03:54.319 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b952e7700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b9006da70 con 0x7f3b90143080 2023-10-08T16:03:54.319 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b952e7700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9006e520 con 0x7f3b900b63c0 2023-10-08T16:03:54.319 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b8effd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b900b63c0 0x7f3b9006df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:54.319 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b8f7fe700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3b90143080 0x7f3b90066f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:54.319 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b8f7fe700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3b90143080 0x7f3b90066f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:45022/0 (socket says 172.21.15.190:45022) 2023-10-08T16:03:54.319 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b8f7fe700 1 -- 172.21.15.190:0/641031105 learned_addr learned my addr 172.21.15.190:0/641031105 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-10-08T16:03:54.319 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b8effd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b900b63c0 0x7f3b9006df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:55814/0 (socket says 172.21.15.190:55814) 2023-10-08T16:03:54.319 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b8e7fc700 1 --2- 172.21.15.190:0/641031105 >> v2:172.21.15.133:3300/0 conn(0x7f3b900b6790 0x7f3b90142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:54.320 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b8effd700 1 -- 172.21.15.190:0/641031105 >> v2:172.21.15.190:3300/0 conn(0x7f3b90143080 msgr2=0x7f3b90066f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:03:54.320 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b8effd700 1 --2- 172.21.15.190:0/641031105 >> v2:172.21.15.190:3300/0 conn(0x7f3b90143080 0x7f3b90066f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.320 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b8effd700 1 -- 172.21.15.190:0/641031105 >> v2:172.21.15.133:3300/0 conn(0x7f3b900b6790 msgr2=0x7f3b90142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:03:54.320 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b8effd700 1 --2- 172.21.15.190:0/641031105 >> v2:172.21.15.133:3300/0 conn(0x7f3b900b6790 0x7f3b90142b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.320 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b8effd700 1 -- 172.21.15.190:0/641031105 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9006e800 con 0x7f3b900b63c0 2023-10-08T16:03:54.320 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b8f7fe700 1 --2- 172.21.15.190:0/641031105 >> v2:172.21.15.190:3300/0 conn(0x7f3b90143080 0x7f3b90066f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:03:54.320 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b8effd700 1 --2- 172.21.15.190:0/641031105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b900b63c0 0x7f3b9006df00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3b9006bfc0 tx=0x7f3b80009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3392111aa6fc884 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:03:54.320 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b8dffb700 1 -- 172.21.15.190:0/641031105 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b80005c10 con 0x7f3b900b63c0 2023-10-08T16:03:54.320 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b8dffb700 1 -- 172.21.15.190:0/641031105 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b80005d70 con 0x7f3b900b63c0 2023-10-08T16:03:54.320 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b8dffb700 1 -- 172.21.15.190:0/641031105 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b80006260 con 0x7f3b900b63c0 2023-10-08T16:03:54.323 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b952e7700 1 -- 172.21.15.190:0/641031105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b900b63c0 msgr2=0x7f3b9006df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:54.323 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b952e7700 1 --2- 172.21.15.190:0/641031105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b900b63c0 0x7f3b9006df00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3b9006bfc0 tx=0x7f3b80009120 comp rx=0 tx=0).stop 2023-10-08T16:03:54.323 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b952e7700 1 -- 172.21.15.190:0/641031105 shutdown_connections 2023-10-08T16:03:54.323 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b952e7700 1 --2- 172.21.15.190:0/641031105 >> v2:172.21.15.190:3300/0 conn(0x7f3b90143080 0x7f3b90066f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.323 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.311+0000 7f3b952e7700 1 --2- 172.21.15.190:0/641031105 >> v2:172.21.15.133:3300/0 conn(0x7f3b900b6790 0x7f3b90142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.324 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b952e7700 1 --2- 172.21.15.190:0/641031105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b900b63c0 0x7f3b9006df00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.324 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b952e7700 1 -- 172.21.15.190:0/641031105 >> 172.21.15.190:0/641031105 conn(0x7f3b9006adf0 msgr2=0x7f3b900b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:03:54.324 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b952e7700 1 -- 172.21.15.190:0/641031105 shutdown_connections 2023-10-08T16:03:54.324 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b952e7700 1 -- 172.21.15.190:0/641031105 wait complete. 2023-10-08T16:03:54.324 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b952e7700 1 Processor -- start 2023-10-08T16:03:54.324 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b952e7700 1 -- start start 2023-10-08T16:03:54.324 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b952e7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b900b63c0 0x7f3b900b1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:54.324 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b952e7700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b900b6790 0x7f3b90153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:54.324 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b952e7700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b90143080 0x7f3b90062ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:54.324 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b952e7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b900af910 con 0x7f3b900b63c0 2023-10-08T16:03:54.324 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b952e7700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9013c540 con 0x7f3b900b6790 2023-10-08T16:03:54.325 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b952e7700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9013c0b0 con 0x7f3b90143080 2023-10-08T16:03:54.325 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b8e7fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b900b6790 0x7f3b90153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:54.325 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b8e7fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b900b6790 0x7f3b90153580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:45024/0 (socket says 172.21.15.190:45024) 2023-10-08T16:03:54.325 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b8e7fc700 1 -- 172.21.15.190:0/2355641906 learned_addr learned my addr 172.21.15.190:0/2355641906 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-10-08T16:03:54.325 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b8effd700 1 --2- 172.21.15.190:0/2355641906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b900b63c0 0x7f3b900b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:54.325 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b8f7fe700 1 --2- 172.21.15.190:0/2355641906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b90143080 0x7f3b90062ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:54.325 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b8e7fc700 1 -- 172.21.15.190:0/2355641906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b90143080 msgr2=0x7f3b90062ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:54.325 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b8e7fc700 1 --2- 172.21.15.190:0/2355641906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b90143080 0x7f3b90062ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.325 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b8e7fc700 1 -- 172.21.15.190:0/2355641906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b900b63c0 msgr2=0x7f3b900b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:54.325 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b8e7fc700 1 --2- 172.21.15.190:0/2355641906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b900b63c0 0x7f3b900b1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.325 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b8e7fc700 1 -- 172.21.15.190:0/2355641906 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b88009ae0 con 0x7f3b900b6790 2023-10-08T16:03:54.325 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b8e7fc700 1 --2- 172.21.15.190:0/2355641906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b900b6790 0x7f3b90153580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3b8400ecb0 tx=0x7f3b840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:03:54.326 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b76ffd700 1 -- 172.21.15.190:0/2355641906 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8400c850 con 0x7f3b900b6790 2023-10-08T16:03:54.326 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b76ffd700 1 -- 172.21.15.190:0/2355641906 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8400c9b0 con 0x7f3b900b6790 2023-10-08T16:03:54.326 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b952e7700 1 -- 172.21.15.190:0/2355641906 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b800093c0 con 0x7f3b900b6790 2023-10-08T16:03:54.326 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b76ffd700 1 -- 172.21.15.190:0/2355641906 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8400cd50 con 0x7f3b900b6790 2023-10-08T16:03:54.326 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.315+0000 7f3b952e7700 1 -- 172.21.15.190:0/2355641906 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b900afb20 con 0x7f3b900b6790 2023-10-08T16:03:54.326 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.319+0000 7f3b76ffd700 1 -- 172.21.15.190:0/2355641906 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f3b84013900 con 0x7f3b900b6790 2023-10-08T16:03:54.326 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.319+0000 7f3b76ffd700 1 -- 172.21.15.190:0/2355641906 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f3b8401cac0 con 0x7f3b900b6790 2023-10-08T16:03:54.326 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.319+0000 7f3b952e7700 1 -- 172.21.15.190:0/2355641906 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b9013c6b0 con 0x7f3b900b6790 2023-10-08T16:03:54.328 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.323+0000 7f3b76ffd700 1 -- 172.21.15.190:0/2355641906 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f3b9013c6b0 con 0x7f3b900b6790 2023-10-08T16:03:54.406 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.399+0000 7f3b952e7700 1 -- 172.21.15.190:0/2355641906 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "05f072e0-7bc0-40f0-8cb6-8e322c82d6d6", "id": 5} v 0) v1 -- 0x7f3b90064810 con 0x7f3b900b6790 2023-10-08T16:03:54.414 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.407+0000 7f3b76ffd700 1 -- 172.21.15.190:0/2355641906 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "05f072e0-7bc0-40f0-8cb6-8e322c82d6d6", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3b8402b0b0 con 0x7f3b900b6790 2023-10-08T16:03:54.414 INFO:teuthology.orchestra.run.smithi190.stdout:5 2023-10-08T16:03:54.416 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.407+0000 7f3b952e7700 1 -- 172.21.15.190:0/2355641906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b900b6790 msgr2=0x7f3b90153580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:54.416 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.407+0000 7f3b952e7700 1 --2- 172.21.15.190:0/2355641906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b900b6790 0x7f3b90153580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3b8400ecb0 tx=0x7f3b840091a0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.416 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.411+0000 7f3b952e7700 1 -- 172.21.15.190:0/2355641906 shutdown_connections 2023-10-08T16:03:54.416 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.411+0000 7f3b952e7700 1 --2- 172.21.15.190:0/2355641906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b90143080 0x7f3b90062ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.416 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.411+0000 7f3b952e7700 1 --2- 172.21.15.190:0/2355641906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b900b6790 0x7f3b90153580 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.416 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.411+0000 7f3b952e7700 1 --2- 172.21.15.190:0/2355641906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b900b63c0 0x7f3b900b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.416 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.411+0000 7f3b952e7700 1 -- 172.21.15.190:0/2355641906 >> 172.21.15.190:0/2355641906 conn(0x7f3b9006adf0 msgr2=0x7f3b900676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:03:54.416 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.411+0000 7f3b952e7700 1 -- 172.21.15.190:0/2355641906 shutdown_connections 2023-10-08T16:03:54.416 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.411+0000 7f3b952e7700 1 -- 172.21.15.190:0/2355641906 wait complete. 2023-10-08T16:03:54.427 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 1bcce8d7-14f3-442d-b135-68c7d66cdedc 6 2023-10-08T16:03:54.529 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.523+0000 7f24eb59e700 1 Processor -- start 2023-10-08T16:03:54.529 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.523+0000 7f24eb59e700 1 -- start start 2023-10-08T16:03:54.531 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.523+0000 7f24eb59e700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f24ec143ef0 0x7f24ec069350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:54.531 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.523+0000 7f24eb59e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24ec0b2480 0x7f24ec0b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:54.531 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.523+0000 7f24eb59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24ec069a20 con 0x7f24ec062dd0 2023-10-08T16:03:54.531 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.523+0000 7f24eb59e700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24ec0b0d00 con 0x7f24ec143ef0 2023-10-08T16:03:54.531 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.523+0000 7f24eb59e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec0b2060 con 0x7f24ec0b2480 2023-10-08T16:03:54.532 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.523+0000 7f24e9d9b700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f24ec143ef0 0x7f24ec069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:54.532 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.523+0000 7f24ead9d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24ec0b2480 0x7f24ec0b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:54.532 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.523+0000 7f24e9d9b700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f24ec143ef0 0x7f24ec069350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:45036/0 (socket says 172.21.15.190:45036) 2023-10-08T16:03:54.532 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.523+0000 7f24e9d9b700 1 -- 172.21.15.190:0/4036886956 learned_addr learned my addr 172.21.15.190:0/4036886956 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-10-08T16:03:54.532 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.523+0000 7f24e9d9b700 1 -- 172.21.15.190:0/4036886956 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24ec0b2480 msgr2=0x7f24ec0b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:03:54.532 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.523+0000 7f24e9d9b700 1 --2- 172.21.15.190:0/4036886956 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24ec0b2480 0x7f24ec0b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.532 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.523+0000 7f24e9d9b700 1 -- 172.21.15.190:0/4036886956 >> v1:172.21.15.133:6789/0 conn(0x7f24ec062dd0 legacy=0x7f24ec1437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:54.532 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.523+0000 7f24e9d9b700 1 -- 172.21.15.190:0/4036886956 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ec0b0990 con 0x7f24ec143ef0 2023-10-08T16:03:54.532 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.527+0000 7f24e9d9b700 1 --2- 172.21.15.190:0/4036886956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24ec143ef0 0x7f24ec069350 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f24e00099b0 tx=0x7f24e0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b351d1f8b41e72a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:03:54.533 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.527+0000 7f24e959a700 1 -- 172.21.15.190:0/4036886956 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e0009ea0 con 0x7f24ec143ef0 2023-10-08T16:03:54.534 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.527+0000 7f24e959a700 1 -- 172.21.15.190:0/4036886956 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e000b860 con 0x7f24ec143ef0 2023-10-08T16:03:54.534 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.527+0000 7f24e959a700 1 -- 172.21.15.190:0/4036886956 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e000bc20 con 0x7f24ec143ef0 2023-10-08T16:03:54.534 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.527+0000 7f24eb59e700 1 -- 172.21.15.190:0/4036886956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24ec143ef0 msgr2=0x7f24ec069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:54.534 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.527+0000 7f24eb59e700 1 --2- 172.21.15.190:0/4036886956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24ec143ef0 0x7f24ec069350 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f24e00099b0 tx=0x7f24e0009250 comp rx=0 tx=0).stop 2023-10-08T16:03:54.534 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.527+0000 7f24eb59e700 1 -- 172.21.15.190:0/4036886956 shutdown_connections 2023-10-08T16:03:54.534 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.527+0000 7f24eb59e700 1 --2- 172.21.15.190:0/4036886956 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24ec0b2480 0x7f24ec0b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.534 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.527+0000 7f24eb59e700 1 --2- 172.21.15.190:0/4036886956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24ec143ef0 0x7f24ec069350 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.534 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.527+0000 7f24eb59e700 1 -- 172.21.15.190:0/4036886956 >> 172.21.15.190:0/4036886956 conn(0x7f24ec0679e0 msgr2=0x7f24ec068c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:03:54.534 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.527+0000 7f24eb59e700 1 -- 172.21.15.190:0/4036886956 shutdown_connections 2023-10-08T16:03:54.534 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.527+0000 7f24eb59e700 1 -- 172.21.15.190:0/4036886956 wait complete. 2023-10-08T16:03:54.535 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.527+0000 7f24eb59e700 1 Processor -- start 2023-10-08T16:03:54.535 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.527+0000 7f24eb59e700 1 -- start start 2023-10-08T16:03:54.537 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.531+0000 7f24eb59e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24ec062dd0 0x7f24ec150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:54.538 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.531+0000 7f24eb59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24ec0b2480 0x7f24ec142730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:54.538 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.531+0000 7f24eb59e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24ec143ef0 0x7f24ec13b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:54.538 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.531+0000 7f24eb59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec13ab80 con 0x7f24ec0b2480 2023-10-08T16:03:54.538 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.531+0000 7f24eb59e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec150770 con 0x7f24ec062dd0 2023-10-08T16:03:54.538 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.531+0000 7f24eb59e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec150a50 con 0x7f24ec143ef0 2023-10-08T16:03:54.538 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.531+0000 7f24ea59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24ec062dd0 0x7f24ec150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:54.538 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.531+0000 7f24ea59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24ec062dd0 0x7f24ec150110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:45044/0 (socket says 172.21.15.190:45044) 2023-10-08T16:03:54.538 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.531+0000 7f24ea59c700 1 -- 172.21.15.190:0/2117511345 learned_addr learned my addr 172.21.15.190:0/2117511345 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-10-08T16:03:54.538 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.531+0000 7f24ead9d700 1 --2- 172.21.15.190:0/2117511345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24ec143ef0 0x7f24ec13b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:54.539 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.531+0000 7f24e9d9b700 1 --2- 172.21.15.190:0/2117511345 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24ec0b2480 0x7f24ec142730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:54.539 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.531+0000 7f24ea59c700 1 -- 172.21.15.190:0/2117511345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24ec143ef0 msgr2=0x7f24ec13b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:54.539 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.531+0000 7f24ea59c700 1 --2- 172.21.15.190:0/2117511345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24ec143ef0 0x7f24ec13b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.539 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.531+0000 7f24ea59c700 1 -- 172.21.15.190:0/2117511345 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24ec0b2480 msgr2=0x7f24ec142730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:54.539 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.531+0000 7f24ea59c700 1 --2- 172.21.15.190:0/2117511345 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24ec0b2480 0x7f24ec142730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.539 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.531+0000 7f24ea59c700 1 -- 172.21.15.190:0/2117511345 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e00094f0 con 0x7f24ec062dd0 2023-10-08T16:03:54.539 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.531+0000 7f24ead9d700 1 --2- 172.21.15.190:0/2117511345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24ec143ef0 0x7f24ec13b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:03:54.539 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.531+0000 7f24ea59c700 1 --2- 172.21.15.190:0/2117511345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24ec062dd0 0x7f24ec150110 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f24dc00c590 tx=0x7f24dc00c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:03:54.539 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.531+0000 7f24da7fc700 1 -- 172.21.15.190:0/2117511345 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24dc011590 con 0x7f24ec062dd0 2023-10-08T16:03:54.539 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.531+0000 7f24da7fc700 1 -- 172.21.15.190:0/2117511345 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24dc011710 con 0x7f24ec062dd0 2023-10-08T16:03:54.539 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.531+0000 7f24da7fc700 1 -- 172.21.15.190:0/2117511345 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24dc011ad0 con 0x7f24ec062dd0 2023-10-08T16:03:54.540 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.531+0000 7f24eb59e700 1 -- 172.21.15.190:0/2117511345 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24ec0b0360 con 0x7f24ec062dd0 2023-10-08T16:03:54.540 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.531+0000 7f24eb59e700 1 -- 172.21.15.190:0/2117511345 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24ec13b570 con 0x7f24ec062dd0 2023-10-08T16:03:54.540 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.531+0000 7f24da7fc700 1 -- 172.21.15.190:0/2117511345 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f24dc01c6c0 con 0x7f24ec062dd0 2023-10-08T16:03:54.540 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.531+0000 7f24da7fc700 1 -- 172.21.15.190:0/2117511345 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f24dc001120 con 0x7f24ec062dd0 2023-10-08T16:03:54.540 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.531+0000 7f24eb59e700 1 -- 172.21.15.190:0/2117511345 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24ec13ad50 con 0x7f24ec062dd0 2023-10-08T16:03:54.542 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.535+0000 7f24da7fc700 1 -- 172.21.15.190:0/2117511345 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f24ec13ad50 con 0x7f24ec062dd0 2023-10-08T16:03:54.613 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.607+0000 7f24eb59e700 1 -- 172.21.15.190:0/2117511345 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1bcce8d7-14f3-442d-b135-68c7d66cdedc", "id": 6} v 0) v1 -- 0x7f24ec04be40 con 0x7f24ec062dd0 2023-10-08T16:03:54.623 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.619+0000 7f24da7fc700 1 -- 172.21.15.190:0/2117511345 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1bcce8d7-14f3-442d-b135-68c7d66cdedc", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f24dc017070 con 0x7f24ec062dd0 2023-10-08T16:03:54.623 INFO:teuthology.orchestra.run.smithi190.stdout:6 2023-10-08T16:03:54.625 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.619+0000 7f24eb59e700 1 -- 172.21.15.190:0/2117511345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24ec062dd0 msgr2=0x7f24ec150110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:54.625 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.619+0000 7f24eb59e700 1 --2- 172.21.15.190:0/2117511345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24ec062dd0 0x7f24ec150110 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f24dc00c590 tx=0x7f24dc00c8a0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.626 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.619+0000 7f24eb59e700 1 -- 172.21.15.190:0/2117511345 shutdown_connections 2023-10-08T16:03:54.626 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.619+0000 7f24eb59e700 1 --2- 172.21.15.190:0/2117511345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24ec143ef0 0x7f24ec13b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.626 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.619+0000 7f24eb59e700 1 --2- 172.21.15.190:0/2117511345 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24ec0b2480 0x7f24ec142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.626 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.619+0000 7f24eb59e700 1 --2- 172.21.15.190:0/2117511345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24ec062dd0 0x7f24ec150110 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.626 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.619+0000 7f24eb59e700 1 -- 172.21.15.190:0/2117511345 >> 172.21.15.190:0/2117511345 conn(0x7f24ec0679e0 msgr2=0x7f24ec138f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:03:54.626 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.619+0000 7f24eb59e700 1 -- 172.21.15.190:0/2117511345 shutdown_connections 2023-10-08T16:03:54.626 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.619+0000 7f24eb59e700 1 -- 172.21.15.190:0/2117511345 wait complete. 2023-10-08T16:03:54.641 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 9157dbf7-2bf9-43d7-a89a-a8e3dae7514c 7 2023-10-08T16:03:54.661 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-10-08T16:03:54.660+0000 7f447afd7000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:03:54.688 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-10-08T16:03:54.683+0000 7fa4caaa4000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:03:54.743 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.735+0000 7fd1dfe0f700 1 Processor -- start 2023-10-08T16:03:54.743 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.735+0000 7fd1dfe0f700 1 -- start start 2023-10-08T16:03:54.745 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.739+0000 7fd1dfe0f700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd1d80b5800 0x7fd1d80b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:54.745 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.739+0000 7fd1dfe0f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1d80b48f0 0x7fd1d80b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:54.745 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.739+0000 7fd1dfe0f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d80b6110 con 0x7fd1d8142600 2023-10-08T16:03:54.745 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.739+0000 7fd1dfe0f700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d80b2870 con 0x7fd1d80b5800 2023-10-08T16:03:54.746 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.739+0000 7fd1dfe0f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d80b2070 con 0x7fd1d80b48f0 2023-10-08T16:03:54.746 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.739+0000 7fd1de3ac700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1d80b48f0 0x7fd1d80b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:54.746 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.739+0000 7fd1ddbab700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd1d80b5800 0x7fd1d80b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:54.746 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.739+0000 7fd1de3ac700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1d80b48f0 0x7fd1d80b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:55842/0 (socket says 172.21.15.190:55842) 2023-10-08T16:03:54.746 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.739+0000 7fd1de3ac700 1 -- 172.21.15.190:0/1719474098 learned_addr learned my addr 172.21.15.190:0/1719474098 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-10-08T16:03:54.746 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.739+0000 7fd1de3ac700 1 -- 172.21.15.190:0/1719474098 >> v2:172.21.15.190:3300/0 conn(0x7fd1d80b5800 msgr2=0x7fd1d80b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:03:54.746 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.739+0000 7fd1de3ac700 1 --2- 172.21.15.190:0/1719474098 >> v2:172.21.15.190:3300/0 conn(0x7fd1d80b5800 0x7fd1d80b5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.746 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.739+0000 7fd1de3ac700 1 -- 172.21.15.190:0/1719474098 >> v1:172.21.15.133:6789/0 conn(0x7fd1d8142600 legacy=0x7fd1d80b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:54.746 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.739+0000 7fd1de3ac700 1 -- 172.21.15.190:0/1719474098 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d80b0e10 con 0x7fd1d80b48f0 2023-10-08T16:03:54.746 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.739+0000 7fd1de3ac700 1 --2- 172.21.15.190:0/1719474098 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1d80b48f0 0x7fd1d80b4d70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009f20 tx=0x7fd1d0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d86f63008fdf4e24 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:03:54.747 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.739+0000 7fd1dcba9700 1 -- 172.21.15.190:0/1719474098 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d000e070 con 0x7fd1d80b48f0 2023-10-08T16:03:54.747 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.739+0000 7fd1dcba9700 1 -- 172.21.15.190:0/1719474098 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d000b9d0 con 0x7fd1d80b48f0 2023-10-08T16:03:54.747 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.739+0000 7fd1dcba9700 1 -- 172.21.15.190:0/1719474098 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d00092e0 con 0x7fd1d80b48f0 2023-10-08T16:03:54.747 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.739+0000 7fd1dfe0f700 1 -- 172.21.15.190:0/1719474098 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1d80b48f0 msgr2=0x7fd1d80b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:54.748 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.739+0000 7fd1dfe0f700 1 --2- 172.21.15.190:0/1719474098 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1d80b48f0 0x7fd1d80b4d70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009f20 tx=0x7fd1d0009840 comp rx=0 tx=0).stop 2023-10-08T16:03:54.748 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.739+0000 7fd1dfe0f700 1 -- 172.21.15.190:0/1719474098 shutdown_connections 2023-10-08T16:03:54.748 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.739+0000 7fd1dfe0f700 1 --2- 172.21.15.190:0/1719474098 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1d80b48f0 0x7fd1d80b4d70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.748 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.739+0000 7fd1dfe0f700 1 --2- 172.21.15.190:0/1719474098 >> v2:172.21.15.190:3300/0 conn(0x7fd1d80b5800 0x7fd1d80b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.748 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.739+0000 7fd1dfe0f700 1 -- 172.21.15.190:0/1719474098 >> 172.21.15.190:0/1719474098 conn(0x7fd1d8062ba0 msgr2=0x7fd1d8062fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:03:54.748 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.739+0000 7fd1dfe0f700 1 -- 172.21.15.190:0/1719474098 shutdown_connections 2023-10-08T16:03:54.748 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.739+0000 7fd1dfe0f700 1 -- 172.21.15.190:0/1719474098 wait complete. 2023-10-08T16:03:54.748 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.743+0000 7fd1dfe0f700 1 Processor -- start 2023-10-08T16:03:54.749 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.743+0000 7fd1dfe0f700 1 -- start start 2023-10-08T16:03:54.751 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.743+0000 7fd1dfe0f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1d80b48f0 0x7fd1d8145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:54.751 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.743+0000 7fd1dfe0f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1d80b5800 0x7fd1d813e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:54.751 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.743+0000 7fd1dfe0f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1d8142600 0x7fd1d813eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:54.751 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.743+0000 7fd1dfe0f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d80a5d70 con 0x7fd1d80b48f0 2023-10-08T16:03:54.751 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.743+0000 7fd1dfe0f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d80af460 con 0x7fd1d80b5800 2023-10-08T16:03:54.751 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.743+0000 7fd1dfe0f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d8145b80 con 0x7fd1d8142600 2023-10-08T16:03:54.751 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.743+0000 7fd1de3ac700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1d8142600 0x7fd1d813eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:54.751 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.743+0000 7fd1dd3aa700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1d80b5800 0x7fd1d813e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:54.752 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.743+0000 7fd1de3ac700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1d8142600 0x7fd1d813eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:55854/0 (socket says 172.21.15.190:55854) 2023-10-08T16:03:54.752 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.743+0000 7fd1de3ac700 1 -- 172.21.15.190:0/1103045528 learned_addr learned my addr 172.21.15.190:0/1103045528 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-10-08T16:03:54.752 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.743+0000 7fd1ddbab700 1 --2- 172.21.15.190:0/1103045528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1d80b48f0 0x7fd1d8145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:54.752 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.743+0000 7fd1de3ac700 1 -- 172.21.15.190:0/1103045528 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1d80b5800 msgr2=0x7fd1d813e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:54.752 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.743+0000 7fd1de3ac700 1 --2- 172.21.15.190:0/1103045528 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1d80b5800 0x7fd1d813e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.752 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.743+0000 7fd1de3ac700 1 -- 172.21.15.190:0/1103045528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1d80b48f0 msgr2=0x7fd1d8145640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:54.752 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.743+0000 7fd1de3ac700 1 --2- 172.21.15.190:0/1103045528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1d80b48f0 0x7fd1d8145640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.752 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.743+0000 7fd1de3ac700 1 -- 172.21.15.190:0/1103045528 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d0009ae0 con 0x7fd1d8142600 2023-10-08T16:03:54.752 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.743+0000 7fd1de3ac700 1 --2- 172.21.15.190:0/1103045528 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1d8142600 0x7fd1d813eab0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000b610 tx=0x7fd1d0018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:03:54.752 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.743+0000 7fd1cdffb700 1 -- 172.21.15.190:0/1103045528 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0008ad0 con 0x7fd1d8142600 2023-10-08T16:03:54.752 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.743+0000 7fd1cdffb700 1 -- 172.21.15.190:0/1103045528 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d0008c30 con 0x7fd1d8142600 2023-10-08T16:03:54.753 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.743+0000 7fd1dfe0f700 1 -- 172.21.15.190:0/1103045528 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d80a6250 con 0x7fd1d8142600 2023-10-08T16:03:54.753 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.743+0000 7fd1cdffb700 1 -- 172.21.15.190:0/1103045528 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0026460 con 0x7fd1d8142600 2023-10-08T16:03:54.753 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.743+0000 7fd1dfe0f700 1 -- 172.21.15.190:0/1103045528 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d813fd00 con 0x7fd1d8142600 2023-10-08T16:03:54.753 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.743+0000 7fd1cdffb700 1 -- 172.21.15.190:0/1103045528 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd1d0003040 con 0x7fd1d8142600 2023-10-08T16:03:54.753 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.743+0000 7fd1cdffb700 1 -- 172.21.15.190:0/1103045528 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fd1d0026d50 con 0x7fd1d8142600 2023-10-08T16:03:54.755 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.751+0000 7fd1dfe0f700 1 -- 172.21.15.190:0/1103045528 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d8064810 con 0x7fd1d8142600 2023-10-08T16:03:54.760 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.755+0000 7fd1cdffb700 1 -- 172.21.15.190:0/1103045528 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fd1d002b020 con 0x7fd1d8142600 2023-10-08T16:03:54.773 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-10-08T16:03:54.772+0000 7f447afd7000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:03:54.810 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-10-08T16:03:54.803+0000 7fa4caaa4000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:03:54.833 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.827+0000 7fd1dfe0f700 1 -- 172.21.15.190:0/1103045528 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9157dbf7-2bf9-43d7-a89a-a8e3dae7514c", "id": 7} v 0) v1 -- 0x7fd1d8140610 con 0x7fd1d8142600 2023-10-08T16:03:54.842 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.835+0000 7fd1cdffb700 1 -- 172.21.15.190:0/1103045528 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9157dbf7-2bf9-43d7-a89a-a8e3dae7514c", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd1d0021070 con 0x7fd1d8142600 2023-10-08T16:03:54.842 INFO:teuthology.orchestra.run.smithi190.stdout:7 2023-10-08T16:03:54.843 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.835+0000 7fd1dfe0f700 1 -- 172.21.15.190:0/1103045528 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1d8142600 msgr2=0x7fd1d813eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:54.844 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.835+0000 7fd1dfe0f700 1 --2- 172.21.15.190:0/1103045528 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1d8142600 0x7fd1d813eab0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000b610 tx=0x7fd1d0018000 comp rx=0 tx=0).stop 2023-10-08T16:03:54.844 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.839+0000 7fd1dfe0f700 1 -- 172.21.15.190:0/1103045528 shutdown_connections 2023-10-08T16:03:54.844 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.839+0000 7fd1dfe0f700 1 --2- 172.21.15.190:0/1103045528 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1d8142600 0x7fd1d813eab0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.844 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.839+0000 7fd1dfe0f700 1 --2- 172.21.15.190:0/1103045528 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1d80b5800 0x7fd1d813e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.844 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.839+0000 7fd1dfe0f700 1 --2- 172.21.15.190:0/1103045528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1d80b48f0 0x7fd1d8145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.844 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.839+0000 7fd1dfe0f700 1 -- 172.21.15.190:0/1103045528 >> 172.21.15.190:0/1103045528 conn(0x7fd1d8062ba0 msgr2=0x7fd1d806fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:03:54.844 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.839+0000 7fd1dfe0f700 1 -- 172.21.15.190:0/1103045528 shutdown_connections 2023-10-08T16:03:54.844 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-08T16:03:54.839+0000 7fd1dfe0f700 1 -- 172.21.15.190:0/1103045528 wait complete. 2023-10-08T16:03:54.855 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-08T16:03:54.855 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-08T16:03:54.857 INFO:tasks.ceph.osd.0:Started 2023-10-08T16:03:54.857 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-08T16:03:54.857 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-08T16:03:54.860 INFO:tasks.ceph.osd.1:Started 2023-10-08T16:03:54.860 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-08T16:03:54.860 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-08T16:03:54.862 INFO:tasks.ceph.osd.2:Started 2023-10-08T16:03:54.862 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-08T16:03:54.862 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-08T16:03:54.864 INFO:tasks.ceph.osd.3:Started 2023-10-08T16:03:54.865 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-08T16:03:54.865 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-08T16:03:54.867 INFO:tasks.ceph.osd.4:Started 2023-10-08T16:03:54.867 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-08T16:03:54.867 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-08T16:03:54.869 INFO:tasks.ceph.osd.5:Started 2023-10-08T16:03:54.869 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-08T16:03:54.869 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-08T16:03:54.871 INFO:tasks.ceph.osd.6:Started 2023-10-08T16:03:54.871 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-08T16:03:54.871 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-08T16:03:54.873 INFO:tasks.ceph.osd.7:Started 2023-10-08T16:03:54.873 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:03:54.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.980+0000 7f9f8972b700 1 Processor -- start 2023-10-08T16:03:54.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.980+0000 7f9f8972b700 1 -- start start 2023-10-08T16:03:54.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.980+0000 7f9f8972b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f840634e0 0x7f9f84142680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:54.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.980+0000 7f9f8972b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9f8413c680 0x7f9f84142bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:54.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.980+0000 7f9f8972b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f840b4fd0 con 0x7f9f840b43c0 2023-10-08T16:03:54.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.980+0000 7f9f8972b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f840b4790 con 0x7f9f8413c680 2023-10-08T16:03:54.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.980+0000 7f9f8972b700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f840b18e0 con 0x7f9f840634e0 2023-10-08T16:03:54.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.980+0000 7f9f88f2a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9f8413c680 0x7f9f84142bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:54.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.980+0000 7f9f88f2a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9f8413c680 0x7f9f84142bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35208/0 (socket says 172.21.15.133:35208) 2023-10-08T16:03:54.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.980+0000 7f9f88f2a700 1 -- 172.21.15.133:0/2398308309 learned_addr learned my addr 172.21.15.133:0/2398308309 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:03:54.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.980+0000 7f9f83fff700 1 --2- 172.21.15.133:0/2398308309 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f840634e0 0x7f9f84142680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:54.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.980+0000 7f9f88f2a700 1 -- 172.21.15.133:0/2398308309 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f840634e0 msgr2=0x7f9f84142680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:03:54.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.980+0000 7f9f88f2a700 1 --2- 172.21.15.133:0/2398308309 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f840634e0 0x7f9f84142680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.980+0000 7f9f88f2a700 1 -- 172.21.15.133:0/2398308309 >> v1:172.21.15.133:6789/0 conn(0x7f9f840b43c0 legacy=0x7f9f8413bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:54.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.980+0000 7f9f88f2a700 1 -- 172.21.15.133:0/2398308309 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f840b4980 con 0x7f9f8413c680 2023-10-08T16:03:54.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.980+0000 7f9f88f2a700 1 --2- 172.21.15.133:0/2398308309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f8413c680 0x7f9f84142bc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c009f20 tx=0x7f9f7c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8fc6e42a58e72 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:03:54.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.980+0000 7f9f82ffd700 1 -- 172.21.15.133:0/2398308309 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c00e070 con 0x7f9f8413c680 2023-10-08T16:03:54.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.980+0000 7f9f82ffd700 1 -- 172.21.15.133:0/2398308309 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c00b9d0 con 0x7f9f8413c680 2023-10-08T16:03:54.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.980+0000 7f9f82ffd700 1 -- 172.21.15.133:0/2398308309 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c0092e0 con 0x7f9f8413c680 2023-10-08T16:03:54.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f8972b700 1 -- 172.21.15.133:0/2398308309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f8413c680 msgr2=0x7f9f84142bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:54.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f8972b700 1 --2- 172.21.15.133:0/2398308309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f8413c680 0x7f9f84142bc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c009f20 tx=0x7f9f7c009840 comp rx=0 tx=0).stop 2023-10-08T16:03:54.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f8972b700 1 -- 172.21.15.133:0/2398308309 shutdown_connections 2023-10-08T16:03:54.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f8972b700 1 --2- 172.21.15.133:0/2398308309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f8413c680 0x7f9f84142bc0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f8972b700 1 --2- 172.21.15.133:0/2398308309 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f840634e0 0x7f9f84142680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f8972b700 1 -- 172.21.15.133:0/2398308309 >> 172.21.15.133:0/2398308309 conn(0x7f9f84067ca0 msgr2=0x7f9f84062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:03:54.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f8972b700 1 -- 172.21.15.133:0/2398308309 shutdown_connections 2023-10-08T16:03:54.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f8972b700 1 -- 172.21.15.133:0/2398308309 wait complete. 2023-10-08T16:03:54.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f8972b700 1 Processor -- start 2023-10-08T16:03:54.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f8972b700 1 -- start start 2023-10-08T16:03:54.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f8972b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f840634e0 0x7f9f84143b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:54.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f8972b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f840b43c0 0x7f9f8413db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:54.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f8972b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f8413c680 0x7f9f8413e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:54.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f8972b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f84144390 con 0x7f9f840634e0 2023-10-08T16:03:54.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f8972b700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f84145280 con 0x7f9f840b43c0 2023-10-08T16:03:54.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f8972b700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f841464d0 con 0x7f9f8413c680 2023-10-08T16:03:54.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f83fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f840634e0 0x7f9f84143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:54.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f83fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f840634e0 0x7f9f84143b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35224/0 (socket says 172.21.15.133:35224) 2023-10-08T16:03:54.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f83fff700 1 -- 172.21.15.133:0/2219981978 learned_addr learned my addr 172.21.15.133:0/2219981978 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:03:54.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f88f2a700 1 --2- 172.21.15.133:0/2219981978 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f8413c680 0x7f9f8413e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:54.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f837fe700 1 --2- 172.21.15.133:0/2219981978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f840b43c0 0x7f9f8413db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:54.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f83fff700 1 -- 172.21.15.133:0/2219981978 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f8413c680 msgr2=0x7f9f8413e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:54.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f83fff700 1 --2- 172.21.15.133:0/2219981978 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f8413c680 0x7f9f8413e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f83fff700 1 -- 172.21.15.133:0/2219981978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f840b43c0 msgr2=0x7f9f8413db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:54.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f83fff700 1 --2- 172.21.15.133:0/2219981978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f840b43c0 0x7f9f8413db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:54.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f83fff700 1 -- 172.21.15.133:0/2219981978 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c009ae0 con 0x7f9f840634e0 2023-10-08T16:03:54.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f83fff700 1 --2- 172.21.15.133:0/2219981978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f840634e0 0x7f9f84143b50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9f7400ec80 tx=0x7f9f740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:03:54.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f6bfff700 1 -- 172.21.15.133:0/2219981978 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f74009690 con 0x7f9f840634e0 2023-10-08T16:03:54.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f6bfff700 1 -- 172.21.15.133:0/2219981978 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7400c850 con 0x7f9f840634e0 2023-10-08T16:03:54.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f8972b700 1 -- 172.21.15.133:0/2219981978 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f84146260 con 0x7f9f840634e0 2023-10-08T16:03:54.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f6bfff700 1 -- 172.21.15.133:0/2219981978 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7400cc10 con 0x7f9f840634e0 2023-10-08T16:03:54.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f8972b700 1 -- 172.21.15.133:0/2219981978 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f84144f10 con 0x7f9f840634e0 2023-10-08T16:03:54.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f6bfff700 1 -- 172.21.15.133:0/2219981978 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9f74005c80 con 0x7f9f840634e0 2023-10-08T16:03:54.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.984+0000 7f9f6bfff700 1 -- 172.21.15.133:0/2219981978 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f9f740066b0 con 0x7f9f840634e0 2023-10-08T16:03:54.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.992+0000 7f9f8972b700 1 -- 172.21.15.133:0/2219981978 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f8404be40 con 0x7f9f840634e0 2023-10-08T16:03:54.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:54.992+0000 7f9f6bfff700 1 -- 172.21.15.133:0/2219981978 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9f74021060 con 0x7f9f840634e0 2023-10-08T16:03:55.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:55.056+0000 7f9f8972b700 1 -- 172.21.15.133:0/2219981978 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f840b03b0 con 0x7f9f840634e0 2023-10-08T16:03:55.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:55.056+0000 7f9f6bfff700 1 -- 172.21.15.133:0/2219981978 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f9f74017070 con 0x7f9f840634e0 2023-10-08T16:03:55.060 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:03:55.061 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":10,"fsid":"f2546191-d59e-4805-8e1b-3d8d3d1dad86","created":"2023-10-08T16:03:52.631855+0000","modified":"2023-10-08T16:03:54.835293+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T16:03:54.835293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"8c5deadf-a203-4d30-aa7f-6e2e492b6ffc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9b081c42-c915-48c3-a1ad-410f09a78576","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"88ecda43-01cd-4644-ab0c-92c91fd38966","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"39faf38d-b8e2-4e11-9b3b-84dc834c977c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4c097e61-1cad-4b61-9183-4e7bc486bd32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"05f072e0-7bc0-40f0-8cb6-8e322c82d6d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1bcce8d7-14f3-442d-b135-68c7d66cdedc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9157dbf7-2bf9-43d7-a89a-a8e3dae7514c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:03:55.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:55.060+0000 7f9f8972b700 1 -- 172.21.15.133:0/2219981978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f840634e0 msgr2=0x7f9f84143b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:55.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:55.060+0000 7f9f8972b700 1 --2- 172.21.15.133:0/2219981978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f840634e0 0x7f9f84143b50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9f7400ec80 tx=0x7f9f740091a0 comp rx=0 tx=0).stop 2023-10-08T16:03:55.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:55.060+0000 7f9f8972b700 1 -- 172.21.15.133:0/2219981978 shutdown_connections 2023-10-08T16:03:55.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:55.060+0000 7f9f8972b700 1 --2- 172.21.15.133:0/2219981978 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f8413c680 0x7f9f8413e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:55.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:55.060+0000 7f9f8972b700 1 --2- 172.21.15.133:0/2219981978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f840b43c0 0x7f9f8413db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:55.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:55.060+0000 7f9f8972b700 1 --2- 172.21.15.133:0/2219981978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f840634e0 0x7f9f84143b50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:55.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:55.060+0000 7f9f8972b700 1 -- 172.21.15.133:0/2219981978 >> 172.21.15.133:0/2219981978 conn(0x7f9f84067ca0 msgr2=0x7f9f8406fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:03:55.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:55.060+0000 7f9f8972b700 1 -- 172.21.15.133:0/2219981978 shutdown_connections 2023-10-08T16:03:55.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:03:55.060+0000 7f9f8972b700 1 -- 172.21.15.133:0/2219981978 wait complete. 2023-10-08T16:03:55.073 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-08T16:03:55.073 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-08T16:03:55.106 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-10-08T16:03:55.104+0000 7f447afd7000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:03:55.145 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-10-08T16:03:55.139+0000 7fa4caaa4000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:03:55.230 INFO:tasks.ceph.osd.1.smithi133.stderr:2023-10-08T16:03:55.228+0000 7f20e71a63c0 -1 Falling back to public interface 2023-10-08T16:03:55.238 INFO:tasks.ceph.osd.3.smithi133.stderr:2023-10-08T16:03:55.236+0000 7f24197e63c0 -1 Falling back to public interface 2023-10-08T16:03:55.239 INFO:tasks.ceph.osd.0.smithi133.stderr:2023-10-08T16:03:55.236+0000 7f66490d53c0 -1 Falling back to public interface 2023-10-08T16:03:55.239 INFO:tasks.ceph.osd.3.smithi133.stderr:2023-10-08T16:03:55.236+0000 7f24187af700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6809/0: (98) Address already in use 2023-10-08T16:03:55.248 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-10-08T16:03:55.243+0000 7f9fa2d383c0 -1 Falling back to public interface 2023-10-08T16:03:55.250 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-10-08T16:03:55.243+0000 7f00f07373c0 -1 Falling back to public interface 2023-10-08T16:03:55.250 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-10-08T16:03:55.243+0000 7fd46913f3c0 -1 Falling back to public interface 2023-10-08T16:03:55.272 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-10-08T16:03:55.268+0000 7f447afd7000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:03:55.313 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-10-08T16:03:55.307+0000 7fa4caaa4000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:03:55.337 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-10-08T16:03:55.336+0000 7f447afd7000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:03:55.373 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-10-08T16:03:55.367+0000 7fa4caaa4000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:03:55.388 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-10-08T16:03:55.384+0000 7f447afd7000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:03:55.425 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-10-08T16:03:55.419+0000 7fa4caaa4000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:03:55.442 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-10-08T16:03:55.440+0000 7f447afd7000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:03:55.478 INFO:tasks.ceph.osd.2.smithi133.stderr:2023-10-08T16:03:55.476+0000 7fb15913c3c0 -1 Falling back to public interface 2023-10-08T16:03:55.481 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-10-08T16:03:55.475+0000 7fa4caaa4000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:03:55.505 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-10-08T16:03:55.499+0000 7f6dae9dd3c0 -1 Falling back to public interface 2023-10-08T16:03:55.736 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-10-08T16:03:55.732+0000 7f447afd7000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:03:55.758 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-10-08T16:03:55.751+0000 7fa4caaa4000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:03:55.792 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-10-08T16:03:55.788+0000 7f447afd7000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:03:55.814 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-10-08T16:03:55.807+0000 7fa4caaa4000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:03:55.857 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-10-08T16:03:55.856+0000 7f447afd7000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:03:55.879 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T16:03:55.879 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-10-08T16:03:55.871+0000 7fa4caaa4000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:03:55.971 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.968+0000 7fc8d2c73700 1 Processor -- start 2023-10-08T16:03:55.971 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.968+0000 7fc8d2c73700 1 -- start start 2023-10-08T16:03:55.974 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.968+0000 7fc8d2c73700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc8cc0b2e50 0x7fc8cc142f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:55.974 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.968+0000 7fc8d2c73700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8cc06d990 0x7fc8cc068db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:55.974 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.968+0000 7fc8d2c73700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc8cc06dde0 0x7fc8cc0692f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:55.974 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.968+0000 7fc8d2c73700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8cc142ae0 con 0x7fc8cc06dde0 2023-10-08T16:03:55.974 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.968+0000 7fc8d2c73700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8cc06e3a0 con 0x7fc8cc0b2e50 2023-10-08T16:03:55.974 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.968+0000 7fc8d2c73700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc142770 con 0x7fc8cc06d990 2023-10-08T16:03:55.974 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.968+0000 7fc8d2472700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc8cc06dde0 0x7fc8cc0692f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:55.975 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.972+0000 7fc8d2472700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc8cc06dde0 0x7fc8cc0692f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35228/0 (socket says 172.21.15.133:35228) 2023-10-08T16:03:55.975 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.972+0000 7fc8d2472700 1 -- 172.21.15.133:0/630706246 learned_addr learned my addr 172.21.15.133:0/630706246 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:03:55.975 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.972+0000 7fc8d1c71700 1 --2- 172.21.15.133:0/630706246 >> v2:172.21.15.190:3300/0 conn(0x7fc8cc0b2e50 0x7fc8cc142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:55.975 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.972+0000 7fc8d1470700 1 --2- 172.21.15.133:0/630706246 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8cc06d990 0x7fc8cc068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:55.975 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.972+0000 7fc8d2472700 1 -- 172.21.15.133:0/630706246 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8cc06d990 msgr2=0x7fc8cc068db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:03:55.975 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.972+0000 7fc8d2472700 1 --2- 172.21.15.133:0/630706246 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8cc06d990 0x7fc8cc068db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:55.975 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.972+0000 7fc8d2472700 1 -- 172.21.15.133:0/630706246 >> v2:172.21.15.190:3300/0 conn(0x7fc8cc0b2e50 msgr2=0x7fc8cc142f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:03:55.975 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.972+0000 7fc8d2472700 1 --2- 172.21.15.133:0/630706246 >> v2:172.21.15.190:3300/0 conn(0x7fc8cc0b2e50 0x7fc8cc142f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:55.975 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.972+0000 7fc8d2472700 1 -- 172.21.15.133:0/630706246 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8cc0b3220 con 0x7fc8cc06dde0 2023-10-08T16:03:55.975 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.972+0000 7fc8d1c71700 1 --2- 172.21.15.133:0/630706246 >> v2:172.21.15.190:3300/0 conn(0x7fc8cc0b2e50 0x7fc8cc142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:03:55.975 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.972+0000 7fc8d2472700 1 --2- 172.21.15.133:0/630706246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8cc06dde0 0x7fc8cc0692f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc0a9570 tx=0x7fc8c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2827514039f1e8fc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:03:55.975 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.972+0000 7fc8d0c6f700 1 -- 172.21.15.133:0/630706246 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c400e070 con 0x7fc8cc06dde0 2023-10-08T16:03:55.976 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.972+0000 7fc8d0c6f700 1 -- 172.21.15.133:0/630706246 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c400ba20 con 0x7fc8cc06dde0 2023-10-08T16:03:55.976 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.972+0000 7fc8d0c6f700 1 -- 172.21.15.133:0/630706246 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c40092e0 con 0x7fc8cc06dde0 2023-10-08T16:03:55.977 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.972+0000 7fc8d2c73700 1 -- 172.21.15.133:0/630706246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8cc06dde0 msgr2=0x7fc8cc0692f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:55.977 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.972+0000 7fc8d2c73700 1 --2- 172.21.15.133:0/630706246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8cc06dde0 0x7fc8cc0692f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc0a9570 tx=0x7fc8c4009840 comp rx=0 tx=0).stop 2023-10-08T16:03:55.977 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.972+0000 7fc8d2c73700 1 -- 172.21.15.133:0/630706246 shutdown_connections 2023-10-08T16:03:55.977 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.972+0000 7fc8d2c73700 1 --2- 172.21.15.133:0/630706246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8cc06dde0 0x7fc8cc0692f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:55.977 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.972+0000 7fc8d2c73700 1 --2- 172.21.15.133:0/630706246 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8cc06d990 0x7fc8cc068db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:55.977 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.972+0000 7fc8d2c73700 1 --2- 172.21.15.133:0/630706246 >> v2:172.21.15.190:3300/0 conn(0x7fc8cc0b2e50 0x7fc8cc142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:55.977 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.972+0000 7fc8d2c73700 1 -- 172.21.15.133:0/630706246 >> 172.21.15.133:0/630706246 conn(0x7fc8cc0b6570 msgr2=0x7fc8cc0b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:03:55.977 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.972+0000 7fc8d2c73700 1 -- 172.21.15.133:0/630706246 shutdown_connections 2023-10-08T16:03:55.977 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.972+0000 7fc8d2c73700 1 -- 172.21.15.133:0/630706246 wait complete. 2023-10-08T16:03:55.978 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.972+0000 7fc8d2c73700 1 Processor -- start 2023-10-08T16:03:55.978 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.972+0000 7fc8d2c73700 1 -- start start 2023-10-08T16:03:55.980 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.976+0000 7fc8d2c73700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8cc06d990 0x7fc8cc13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:55.980 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.976+0000 7fc8d2c73700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8cc06dde0 0x7fc8cc13cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:55.980 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.976+0000 7fc8d2c73700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8cc0b2e50 0x7fc8cc151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:03:55.980 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.976+0000 7fc8d2c73700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc13fc50 con 0x7fc8cc06d990 2023-10-08T16:03:55.980 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.976+0000 7fc8d2c73700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc1400e0 con 0x7fc8cc0b2e50 2023-10-08T16:03:55.980 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.976+0000 7fc8d2c73700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc13f690 con 0x7fc8cc06dde0 2023-10-08T16:03:55.980 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.976+0000 7fc8d1c71700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8cc06d990 0x7fc8cc13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:55.981 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.976+0000 7fc8d1c71700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8cc06d990 0x7fc8cc13bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35232/0 (socket says 172.21.15.133:35232) 2023-10-08T16:03:55.981 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.976+0000 7fc8d1c71700 1 -- 172.21.15.133:0/4144670571 learned_addr learned my addr 172.21.15.133:0/4144670571 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:03:55.981 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.976+0000 7fc8d2472700 1 --2- 172.21.15.133:0/4144670571 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8cc0b2e50 0x7fc8cc151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:55.981 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.976+0000 7fc8d1470700 1 --2- 172.21.15.133:0/4144670571 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8cc06dde0 0x7fc8cc13cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:03:55.981 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.976+0000 7fc8d1c71700 1 -- 172.21.15.133:0/4144670571 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8cc06dde0 msgr2=0x7fc8cc13cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:55.981 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.976+0000 7fc8d1c71700 1 --2- 172.21.15.133:0/4144670571 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8cc06dde0 0x7fc8cc13cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:55.981 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.976+0000 7fc8d1c71700 1 -- 172.21.15.133:0/4144670571 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8cc0b2e50 msgr2=0x7fc8cc151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:55.981 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.976+0000 7fc8d1c71700 1 --2- 172.21.15.133:0/4144670571 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8cc0b2e50 0x7fc8cc151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:55.981 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.976+0000 7fc8d1c71700 1 -- 172.21.15.133:0/4144670571 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c4009ae0 con 0x7fc8cc06d990 2023-10-08T16:03:55.981 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.976+0000 7fc8d1c71700 1 --2- 172.21.15.133:0/4144670571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8cc06d990 0x7fc8cc13bd30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800fbe0 tx=0x7fc8c8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:03:55.981 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.976+0000 7fc8c1ffb700 1 -- 172.21.15.133:0/4144670571 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c80078f0 con 0x7fc8cc06d990 2023-10-08T16:03:55.981 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.976+0000 7fc8c1ffb700 1 -- 172.21.15.133:0/4144670571 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c8007a50 con 0x7fc8cc06d990 2023-10-08T16:03:55.981 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.976+0000 7fc8d2c73700 1 -- 172.21.15.133:0/4144670571 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8cc0ade20 con 0x7fc8cc06d990 2023-10-08T16:03:55.982 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.976+0000 7fc8c1ffb700 1 -- 172.21.15.133:0/4144670571 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8007df0 con 0x7fc8cc06d990 2023-10-08T16:03:55.982 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.976+0000 7fc8d2c73700 1 -- 172.21.15.133:0/4144670571 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8cc0adaa0 con 0x7fc8cc06d990 2023-10-08T16:03:55.982 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.976+0000 7fc8c1ffb700 1 -- 172.21.15.133:0/4144670571 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc8c80118e0 con 0x7fc8cc06d990 2023-10-08T16:03:55.982 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.976+0000 7fc8c1ffb700 1 -- 172.21.15.133:0/4144670571 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fc8c801bcc0 con 0x7fc8cc06d990 2023-10-08T16:03:55.982 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.976+0000 7fc8d2c73700 1 -- 172.21.15.133:0/4144670571 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8cc064810 con 0x7fc8cc06d990 2023-10-08T16:03:55.984 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:55.980+0000 7fc8c1ffb700 1 -- 172.21.15.133:0/4144670571 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc8c8020060 con 0x7fc8cc06d990 2023-10-08T16:03:56.022 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-10-08T16:03:56.020+0000 7f447afd7000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:03:56.038 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-10-08T16:03:56.031+0000 7fa4caaa4000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:03:56.048 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:56.048+0000 7fc8d2c73700 1 -- 172.21.15.133:0/4144670571 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8cc0b5060 con 0x7fc8cc06d990 2023-10-08T16:03:56.050 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:56.048+0000 7fc8c1ffb700 1 -- 172.21.15.133:0/4144670571 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fc8c8011d90 con 0x7fc8cc06d990 2023-10-08T16:03:56.050 INFO:teuthology.misc.health.smithi133.stdout: 2023-10-08T16:03:56.050 INFO:teuthology.misc.health.smithi133.stdout:{"epoch":10,"fsid":"f2546191-d59e-4805-8e1b-3d8d3d1dad86","created":"2023-10-08T16:03:52.631855+0000","modified":"2023-10-08T16:03:54.835293+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T16:03:54.835293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"8c5deadf-a203-4d30-aa7f-6e2e492b6ffc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9b081c42-c915-48c3-a1ad-410f09a78576","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"88ecda43-01cd-4644-ab0c-92c91fd38966","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"39faf38d-b8e2-4e11-9b3b-84dc834c977c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4c097e61-1cad-4b61-9183-4e7bc486bd32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"05f072e0-7bc0-40f0-8cb6-8e322c82d6d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1bcce8d7-14f3-442d-b135-68c7d66cdedc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9157dbf7-2bf9-43d7-a89a-a8e3dae7514c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:03:56.051 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:56.048+0000 7fc8d2c73700 1 -- 172.21.15.133:0/4144670571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8cc06d990 msgr2=0x7fc8cc13bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:03:56.051 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:56.048+0000 7fc8d2c73700 1 --2- 172.21.15.133:0/4144670571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8cc06d990 0x7fc8cc13bd30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800fbe0 tx=0x7fc8c8008040 comp rx=0 tx=0).stop 2023-10-08T16:03:56.052 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:56.048+0000 7fc8d2c73700 1 -- 172.21.15.133:0/4144670571 shutdown_connections 2023-10-08T16:03:56.052 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:56.048+0000 7fc8d2c73700 1 --2- 172.21.15.133:0/4144670571 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8cc0b2e50 0x7fc8cc151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:56.052 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:56.048+0000 7fc8d2c73700 1 --2- 172.21.15.133:0/4144670571 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8cc06dde0 0x7fc8cc13cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:56.052 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:56.048+0000 7fc8d2c73700 1 --2- 172.21.15.133:0/4144670571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8cc06d990 0x7fc8cc13bd30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:03:56.052 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:56.048+0000 7fc8d2c73700 1 -- 172.21.15.133:0/4144670571 >> 172.21.15.133:0/4144670571 conn(0x7fc8cc0b6570 msgr2=0x7fc8cc0b1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:03:56.052 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:56.048+0000 7fc8d2c73700 1 -- 172.21.15.133:0/4144670571 shutdown_connections 2023-10-08T16:03:56.052 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:03:56.048+0000 7fc8d2c73700 1 -- 172.21.15.133:0/4144670571 wait complete. 2023-10-08T16:03:56.061 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-08T16:03:56.090 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-10-08T16:03:56.088+0000 7f447afd7000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:03:56.102 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-10-08T16:03:56.095+0000 7fa4caaa4000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:03:56.797 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-10-08T16:03:56.792+0000 7f447afd7000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:03:56.800 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-10-08T16:03:56.795+0000 7fa4caaa4000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:03:57.844 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-10-08T16:03:57.840+0000 7f44640cf700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-08T16:03:57.846 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-10-08T16:03:57.844+0000 7f44640cf700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-08T16:03:58.844 INFO:tasks.ceph.osd.2.smithi133.stderr:2023-10-08T16:03:58.839+0000 7fb15913c3c0 -1 osd.2 0 log_to_monitors true 2023-10-08T16:03:58.847 INFO:tasks.ceph.osd.0.smithi133.stderr:2023-10-08T16:03:58.843+0000 7f66490d53c0 -1 osd.0 0 log_to_monitors true 2023-10-08T16:03:58.858 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-10-08T16:03:58.851+0000 7fd46913f3c0 -1 osd.5 0 log_to_monitors true 2023-10-08T16:03:59.079 INFO:tasks.ceph.osd.3.smithi133.stderr:2023-10-08T16:03:59.075+0000 7f24197e63c0 -1 osd.3 0 log_to_monitors true 2023-10-08T16:03:59.083 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-10-08T16:03:59.079+0000 7f00f07373c0 -1 osd.4 0 log_to_monitors true 2023-10-08T16:03:59.086 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-10-08T16:03:59.079+0000 7f9fa2d383c0 -1 osd.6 0 log_to_monitors true 2023-10-08T16:03:59.169 INFO:tasks.ceph.osd.1.smithi133.stderr:2023-10-08T16:03:59.167+0000 7f20e71a63c0 -1 osd.1 0 log_to_monitors true 2023-10-08T16:03:59.271 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-10-08T16:03:59.267+0000 7f6dae9dd3c0 -1 osd.7 0 log_to_monitors true 2023-10-08T16:04:02.867 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T16:04:02.989 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.987+0000 7f6dd56b2700 1 Processor -- start 2023-10-08T16:04:02.989 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.987+0000 7f6dd56b2700 1 -- start start 2023-10-08T16:04:02.990 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.987+0000 7f6dd56b2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6dd00ae830 0x7f6dd00b1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:02.990 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.987+0000 7f6dd56b2700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6dd006f150 0x7f6dd00b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:02.990 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.987+0000 7f6dd56b2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd00afe50 con 0x7f6dd00709d0 2023-10-08T16:04:02.991 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.987+0000 7f6dd56b2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd00b0110 con 0x7f6dd00ae830 2023-10-08T16:04:02.991 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.987+0000 7f6dd56b2700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd00b03f0 con 0x7f6dd006f150 2023-10-08T16:04:02.991 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.987+0000 7f6dceffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6dd00709d0 0x7f6dd00b08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55756/0 (socket says 172.21.15.133:55756) 2023-10-08T16:04:02.991 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.987+0000 7f6dceffd700 1 -- 172.21.15.133:0/2715442382 learned_addr learned my addr 172.21.15.133:0/2715442382 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:02.991 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.987+0000 7f6dce7fc700 1 --2- 172.21.15.133:0/2715442382 >> v2:172.21.15.133:3300/0 conn(0x7f6dd00ae830 0x7f6dd00b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:02.992 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.987+0000 7f6dce7fc700 1 -- 172.21.15.133:0/2715442382 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6dd006f150 msgr2=0x7f6dd00b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:02.992 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.987+0000 7f6dce7fc700 1 --2- 172.21.15.133:0/2715442382 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6dd006f150 0x7f6dd00b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:02.992 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.987+0000 7f6dce7fc700 1 -- 172.21.15.133:0/2715442382 >> v1:172.21.15.133:6789/0 conn(0x7f6dd00709d0 legacy=0x7f6dd00b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:02.992 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.987+0000 7f6dcdffb700 1 -- 172.21.15.133:0/2715442382 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 258984105 0 0) 0x7f6dd00afe50 con 0x7f6dd00709d0 2023-10-08T16:04:02.992 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.987+0000 7f6dce7fc700 1 -- 172.21.15.133:0/2715442382 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd0070da0 con 0x7f6dd00ae830 2023-10-08T16:04:02.993 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.987+0000 7f6dce7fc700 1 --2- 172.21.15.133:0/2715442382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dd00ae830 0x7f6dd00b1920 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8009e90 tx=0x7f6dc8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=743b383966e56c97 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:02.993 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.987+0000 7f6dcdffb700 1 -- 172.21.15.133:0/2715442382 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc800e070 con 0x7f6dd00ae830 2023-10-08T16:04:02.993 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.987+0000 7f6dcdffb700 1 -- 172.21.15.133:0/2715442382 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc800bbf0 con 0x7f6dd00ae830 2023-10-08T16:04:02.993 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.987+0000 7f6dcdffb700 1 -- 172.21.15.133:0/2715442382 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8012430 con 0x7f6dd00ae830 2023-10-08T16:04:02.993 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.991+0000 7f6dd56b2700 1 -- 172.21.15.133:0/2715442382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dd00ae830 msgr2=0x7f6dd00b1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:02.994 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.991+0000 7f6dd56b2700 1 --2- 172.21.15.133:0/2715442382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dd00ae830 0x7f6dd00b1920 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8009e90 tx=0x7f6dc8009780 comp rx=0 tx=0).stop 2023-10-08T16:04:02.994 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.991+0000 7f6dd56b2700 1 -- 172.21.15.133:0/2715442382 shutdown_connections 2023-10-08T16:04:02.994 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.991+0000 7f6dd56b2700 1 --2- 172.21.15.133:0/2715442382 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6dd006f150 0x7f6dd00b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:02.994 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.991+0000 7f6dd56b2700 1 --2- 172.21.15.133:0/2715442382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dd00ae830 0x7f6dd00b1920 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:02.994 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.991+0000 7f6dd56b2700 1 -- 172.21.15.133:0/2715442382 >> 172.21.15.133:0/2715442382 conn(0x7f6dd0066f90 msgr2=0x7f6dd0067390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:02.994 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.991+0000 7f6dd56b2700 1 -- 172.21.15.133:0/2715442382 shutdown_connections 2023-10-08T16:04:02.994 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.991+0000 7f6dd56b2700 1 -- 172.21.15.133:0/2715442382 wait complete. 2023-10-08T16:04:02.995 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.991+0000 7f6dd56b2700 1 Processor -- start 2023-10-08T16:04:02.995 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.991+0000 7f6dd56b2700 1 -- start start 2023-10-08T16:04:02.996 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.991+0000 7f6dd56b2700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6dd006f150 0x7f6dd00a7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:02.996 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.991+0000 7f6dd56b2700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6dd00709d0 0x7f6dd00a5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:02.997 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.991+0000 7f6dd56b2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dd00ae830 0x7f6dd00a63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:02.997 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.991+0000 7f6dd56b2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd00a59e0 con 0x7f6dd00ae830 2023-10-08T16:04:02.997 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.991+0000 7f6dd56b2700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd006e040 con 0x7f6dd006f150 2023-10-08T16:04:02.997 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.991+0000 7f6dd56b2700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd00a7550 con 0x7f6dd00709d0 2023-10-08T16:04:02.997 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.991+0000 7f6dcf7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dd00ae830 0x7f6dd00a63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:02.997 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.991+0000 7f6dcf7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dd00ae830 0x7f6dd00a63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38282/0 (socket says 172.21.15.133:38282) 2023-10-08T16:04:02.997 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.991+0000 7f6dcf7fe700 1 -- 172.21.15.133:0/4146226581 learned_addr learned my addr 172.21.15.133:0/4146226581 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:02.997 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.991+0000 7f6dceffd700 1 --2- 172.21.15.133:0/4146226581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6dd006f150 0x7f6dd00a7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:02.997 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.991+0000 7f6dce7fc700 1 --2- 172.21.15.133:0/4146226581 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6dd00709d0 0x7f6dd00a5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:02.997 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.991+0000 7f6dcf7fe700 1 -- 172.21.15.133:0/4146226581 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6dd00709d0 msgr2=0x7f6dd00a5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:02.998 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.991+0000 7f6dcf7fe700 1 --2- 172.21.15.133:0/4146226581 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6dd00709d0 0x7f6dd00a5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:02.998 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.991+0000 7f6dcf7fe700 1 -- 172.21.15.133:0/4146226581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6dd006f150 msgr2=0x7f6dd00a7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:02.998 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.991+0000 7f6dcf7fe700 1 --2- 172.21.15.133:0/4146226581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6dd006f150 0x7f6dd00a7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:02.998 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.991+0000 7f6dcf7fe700 1 -- 172.21.15.133:0/4146226581 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc8009a20 con 0x7f6dd00ae830 2023-10-08T16:04:02.998 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.995+0000 7f6dcf7fe700 1 --2- 172.21.15.133:0/4146226581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dd00ae830 0x7f6dd00a63b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400b590 tx=0x7f6dc4006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:02.999 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.995+0000 7f6db6ffd700 1 -- 172.21.15.133:0/4146226581 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc400f510 con 0x7f6dd00ae830 2023-10-08T16:04:02.999 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.995+0000 7f6db6ffd700 1 -- 172.21.15.133:0/4146226581 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc400f690 con 0x7f6dd00ae830 2023-10-08T16:04:02.999 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.995+0000 7f6db6ffd700 1 -- 172.21.15.133:0/4146226581 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc400fa50 con 0x7f6dd00ae830 2023-10-08T16:04:02.999 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.995+0000 7f6dd56b2700 1 -- 172.21.15.133:0/4146226581 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd006e2e0 con 0x7f6dd00ae830 2023-10-08T16:04:02.999 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.995+0000 7f6dd56b2700 1 -- 172.21.15.133:0/4146226581 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd00a71d0 con 0x7f6dd00ae830 2023-10-08T16:04:02.999 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.995+0000 7f6dd56b2700 1 -- 172.21.15.133:0/4146226581 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd00a5b90 con 0x7f6dd00ae830 2023-10-08T16:04:02.999 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.995+0000 7f6db6ffd700 1 -- 172.21.15.133:0/4146226581 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 79903+0+0 (secure 0 0 0) 0x7f6dc4024430 con 0x7f6dd00ae830 2023-10-08T16:04:03.001 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.995+0000 7f6db6ffd700 1 --2- 172.21.15.133:0/4146226581 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6dbc060590 0x7f6dbc062a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:03.001 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.995+0000 7f6db6ffd700 1 -- 172.21.15.133:0/4146226581 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7f6dc407be10 con 0x7f6dd00ae830 2023-10-08T16:04:03.001 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.999+0000 7f6dceffd700 1 --2- 172.21.15.133:0/4146226581 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6dbc060590 0x7f6dbc062a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:03.001 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:02.999+0000 7f6dceffd700 1 --2- 172.21.15.133:0/4146226581 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6dbc060590 0x7f6dbc062a40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6dc00011e0 tx=0x7f6dc0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:03.008 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:03.003+0000 7f6db6ffd700 1 -- 172.21.15.133:0/4146226581 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6dc404d3d0 con 0x7f6dd00ae830 2023-10-08T16:04:03.017 INFO:tasks.ceph.osd.2.smithi133.stderr:2023-10-08T16:04:03.015+0000 7fb156101700 -1 osd.2 0 waiting for initial osdmap 2023-10-08T16:04:03.024 INFO:tasks.ceph.osd.2.smithi133.stderr:2023-10-08T16:04:03.019+0000 7fb14d680700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:04:03.079 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-10-08T16:04:03.075+0000 7f9f9e4d8700 -1 osd.6 0 waiting for initial osdmap 2023-10-08T16:04:03.086 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-10-08T16:04:03.079+0000 7f9f9727c700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:04:03.134 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-10-08T16:04:03.127+0000 7fd4648df700 -1 osd.5 0 waiting for initial osdmap 2023-10-08T16:04:03.143 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-10-08T16:04:03.139+0000 7fd45d683700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:04:03.146 INFO:tasks.ceph.osd.3.smithi133.stderr:2023-10-08T16:04:03.143+0000 7f2414f86700 -1 osd.3 0 waiting for initial osdmap 2023-10-08T16:04:03.154 INFO:tasks.ceph.osd.3.smithi133.stderr:2023-10-08T16:04:03.151+0000 7f240dd2a700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:04:03.156 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-10-08T16:04:03.151+0000 7f6dab9a2700 -1 osd.7 0 waiting for initial osdmap 2023-10-08T16:04:03.163 INFO:tasks.ceph.osd.0.smithi133.stderr:2023-10-08T16:04:03.159+0000 7f6644875700 -1 osd.0 0 waiting for initial osdmap 2023-10-08T16:04:03.165 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-10-08T16:04:03.159+0000 7f6da2f21700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:04:03.169 INFO:tasks.ceph.osd.0.smithi133.stderr:2023-10-08T16:04:03.167+0000 7f663d619700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:04:03.178 INFO:tasks.ceph.osd.1.smithi133.stderr:2023-10-08T16:04:03.175+0000 7f20e2946700 -1 osd.1 0 waiting for initial osdmap 2023-10-08T16:04:03.184 INFO:tasks.ceph.osd.1.smithi133.stderr:2023-10-08T16:04:03.183+0000 7f20db6ea700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:04:03.188 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-10-08T16:04:03.183+0000 7f00ed6fc700 -1 osd.4 0 waiting for initial osdmap 2023-10-08T16:04:03.198 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-10-08T16:04:03.191+0000 7f00e4c7b700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:04:03.229 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:03.227+0000 7f6dd56b2700 1 -- 172.21.15.133:0/4146226581 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6dd0064810 con 0x7f6dd00ae830 2023-10-08T16:04:03.230 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:03.227+0000 7f6db6ffd700 1 -- 172.21.15.133:0/4146226581 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f6dc40509f0 con 0x7f6dd00ae830 2023-10-08T16:04:03.230 INFO:teuthology.misc.health.smithi133.stdout: 2023-10-08T16:04:03.230 INFO:teuthology.misc.health.smithi133.stdout:{"epoch":12,"fsid":"f2546191-d59e-4805-8e1b-3d8d3d1dad86","created":"2023-10-08T16:03:52.631855+0000","modified":"2023-10-08T16:04:00.847041+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T16:03:54.835293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"8c5deadf-a203-4d30-aa7f-6e2e492b6ffc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9b081c42-c915-48c3-a1ad-410f09a78576","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"88ecda43-01cd-4644-ab0c-92c91fd38966","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"39faf38d-b8e2-4e11-9b3b-84dc834c977c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4c097e61-1cad-4b61-9183-4e7bc486bd32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"05f072e0-7bc0-40f0-8cb6-8e322c82d6d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1bcce8d7-14f3-442d-b135-68c7d66cdedc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9157dbf7-2bf9-43d7-a89a-a8e3dae7514c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:04:03.232 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:03.227+0000 7f6dd56b2700 1 -- 172.21.15.133:0/4146226581 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6dbc060590 msgr2=0x7f6dbc062a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:03.232 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:03.227+0000 7f6dd56b2700 1 --2- 172.21.15.133:0/4146226581 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6dbc060590 0x7f6dbc062a40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6dc00011e0 tx=0x7f6dc0009040 comp rx=0 tx=0).stop 2023-10-08T16:04:03.233 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:03.227+0000 7f6dd56b2700 1 -- 172.21.15.133:0/4146226581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dd00ae830 msgr2=0x7f6dd00a63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:03.233 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:03.227+0000 7f6dd56b2700 1 --2- 172.21.15.133:0/4146226581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dd00ae830 0x7f6dd00a63b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400b590 tx=0x7f6dc4006f90 comp rx=0 tx=0).stop 2023-10-08T16:04:03.233 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:03.227+0000 7f6dd56b2700 1 -- 172.21.15.133:0/4146226581 shutdown_connections 2023-10-08T16:04:03.233 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:03.227+0000 7f6dd56b2700 1 --2- 172.21.15.133:0/4146226581 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6dbc060590 0x7f6dbc062a40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:03.233 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:03.227+0000 7f6dd56b2700 1 --2- 172.21.15.133:0/4146226581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dd00ae830 0x7f6dd00a63b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:03.233 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:03.227+0000 7f6dd56b2700 1 --2- 172.21.15.133:0/4146226581 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6dd00709d0 0x7f6dd00a5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:03.233 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:03.227+0000 7f6dd56b2700 1 --2- 172.21.15.133:0/4146226581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6dd006f150 0x7f6dd00a7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:03.233 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:03.227+0000 7f6dd56b2700 1 -- 172.21.15.133:0/4146226581 >> 172.21.15.133:0/4146226581 conn(0x7f6dd0066f90 msgr2=0x7f6dd0142270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:03.233 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:03.227+0000 7f6dd56b2700 1 -- 172.21.15.133:0/4146226581 shutdown_connections 2023-10-08T16:04:03.233 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:03.227+0000 7f6dd56b2700 1 -- 172.21.15.133:0/4146226581 wait complete. 2023-10-08T16:04:03.242 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-08T16:04:10.047 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T16:04:10.152 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.143+0000 7fd1262bc700 1 Processor -- start 2023-10-08T16:04:10.152 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.143+0000 7fd1262bc700 1 -- start start 2023-10-08T16:04:10.153 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd1262bc700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1200b4db0 0x7fd1200ade80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:10.153 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd1262bc700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd1200ab7c0 0x7fd1200ae3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:10.153 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd1262bc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1200ad1f0 con 0x7fd1200b13b0 2023-10-08T16:04:10.153 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd1262bc700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1200abf30 con 0x7fd1200ab7c0 2023-10-08T16:04:10.153 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd1262bc700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1200ac210 con 0x7fd1200b4db0 2023-10-08T16:04:10.153 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd125abb700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd1200b13b0 0x7fd1200b17d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34630/0 (socket says 172.21.15.133:34630) 2023-10-08T16:04:10.153 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd125abb700 1 -- 172.21.15.133:0/2370709943 learned_addr learned my addr 172.21.15.133:0/2370709943 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:10.153 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd1252ba700 1 --2- 172.21.15.133:0/2370709943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1200b4db0 0x7fd1200ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:10.153 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd124ab9700 1 --2- 172.21.15.133:0/2370709943 >> v2:172.21.15.190:3300/0 conn(0x7fd1200ab7c0 0x7fd1200ae3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:10.154 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd11ffff700 1 -- 172.21.15.133:0/2370709943 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3724274078 0 0) 0x7fd1200ad1f0 con 0x7fd1200b13b0 2023-10-08T16:04:10.154 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd11ffff700 1 -- 172.21.15.133:0/2370709943 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd108003570 con 0x7fd1200b13b0 2023-10-08T16:04:10.154 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd1252ba700 1 -- 172.21.15.133:0/2370709943 >> v2:172.21.15.190:3300/0 conn(0x7fd1200ab7c0 msgr2=0x7fd1200ae3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:10.154 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd1252ba700 1 --2- 172.21.15.133:0/2370709943 >> v2:172.21.15.190:3300/0 conn(0x7fd1200ab7c0 0x7fd1200ae3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.154 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd1252ba700 1 -- 172.21.15.133:0/2370709943 >> v1:172.21.15.133:6789/0 conn(0x7fd1200b13b0 legacy=0x7fd1200b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:10.154 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd1252ba700 1 -- 172.21.15.133:0/2370709943 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1200ad960 con 0x7fd1200b4db0 2023-10-08T16:04:10.154 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd1252ba700 1 --2- 172.21.15.133:0/2370709943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1200b4db0 0x7fd1200ade80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd1140098e0 tx=0x7fd1140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2911c1a6f53b1cb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:10.154 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd11ffff700 1 -- 172.21.15.133:0/2370709943 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd114011630 con 0x7fd1200b4db0 2023-10-08T16:04:10.154 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd11ffff700 1 -- 172.21.15.133:0/2370709943 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd114011790 con 0x7fd1200b4db0 2023-10-08T16:04:10.155 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd11ffff700 1 -- 172.21.15.133:0/2370709943 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd114011b30 con 0x7fd1200b4db0 2023-10-08T16:04:10.155 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd1262bc700 1 -- 172.21.15.133:0/2370709943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1200b4db0 msgr2=0x7fd1200ade80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:10.155 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd1262bc700 1 --2- 172.21.15.133:0/2370709943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1200b4db0 0x7fd1200ade80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd1140098e0 tx=0x7fd1140091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.155 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd1262bc700 1 -- 172.21.15.133:0/2370709943 shutdown_connections 2023-10-08T16:04:10.155 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd1262bc700 1 --2- 172.21.15.133:0/2370709943 >> v2:172.21.15.190:3300/0 conn(0x7fd1200ab7c0 0x7fd1200ae3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.155 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd1262bc700 1 --2- 172.21.15.133:0/2370709943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1200b4db0 0x7fd1200ade80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.155 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd1262bc700 1 -- 172.21.15.133:0/2370709943 >> 172.21.15.133:0/2370709943 conn(0x7fd1200709d0 msgr2=0x7fd120067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:10.155 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd1262bc700 1 -- 172.21.15.133:0/2370709943 shutdown_connections 2023-10-08T16:04:10.155 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.147+0000 7fd1262bc700 1 -- 172.21.15.133:0/2370709943 wait complete. 2023-10-08T16:04:10.157 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.151+0000 7fd1262bc700 1 Processor -- start 2023-10-08T16:04:10.158 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.151+0000 7fd1262bc700 1 -- start start 2023-10-08T16:04:10.158 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.151+0000 7fd1262bc700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1200ab7c0 0x7fd12014aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:10.158 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.151+0000 7fd1262bc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1200b13b0 0x7fd1200a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:10.158 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.151+0000 7fd1262bc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1200b4db0 0x7fd120145010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:10.158 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.151+0000 7fd1262bc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1200a70b0 con 0x7fd1200b4db0 2023-10-08T16:04:10.158 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.151+0000 7fd1262bc700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1200a5660 con 0x7fd1200b13b0 2023-10-08T16:04:10.158 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.151+0000 7fd1262bc700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1200a75c0 con 0x7fd1200ab7c0 2023-10-08T16:04:10.158 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.151+0000 7fd125abb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1200b4db0 0x7fd120145010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:10.158 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.151+0000 7fd125abb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1200b4db0 0x7fd120145010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52544/0 (socket says 172.21.15.133:52544) 2023-10-08T16:04:10.159 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.151+0000 7fd125abb700 1 -- 172.21.15.133:0/3769758590 learned_addr learned my addr 172.21.15.133:0/3769758590 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:10.159 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.151+0000 7fd1252ba700 1 --2- 172.21.15.133:0/3769758590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1200ab7c0 0x7fd12014aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:10.159 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.151+0000 7fd124ab9700 1 --2- 172.21.15.133:0/3769758590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1200b13b0 0x7fd1200a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:10.160 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.151+0000 7fd125abb700 1 -- 172.21.15.133:0/3769758590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1200ab7c0 msgr2=0x7fd12014aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:10.160 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.151+0000 7fd125abb700 1 --2- 172.21.15.133:0/3769758590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1200ab7c0 0x7fd12014aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.160 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.151+0000 7fd125abb700 1 -- 172.21.15.133:0/3769758590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1200b13b0 msgr2=0x7fd1200a5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:10.160 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.151+0000 7fd125abb700 1 --2- 172.21.15.133:0/3769758590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1200b13b0 0x7fd1200a5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.160 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.151+0000 7fd125abb700 1 -- 172.21.15.133:0/3769758590 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd114009420 con 0x7fd1200b4db0 2023-10-08T16:04:10.160 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.151+0000 7fd125abb700 1 --2- 172.21.15.133:0/3769758590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1200b4db0 0x7fd120145010 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd1180010e0 tx=0x7fd118007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:10.160 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.151+0000 7fd11d7fa700 1 -- 172.21.15.133:0/3769758590 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd118005c00 con 0x7fd1200b4db0 2023-10-08T16:04:10.160 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.151+0000 7fd11d7fa700 1 -- 172.21.15.133:0/3769758590 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd118005d60 con 0x7fd1200b4db0 2023-10-08T16:04:10.160 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.151+0000 7fd11d7fa700 1 -- 172.21.15.133:0/3769758590 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1180072e0 con 0x7fd1200b4db0 2023-10-08T16:04:10.161 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.151+0000 7fd1262bc700 1 -- 172.21.15.133:0/3769758590 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd12006cfb0 con 0x7fd1200b4db0 2023-10-08T16:04:10.161 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.151+0000 7fd1262bc700 1 -- 172.21.15.133:0/3769758590 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1200a6180 con 0x7fd1200b4db0 2023-10-08T16:04:10.161 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.155+0000 7fd1262bc700 1 -- 172.21.15.133:0/3769758590 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd120064810 con 0x7fd1200b4db0 2023-10-08T16:04:10.161 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.155+0000 7fd11d7fa700 1 -- 172.21.15.133:0/3769758590 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd118007690 con 0x7fd1200b4db0 2023-10-08T16:04:10.161 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.155+0000 7fd11d7fa700 1 --2- 172.21.15.133:0/3769758590 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fd10c060550 0x7fd10c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:10.162 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.155+0000 7fd1252ba700 1 --2- 172.21.15.133:0/3769758590 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fd10c060550 0x7fd10c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:10.162 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.155+0000 7fd11d7fa700 1 -- 172.21.15.133:0/3769758590 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd11807b770 con 0x7fd1200b4db0 2023-10-08T16:04:10.162 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.155+0000 7fd1252ba700 1 --2- 172.21.15.133:0/3769758590 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fd10c060550 0x7fd10c062a00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd1140091e0 tx=0x7fd114017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:10.166 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.163+0000 7fd11d7fa700 1 -- 172.21.15.133:0/3769758590 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd118049be0 con 0x7fd1200b4db0 2023-10-08T16:04:10.320 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.315+0000 7fd1262bc700 1 -- 172.21.15.133:0/3769758590 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1200b4200 con 0x7fd1200b4db0 2023-10-08T16:04:10.321 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.319+0000 7fd11d7fa700 1 -- 172.21.15.133:0/3769758590 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12175 (secure 0 0 0) 0x7fd11804c160 con 0x7fd1200b4db0 2023-10-08T16:04:10.322 INFO:teuthology.misc.health.smithi133.stdout: 2023-10-08T16:04:10.322 INFO:teuthology.misc.health.smithi133.stdout:{"epoch":16,"fsid":"f2546191-d59e-4805-8e1b-3d8d3d1dad86","created":"2023-10-08T16:03:52.631855+0000","modified":"2023-10-08T16:04:07.090975+0000","last_up_change":"2023-10-08T16:04:04.030581+0000","last_in_change":"2023-10-08T16:03:54.835293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:04.898316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"8c5deadf-a203-4d30-aa7f-6e2e492b6ffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6809","nonce":33493},{"type":"v1","addr":"172.21.15.133:6811","nonce":33493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":33493},{"type":"v1","addr":"172.21.15.133:6815","nonce":33493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":33493},{"type":"v1","addr":"172.21.15.133:6822","nonce":33493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":33493},{"type":"v1","addr":"172.21.15.133:6818","nonce":33493}]},"public_addr":"172.21.15.133:6811/33493","cluster_addr":"172.21.15.133:6815/33493","heartbeat_back_addr":"172.21.15.133:6822/33493","heartbeat_front_addr":"172.21.15.133:6818/33493","state":["exists","up"]},{"osd":1,"uuid":"9b081c42-c915-48c3-a1ad-410f09a78576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":33490},{"type":"v1","addr":"172.21.15.133:6801","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":33490},{"type":"v1","addr":"172.21.15.133:6803","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":33490},{"type":"v1","addr":"172.21.15.133:6807","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":33490},{"type":"v1","addr":"172.21.15.133:6805","nonce":33490}]},"public_addr":"172.21.15.133:6801/33490","cluster_addr":"172.21.15.133:6803/33490","heartbeat_back_addr":"172.21.15.133:6807/33490","heartbeat_front_addr":"172.21.15.133:6805/33490","state":["exists","up"]},{"osd":2,"uuid":"88ecda43-01cd-4644-ab0c-92c91fd38966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":33492},{"type":"v1","addr":"172.21.15.133:6825","nonce":33492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":33492},{"type":"v1","addr":"172.21.15.133:6827","nonce":33492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":33492},{"type":"v1","addr":"172.21.15.133:6831","nonce":33492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":33492},{"type":"v1","addr":"172.21.15.133:6829","nonce":33492}]},"public_addr":"172.21.15.133:6825/33492","cluster_addr":"172.21.15.133:6827/33492","heartbeat_back_addr":"172.21.15.133:6831/33492","heartbeat_front_addr":"172.21.15.133:6829/33492","state":["exists","up"]},{"osd":3,"uuid":"39faf38d-b8e2-4e11-9b3b-84dc834c977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":33491},{"type":"v1","addr":"172.21.15.133:6810","nonce":33491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":33491},{"type":"v1","addr":"172.21.15.133:6814","nonce":33491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":33491},{"type":"v1","addr":"172.21.15.133:6823","nonce":33491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":33491},{"type":"v1","addr":"172.21.15.133:6819","nonce":33491}]},"public_addr":"172.21.15.133:6810/33491","cluster_addr":"172.21.15.133:6814/33491","heartbeat_back_addr":"172.21.15.133:6823/33491","heartbeat_front_addr":"172.21.15.133:6819/33491","state":["exists","up"]},{"osd":4,"uuid":"4c097e61-1cad-4b61-9183-4e7bc486bd32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":33678},{"type":"v1","addr":"172.21.15.190:6810","nonce":33678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":33678},{"type":"v1","addr":"172.21.15.190:6814","nonce":33678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":33678},{"type":"v1","addr":"172.21.15.190:6822","nonce":33678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":33678},{"type":"v1","addr":"172.21.15.190:6818","nonce":33678}]},"public_addr":"172.21.15.190:6810/33678","cluster_addr":"172.21.15.190:6814/33678","heartbeat_back_addr":"172.21.15.190:6822/33678","heartbeat_front_addr":"172.21.15.190:6818/33678","state":["exists","up"]},{"osd":5,"uuid":"05f072e0-7bc0-40f0-8cb6-8e322c82d6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":33676},{"type":"v1","addr":"172.21.15.190:6811","nonce":33676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":33676},{"type":"v1","addr":"172.21.15.190:6815","nonce":33676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":33676},{"type":"v1","addr":"172.21.15.190:6823","nonce":33676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":33676},{"type":"v1","addr":"172.21.15.190:6819","nonce":33676}]},"public_addr":"172.21.15.190:6811/33676","cluster_addr":"172.21.15.190:6815/33676","heartbeat_back_addr":"172.21.15.190:6823/33676","heartbeat_front_addr":"172.21.15.190:6819/33676","state":["exists","up"]},{"osd":6,"uuid":"1bcce8d7-14f3-442d-b135-68c7d66cdedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":33677},{"type":"v1","addr":"172.21.15.190:6801","nonce":33677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":33677},{"type":"v1","addr":"172.21.15.190:6803","nonce":33677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":33677},{"type":"v1","addr":"172.21.15.190:6807","nonce":33677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":33677},{"type":"v1","addr":"172.21.15.190:6805","nonce":33677}]},"public_addr":"172.21.15.190:6801/33677","cluster_addr":"172.21.15.190:6803/33677","heartbeat_back_addr":"172.21.15.190:6807/33677","heartbeat_front_addr":"172.21.15.190:6805/33677","state":["exists","up"]},{"osd":7,"uuid":"9157dbf7-2bf9-43d7-a89a-a8e3dae7514c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":33686},{"type":"v1","addr":"172.21.15.190:6825","nonce":33686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":33686},{"type":"v1","addr":"172.21.15.190:6827","nonce":33686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":33686},{"type":"v1","addr":"172.21.15.190:6831","nonce":33686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":33686},{"type":"v1","addr":"172.21.15.190:6829","nonce":33686}]},"public_addr":"172.21.15.190:6825/33686","cluster_addr":"172.21.15.190:6827/33686","heartbeat_back_addr":"172.21.15.190:6831/33686","heartbeat_front_addr":"172.21.15.190:6829/33686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.886742+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.199618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.871695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.115926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.069650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.841448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.132320+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.315132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:04:10.324 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.319+0000 7fd1262bc700 1 -- 172.21.15.133:0/3769758590 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fd10c060550 msgr2=0x7fd10c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:10.324 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.319+0000 7fd1262bc700 1 --2- 172.21.15.133:0/3769758590 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fd10c060550 0x7fd10c062a00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd1140091e0 tx=0x7fd114017000 comp rx=0 tx=0).stop 2023-10-08T16:04:10.324 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.319+0000 7fd1262bc700 1 -- 172.21.15.133:0/3769758590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1200b4db0 msgr2=0x7fd120145010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:10.324 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.319+0000 7fd1262bc700 1 --2- 172.21.15.133:0/3769758590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1200b4db0 0x7fd120145010 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd1180010e0 tx=0x7fd118007dd0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.324 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.319+0000 7fd1262bc700 1 -- 172.21.15.133:0/3769758590 shutdown_connections 2023-10-08T16:04:10.324 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.319+0000 7fd1262bc700 1 --2- 172.21.15.133:0/3769758590 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fd10c060550 0x7fd10c062a00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.325 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.319+0000 7fd1262bc700 1 --2- 172.21.15.133:0/3769758590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1200b4db0 0x7fd120145010 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.325 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.319+0000 7fd1262bc700 1 --2- 172.21.15.133:0/3769758590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1200b13b0 0x7fd1200a5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.325 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.319+0000 7fd1262bc700 1 --2- 172.21.15.133:0/3769758590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1200ab7c0 0x7fd12014aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.325 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.319+0000 7fd1262bc700 1 -- 172.21.15.133:0/3769758590 >> 172.21.15.133:0/3769758590 conn(0x7fd1200709d0 msgr2=0x7fd12014cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:10.325 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.319+0000 7fd1262bc700 1 -- 172.21.15.133:0/3769758590 shutdown_connections 2023-10-08T16:04:10.325 INFO:teuthology.misc.health.smithi133.stderr:2023-10-08T16:04:10.319+0000 7fd1262bc700 1 -- 172.21.15.133:0/3769758590 wait complete. 2023-10-08T16:04:10.334 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-08T16:04:10.334 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-08T16:04:10.334 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T16:04:10.334 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T16:04:10.336 INFO:tasks.ceph.mds.a:Started 2023-10-08T16:04:10.337 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T16:04:10.337 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T16:04:10.339 INFO:tasks.ceph.mds.b:Started 2023-10-08T16:04:10.339 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-08T16:04:10.340 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:04:10.418 INFO:tasks.ceph.mds.b.smithi190.stdout:starting mds.b at 2023-10-08T16:04:10.426 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2023-10-08T16:04:10.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.439+0000 7f65f5ae2700 1 Processor -- start 2023-10-08T16:04:10.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.439+0000 7f65f5ae2700 1 -- start start 2023-10-08T16:04:10.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65f5ae2700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f65f0070830 0x7f65f00ad920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:10.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65f5ae2700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65f0070c00 0x7f65f00ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:10.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65f5ae2700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f00ab9b0 con 0x7f65f00b1460 2023-10-08T16:04:10.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65f5ae2700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f00ad490 con 0x7f65f0070830 2023-10-08T16:04:10.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65f5ae2700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f00aea40 con 0x7f65f0070c00 2023-10-08T16:04:10.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65f4ae0700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f65f0070830 0x7f65f00ad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:10.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65f52e1700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65f0070c00 0x7f65f00ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:10.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65f4ae0700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f65f0070830 0x7f65f00ad920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.133:49484/0 (socket says 172.21.15.133:49484) 2023-10-08T16:04:10.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65f4ae0700 1 -- 172.21.15.133:0/1568689099 learned_addr learned my addr 172.21.15.133:0/1568689099 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:10.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65effff700 1 --1- 172.21.15.133:0/1568689099 >> v1:172.21.15.190:6789/0 conn(0x7f65f00b1460 0x7f65f00b1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.133:54242/0 (socket says 172.21.15.133:54242) 2023-10-08T16:04:10.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65ef7fe700 1 -- 172.21.15.133:0/1568689099 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2080382273 0 0) 0x7f65e8001490 con 0x7f65f00b1460 2023-10-08T16:04:10.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65ef7fe700 1 -- 172.21.15.133:0/1568689099 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65dc003570 con 0x7f65f00b1460 2023-10-08T16:04:10.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65f4ae0700 1 -- 172.21.15.133:0/1568689099 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65f0070c00 msgr2=0x7f65f00ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:10.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65f4ae0700 1 --2- 172.21.15.133:0/1568689099 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65f0070c00 0x7f65f00ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65f4ae0700 1 -- 172.21.15.133:0/1568689099 >> v1:172.21.15.190:6789/0 conn(0x7f65f00b1460 legacy=0x7f65f00b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:10.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65f4ae0700 1 -- 172.21.15.133:0/1568689099 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f00af1b0 con 0x7f65f0070830 2023-10-08T16:04:10.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65f52e1700 1 --2- 172.21.15.133:0/1568689099 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65f0070c00 0x7f65f00ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:04:10.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65f4ae0700 1 --2- 172.21.15.133:0/1568689099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65f0070830 0x7f65f00ad920 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f65d80099b0 tx=0x7f65d8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6acd9dc21764c58 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:10.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65ef7fe700 1 -- 172.21.15.133:0/1568689099 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d800b680 con 0x7f65f0070830 2023-10-08T16:04:10.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65ef7fe700 1 -- 172.21.15.133:0/1568689099 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d800b7e0 con 0x7f65f0070830 2023-10-08T16:04:10.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65ef7fe700 1 -- 172.21.15.133:0/1568689099 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d800bba0 con 0x7f65f0070830 2023-10-08T16:04:10.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65f5ae2700 1 -- 172.21.15.133:0/1568689099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65f0070830 msgr2=0x7f65f00ad920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:10.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65f5ae2700 1 --2- 172.21.15.133:0/1568689099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65f0070830 0x7f65f00ad920 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f65d80099b0 tx=0x7f65d8009250 comp rx=0 tx=0).stop 2023-10-08T16:04:10.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65f5ae2700 1 -- 172.21.15.133:0/1568689099 shutdown_connections 2023-10-08T16:04:10.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65f5ae2700 1 --2- 172.21.15.133:0/1568689099 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65f0070c00 0x7f65f00ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65f5ae2700 1 --2- 172.21.15.133:0/1568689099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65f0070830 0x7f65f00ad920 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65f5ae2700 1 -- 172.21.15.133:0/1568689099 >> 172.21.15.133:0/1568689099 conn(0x7f65f0066f90 msgr2=0x7f65f0067390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:10.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65f5ae2700 1 -- 172.21.15.133:0/1568689099 shutdown_connections 2023-10-08T16:04:10.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.443+0000 7f65f5ae2700 1 -- 172.21.15.133:0/1568689099 wait complete. 2023-10-08T16:04:10.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.447+0000 7f65f5ae2700 1 Processor -- start 2023-10-08T16:04:10.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.447+0000 7f65f5ae2700 1 -- start start 2023-10-08T16:04:10.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.447+0000 7f65f5ae2700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65f0070830 0x7f65f00b5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:10.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.447+0000 7f65f5ae2700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65f0070c00 0x7f65f0143d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:10.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.447+0000 7f65f5ae2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65f00b1460 0x7f65f013d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:10.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.447+0000 7f65f5ae2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f00a6330 con 0x7f65f00b1460 2023-10-08T16:04:10.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.447+0000 7f65f5ae2700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f00a7fb0 con 0x7f65f0070c00 2023-10-08T16:04:10.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.447+0000 7f65f5ae2700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f00a76a0 con 0x7f65f0070830 2023-10-08T16:04:10.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.447+0000 7f65f52e1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65f00b1460 0x7f65f013d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:10.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.447+0000 7f65f52e1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65f00b1460 0x7f65f013d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52566/0 (socket says 172.21.15.133:52566) 2023-10-08T16:04:10.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.447+0000 7f65f4ae0700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65f0070830 0x7f65f00b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:10.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.447+0000 7f65f52e1700 1 -- 172.21.15.133:0/1159854731 learned_addr learned my addr 172.21.15.133:0/1159854731 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:10.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.447+0000 7f65effff700 1 --2- 172.21.15.133:0/1159854731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65f0070c00 0x7f65f0143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:10.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.451+0000 7f65f52e1700 1 -- 172.21.15.133:0/1159854731 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65f0070830 msgr2=0x7f65f00b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:10.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.451+0000 7f65f52e1700 1 --2- 172.21.15.133:0/1159854731 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65f0070830 0x7f65f00b5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.451+0000 7f65f52e1700 1 -- 172.21.15.133:0/1159854731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65f0070c00 msgr2=0x7f65f0143d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:10.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.451+0000 7f65f52e1700 1 --2- 172.21.15.133:0/1159854731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65f0070c00 0x7f65f0143d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.451+0000 7f65f52e1700 1 -- 172.21.15.133:0/1159854731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e0009420 con 0x7f65f00b1460 2023-10-08T16:04:10.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.451+0000 7f65f4ae0700 1 --2- 172.21.15.133:0/1159854731 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65f0070830 0x7f65f00b5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:04:10.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.451+0000 7f65f52e1700 1 --2- 172.21.15.133:0/1159854731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65f00b1460 0x7f65f013d3c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f65e000ec80 tx=0x7f65e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:10.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.451+0000 7f65ecff9700 1 -- 172.21.15.133:0/1159854731 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e000c850 con 0x7f65f00b1460 2023-10-08T16:04:10.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.451+0000 7f65ecff9700 1 -- 172.21.15.133:0/1159854731 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e000c9b0 con 0x7f65f00b1460 2023-10-08T16:04:10.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.451+0000 7f65f5ae2700 1 -- 172.21.15.133:0/1159854731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d80094f0 con 0x7f65f00b1460 2023-10-08T16:04:10.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.451+0000 7f65ecff9700 1 -- 172.21.15.133:0/1159854731 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e000cd50 con 0x7f65f00b1460 2023-10-08T16:04:10.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.451+0000 7f65f5ae2700 1 -- 172.21.15.133:0/1159854731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f00a7980 con 0x7f65f00b1460 2023-10-08T16:04:10.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.451+0000 7f65f5ae2700 1 -- 172.21.15.133:0/1159854731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f004be40 con 0x7f65f00b1460 2023-10-08T16:04:10.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.451+0000 7f65ecff9700 1 -- 172.21.15.133:0/1159854731 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f65e0013680 con 0x7f65f00b1460 2023-10-08T16:04:10.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.455+0000 7f65ecff9700 1 --2- 172.21.15.133:0/1159854731 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f65d0060550 0x7f65d0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:10.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.455+0000 7f65f4ae0700 1 --2- 172.21.15.133:0/1159854731 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f65d0060550 0x7f65d0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:10.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.455+0000 7f65ecff9700 1 -- 172.21.15.133:0/1159854731 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f65e007c490 con 0x7f65f00b1460 2023-10-08T16:04:10.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.455+0000 7f65f4ae0700 1 --2- 172.21.15.133:0/1159854731 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f65d0060550 0x7f65d0062a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f65d80099b0 tx=0x7f65d8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:10.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.459+0000 7f65ecff9700 1 -- 172.21.15.133:0/1159854731 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f65e004cdd0 con 0x7f65f00b1460 2023-10-08T16:04:10.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.615+0000 7f65f5ae2700 1 -- 172.21.15.133:0/1159854731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65f006bd50 con 0x7f65f00b1460 2023-10-08T16:04:10.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.619+0000 7f65ecff9700 1 -- 172.21.15.133:0/1159854731 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12175 (secure 0 0 0) 0x7f65e00503f0 con 0x7f65f00b1460 2023-10-08T16:04:10.621 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:04:10.622 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":16,"fsid":"f2546191-d59e-4805-8e1b-3d8d3d1dad86","created":"2023-10-08T16:03:52.631855+0000","modified":"2023-10-08T16:04:07.090975+0000","last_up_change":"2023-10-08T16:04:04.030581+0000","last_in_change":"2023-10-08T16:03:54.835293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:04.898316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"8c5deadf-a203-4d30-aa7f-6e2e492b6ffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6809","nonce":33493},{"type":"v1","addr":"172.21.15.133:6811","nonce":33493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":33493},{"type":"v1","addr":"172.21.15.133:6815","nonce":33493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":33493},{"type":"v1","addr":"172.21.15.133:6822","nonce":33493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":33493},{"type":"v1","addr":"172.21.15.133:6818","nonce":33493}]},"public_addr":"172.21.15.133:6811/33493","cluster_addr":"172.21.15.133:6815/33493","heartbeat_back_addr":"172.21.15.133:6822/33493","heartbeat_front_addr":"172.21.15.133:6818/33493","state":["exists","up"]},{"osd":1,"uuid":"9b081c42-c915-48c3-a1ad-410f09a78576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":33490},{"type":"v1","addr":"172.21.15.133:6801","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":33490},{"type":"v1","addr":"172.21.15.133:6803","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":33490},{"type":"v1","addr":"172.21.15.133:6807","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":33490},{"type":"v1","addr":"172.21.15.133:6805","nonce":33490}]},"public_addr":"172.21.15.133:6801/33490","cluster_addr":"172.21.15.133:6803/33490","heartbeat_back_addr":"172.21.15.133:6807/33490","heartbeat_front_addr":"172.21.15.133:6805/33490","state":["exists","up"]},{"osd":2,"uuid":"88ecda43-01cd-4644-ab0c-92c91fd38966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":33492},{"type":"v1","addr":"172.21.15.133:6825","nonce":33492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":33492},{"type":"v1","addr":"172.21.15.133:6827","nonce":33492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":33492},{"type":"v1","addr":"172.21.15.133:6831","nonce":33492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":33492},{"type":"v1","addr":"172.21.15.133:6829","nonce":33492}]},"public_addr":"172.21.15.133:6825/33492","cluster_addr":"172.21.15.133:6827/33492","heartbeat_back_addr":"172.21.15.133:6831/33492","heartbeat_front_addr":"172.21.15.133:6829/33492","state":["exists","up"]},{"osd":3,"uuid":"39faf38d-b8e2-4e11-9b3b-84dc834c977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":33491},{"type":"v1","addr":"172.21.15.133:6810","nonce":33491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":33491},{"type":"v1","addr":"172.21.15.133:6814","nonce":33491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":33491},{"type":"v1","addr":"172.21.15.133:6823","nonce":33491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":33491},{"type":"v1","addr":"172.21.15.133:6819","nonce":33491}]},"public_addr":"172.21.15.133:6810/33491","cluster_addr":"172.21.15.133:6814/33491","heartbeat_back_addr":"172.21.15.133:6823/33491","heartbeat_front_addr":"172.21.15.133:6819/33491","state":["exists","up"]},{"osd":4,"uuid":"4c097e61-1cad-4b61-9183-4e7bc486bd32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":33678},{"type":"v1","addr":"172.21.15.190:6810","nonce":33678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":33678},{"type":"v1","addr":"172.21.15.190:6814","nonce":33678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":33678},{"type":"v1","addr":"172.21.15.190:6822","nonce":33678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":33678},{"type":"v1","addr":"172.21.15.190:6818","nonce":33678}]},"public_addr":"172.21.15.190:6810/33678","cluster_addr":"172.21.15.190:6814/33678","heartbeat_back_addr":"172.21.15.190:6822/33678","heartbeat_front_addr":"172.21.15.190:6818/33678","state":["exists","up"]},{"osd":5,"uuid":"05f072e0-7bc0-40f0-8cb6-8e322c82d6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":33676},{"type":"v1","addr":"172.21.15.190:6811","nonce":33676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":33676},{"type":"v1","addr":"172.21.15.190:6815","nonce":33676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":33676},{"type":"v1","addr":"172.21.15.190:6823","nonce":33676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":33676},{"type":"v1","addr":"172.21.15.190:6819","nonce":33676}]},"public_addr":"172.21.15.190:6811/33676","cluster_addr":"172.21.15.190:6815/33676","heartbeat_back_addr":"172.21.15.190:6823/33676","heartbeat_front_addr":"172.21.15.190:6819/33676","state":["exists","up"]},{"osd":6,"uuid":"1bcce8d7-14f3-442d-b135-68c7d66cdedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":33677},{"type":"v1","addr":"172.21.15.190:6801","nonce":33677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":33677},{"type":"v1","addr":"172.21.15.190:6803","nonce":33677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":33677},{"type":"v1","addr":"172.21.15.190:6807","nonce":33677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":33677},{"type":"v1","addr":"172.21.15.190:6805","nonce":33677}]},"public_addr":"172.21.15.190:6801/33677","cluster_addr":"172.21.15.190:6803/33677","heartbeat_back_addr":"172.21.15.190:6807/33677","heartbeat_front_addr":"172.21.15.190:6805/33677","state":["exists","up"]},{"osd":7,"uuid":"9157dbf7-2bf9-43d7-a89a-a8e3dae7514c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":33686},{"type":"v1","addr":"172.21.15.190:6825","nonce":33686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":33686},{"type":"v1","addr":"172.21.15.190:6827","nonce":33686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":33686},{"type":"v1","addr":"172.21.15.190:6831","nonce":33686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":33686},{"type":"v1","addr":"172.21.15.190:6829","nonce":33686}]},"public_addr":"172.21.15.190:6825/33686","cluster_addr":"172.21.15.190:6827/33686","heartbeat_back_addr":"172.21.15.190:6831/33686","heartbeat_front_addr":"172.21.15.190:6829/33686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.886742+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.199618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.871695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.115926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.069650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.841448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.132320+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.315132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:04:10.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.619+0000 7f65f5ae2700 1 -- 172.21.15.133:0/1159854731 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f65d0060550 msgr2=0x7f65d0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:10.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.619+0000 7f65f5ae2700 1 --2- 172.21.15.133:0/1159854731 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f65d0060550 0x7f65d0062a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f65d80099b0 tx=0x7f65d8017000 comp rx=0 tx=0).stop 2023-10-08T16:04:10.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.619+0000 7f65f5ae2700 1 -- 172.21.15.133:0/1159854731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65f00b1460 msgr2=0x7f65f013d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:10.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.619+0000 7f65f5ae2700 1 --2- 172.21.15.133:0/1159854731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65f00b1460 0x7f65f013d3c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f65e000ec80 tx=0x7f65e00091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.619+0000 7f65f5ae2700 1 -- 172.21.15.133:0/1159854731 shutdown_connections 2023-10-08T16:04:10.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.619+0000 7f65f5ae2700 1 --2- 172.21.15.133:0/1159854731 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f65d0060550 0x7f65d0062a00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.619+0000 7f65f5ae2700 1 --2- 172.21.15.133:0/1159854731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65f00b1460 0x7f65f013d3c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.619+0000 7f65f5ae2700 1 --2- 172.21.15.133:0/1159854731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65f0070c00 0x7f65f0143d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.619+0000 7f65f5ae2700 1 --2- 172.21.15.133:0/1159854731 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65f0070830 0x7f65f00b5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.619+0000 7f65f5ae2700 1 -- 172.21.15.133:0/1159854731 >> 172.21.15.133:0/1159854731 conn(0x7f65f0066f90 msgr2=0x7f65f01450a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:10.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.619+0000 7f65f5ae2700 1 -- 172.21.15.133:0/1159854731 shutdown_connections 2023-10-08T16:04:10.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.619+0000 7f65f5ae2700 1 -- 172.21.15.133:0/1159854731 wait complete. 2023-10-08T16:04:10.635 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:04.898316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:04:10.636 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:04:10.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.747+0000 7f9e33340700 1 Processor -- start 2023-10-08T16:04:10.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.747+0000 7f9e33340700 1 -- start start 2023-10-08T16:04:10.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.747+0000 7f9e33340700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9e2c0b52d0 0x7f9e2c0ae040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:10.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.747+0000 7f9e33340700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9e2c0693a0 0x7f9e2c0ac5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:10.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.747+0000 7f9e33340700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e2c0acaf0 con 0x7f9e2c0ac150 2023-10-08T16:04:10.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.747+0000 7f9e33340700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e2c0ad6d0 con 0x7f9e2c0693a0 2023-10-08T16:04:10.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.747+0000 7f9e33340700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e2c0ae580 con 0x7f9e2c0b52d0 2023-10-08T16:04:10.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.747+0000 7f9e32b3f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9e2c0693a0 0x7f9e2c0ac5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:10.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.747+0000 7f9e32b3f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9e2c0693a0 0x7f9e2c0ac5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52582/0 (socket says 172.21.15.133:52582) 2023-10-08T16:04:10.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.747+0000 7f9e32b3f700 1 -- 172.21.15.133:0/1054857587 learned_addr learned my addr 172.21.15.133:0/1054857587 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:10.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.747+0000 7f9e3233e700 1 --2- 172.21.15.133:0/1054857587 >> v2:172.21.15.190:3300/0 conn(0x7f9e2c0b52d0 0x7f9e2c0ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:10.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.747+0000 7f9e32b3f700 1 -- 172.21.15.133:0/1054857587 >> v2:172.21.15.190:3300/0 conn(0x7f9e2c0b52d0 msgr2=0x7f9e2c0ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:10.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.747+0000 7f9e32b3f700 1 --2- 172.21.15.133:0/1054857587 >> v2:172.21.15.190:3300/0 conn(0x7f9e2c0b52d0 0x7f9e2c0ae040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.747+0000 7f9e32b3f700 1 -- 172.21.15.133:0/1054857587 >> v1:172.21.15.190:6789/0 conn(0x7f9e2c0ac150 legacy=0x7f9e2c141cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:10.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.747+0000 7f9e32b3f700 1 -- 172.21.15.133:0/1054857587 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2c0ad8d0 con 0x7f9e2c0693a0 2023-10-08T16:04:10.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.747+0000 7f9e32b3f700 1 --2- 172.21.15.133:0/1054857587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e2c0693a0 0x7f9e2c0ac5b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c068840 tx=0x7f9e1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60053604ec279589 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:10.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.747+0000 7f9e3133c700 1 -- 172.21.15.133:0/1054857587 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c00b820 con 0x7f9e2c0693a0 2023-10-08T16:04:10.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.747+0000 7f9e3133c700 1 -- 172.21.15.133:0/1054857587 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1c00b980 con 0x7f9e2c0693a0 2023-10-08T16:04:10.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.747+0000 7f9e3133c700 1 -- 172.21.15.133:0/1054857587 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c00bd40 con 0x7f9e2c0693a0 2023-10-08T16:04:10.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.751+0000 7f9e33340700 1 -- 172.21.15.133:0/1054857587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e2c0693a0 msgr2=0x7f9e2c0ac5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:10.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.751+0000 7f9e33340700 1 --2- 172.21.15.133:0/1054857587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e2c0693a0 0x7f9e2c0ac5b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c068840 tx=0x7f9e1c009250 comp rx=0 tx=0).stop 2023-10-08T16:04:10.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.751+0000 7f9e33340700 1 -- 172.21.15.133:0/1054857587 shutdown_connections 2023-10-08T16:04:10.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.751+0000 7f9e33340700 1 --2- 172.21.15.133:0/1054857587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e2c0693a0 0x7f9e2c0ac5b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.751+0000 7f9e33340700 1 --2- 172.21.15.133:0/1054857587 >> v2:172.21.15.190:3300/0 conn(0x7f9e2c0b52d0 0x7f9e2c0ae040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.751+0000 7f9e33340700 1 -- 172.21.15.133:0/1054857587 >> 172.21.15.133:0/1054857587 conn(0x7f9e2c068420 msgr2=0x7f9e2c070830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:10.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.751+0000 7f9e33340700 1 -- 172.21.15.133:0/1054857587 shutdown_connections 2023-10-08T16:04:10.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.751+0000 7f9e33340700 1 -- 172.21.15.133:0/1054857587 wait complete. 2023-10-08T16:04:10.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.751+0000 7f9e33340700 1 Processor -- start 2023-10-08T16:04:10.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.751+0000 7f9e33340700 1 -- start start 2023-10-08T16:04:10.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.755+0000 7f9e33340700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e2c0693a0 0x7f9e2c13ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:10.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.755+0000 7f9e33340700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e2c0ac150 0x7f9e2c153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:10.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.755+0000 7f9e33340700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e2c0b52d0 0x7f9e2c13eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:10.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.755+0000 7f9e33340700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c13e210 con 0x7f9e2c0b52d0 2023-10-08T16:04:10.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.755+0000 7f9e33340700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c1537c0 con 0x7f9e2c0ac150 2023-10-08T16:04:10.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.755+0000 7f9e33340700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c153aa0 con 0x7f9e2c0693a0 2023-10-08T16:04:10.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.755+0000 7f9e32b3f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e2c0b52d0 0x7f9e2c13eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:10.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.755+0000 7f9e3233e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e2c0693a0 0x7f9e2c13ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:10.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.755+0000 7f9e32b3f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e2c0b52d0 0x7f9e2c13eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52590/0 (socket says 172.21.15.133:52590) 2023-10-08T16:04:10.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.755+0000 7f9e32b3f700 1 -- 172.21.15.133:0/347000232 learned_addr learned my addr 172.21.15.133:0/347000232 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:10.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.755+0000 7f9e31b3d700 1 --2- 172.21.15.133:0/347000232 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e2c0ac150 0x7f9e2c153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:10.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.755+0000 7f9e32b3f700 1 -- 172.21.15.133:0/347000232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e2c0693a0 msgr2=0x7f9e2c13ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:10.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.755+0000 7f9e32b3f700 1 --2- 172.21.15.133:0/347000232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e2c0693a0 0x7f9e2c13ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.755+0000 7f9e32b3f700 1 -- 172.21.15.133:0/347000232 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e2c0ac150 msgr2=0x7f9e2c153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:10.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.755+0000 7f9e32b3f700 1 --2- 172.21.15.133:0/347000232 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e2c0ac150 0x7f9e2c153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.755+0000 7f9e32b3f700 1 -- 172.21.15.133:0/347000232 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e1c0094f0 con 0x7f9e2c0b52d0 2023-10-08T16:04:10.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.755+0000 7f9e32b3f700 1 --2- 172.21.15.133:0/347000232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e2c0b52d0 0x7f9e2c13eb60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c006fd0 tx=0x7f9e1c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:10.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.755+0000 7f9e2a7fc700 1 -- 172.21.15.133:0/347000232 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c00b820 con 0x7f9e2c0b52d0 2023-10-08T16:04:10.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.755+0000 7f9e2a7fc700 1 -- 172.21.15.133:0/347000232 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1c020070 con 0x7f9e2c0b52d0 2023-10-08T16:04:10.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.755+0000 7f9e33340700 1 -- 172.21.15.133:0/347000232 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e2c13cfb0 con 0x7f9e2c0b52d0 2023-10-08T16:04:10.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.755+0000 7f9e2a7fc700 1 -- 172.21.15.133:0/347000232 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c01b680 con 0x7f9e2c0b52d0 2023-10-08T16:04:10.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.755+0000 7f9e33340700 1 -- 172.21.15.133:0/347000232 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e2c13d2d0 con 0x7f9e2c0b52d0 2023-10-08T16:04:10.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.759+0000 7f9e2a7fc700 1 -- 172.21.15.133:0/347000232 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9e1c022030 con 0x7f9e2c0b52d0 2023-10-08T16:04:10.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.759+0000 7f9e33340700 1 -- 172.21.15.133:0/347000232 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e2c0b3f40 con 0x7f9e2c0b52d0 2023-10-08T16:04:10.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.759+0000 7f9e2a7fc700 1 --2- 172.21.15.133:0/347000232 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f9e18060550 0x7f9e18062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:10.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.759+0000 7f9e3233e700 1 --2- 172.21.15.133:0/347000232 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f9e18060550 0x7f9e18062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:10.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.759+0000 7f9e2a7fc700 1 -- 172.21.15.133:0/347000232 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9e1c07e410 con 0x7f9e2c0b52d0 2023-10-08T16:04:10.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.759+0000 7f9e3233e700 1 --2- 172.21.15.133:0/347000232 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f9e18060550 0x7f9e18062a00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9e20006fd0 tx=0x7f9e20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:10.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.763+0000 7f9e2a7fc700 1 -- 172.21.15.133:0/347000232 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9e2c0b3f40 con 0x7f9e2c0b52d0 2023-10-08T16:04:10.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.923+0000 7f9e33340700 1 -- 172.21.15.133:0/347000232 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9e2c0b3f40 con 0x7f9e2c0b52d0 2023-10-08T16:04:10.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.923+0000 7f9e2a7fc700 1 -- 172.21.15.133:0/347000232 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9e2c0b3f40 con 0x7f9e2c0b52d0 2023-10-08T16:04:10.925 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-10-08T16:04:10.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.923+0000 7f9e33340700 1 -- 172.21.15.133:0/347000232 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f9e18060550 msgr2=0x7f9e18062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:10.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.923+0000 7f9e33340700 1 --2- 172.21.15.133:0/347000232 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f9e18060550 0x7f9e18062a00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9e20006fd0 tx=0x7f9e20008040 comp rx=0 tx=0).stop 2023-10-08T16:04:10.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.923+0000 7f9e33340700 1 -- 172.21.15.133:0/347000232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e2c0b52d0 msgr2=0x7f9e2c13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:10.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.923+0000 7f9e33340700 1 --2- 172.21.15.133:0/347000232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e2c0b52d0 0x7f9e2c13eb60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c006fd0 tx=0x7f9e1c016000 comp rx=0 tx=0).stop 2023-10-08T16:04:10.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.923+0000 7f9e33340700 1 -- 172.21.15.133:0/347000232 shutdown_connections 2023-10-08T16:04:10.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.923+0000 7f9e33340700 1 --2- 172.21.15.133:0/347000232 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f9e18060550 0x7f9e18062a00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.923+0000 7f9e33340700 1 --2- 172.21.15.133:0/347000232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e2c0b52d0 0x7f9e2c13eb60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.923+0000 7f9e33340700 1 --2- 172.21.15.133:0/347000232 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e2c0ac150 0x7f9e2c153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.923+0000 7f9e33340700 1 --2- 172.21.15.133:0/347000232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e2c0693a0 0x7f9e2c13ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:10.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.923+0000 7f9e33340700 1 -- 172.21.15.133:0/347000232 >> 172.21.15.133:0/347000232 conn(0x7f9e2c068420 msgr2=0x7f9e2c1387a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:10.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.923+0000 7f9e33340700 1 -- 172.21.15.133:0/347000232 shutdown_connections 2023-10-08T16:04:10.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:10.923+0000 7f9e33340700 1 -- 172.21.15.133:0/347000232 wait complete. 2023-10-08T16:04:10.940 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:04:11.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.035+0000 7f6913fb7700 1 Processor -- start 2023-10-08T16:04:11.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6913fb7700 1 -- start start 2023-10-08T16:04:11.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6913fb7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f690c0b57b0 0x7f690c0b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:11.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6913fb7700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f690c0b0860 0x7f690c145af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:11.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6913fb7700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f690c0b2ae0 con 0x7f690c0b4cf0 2023-10-08T16:04:11.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6913fb7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f690c0b1090 con 0x7f690c0b57b0 2023-10-08T16:04:11.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6913fb7700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690c0b1d60 con 0x7f690c0b0860 2023-10-08T16:04:11.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6911d53700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f690c0b57b0 0x7f690c0b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:11.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6911d53700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f690c0b57b0 0x7f690c0b5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52602/0 (socket says 172.21.15.133:52602) 2023-10-08T16:04:11.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6911d53700 1 -- 172.21.15.133:0/2577411393 learned_addr learned my addr 172.21.15.133:0/2577411393 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:11.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6911552700 1 --2- 172.21.15.133:0/2577411393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f690c0b0860 0x7f690c145af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:11.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6911d53700 1 -- 172.21.15.133:0/2577411393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f690c0b0860 msgr2=0x7f690c145af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:11.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6911d53700 1 --2- 172.21.15.133:0/2577411393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f690c0b0860 0x7f690c145af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:11.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6911d53700 1 -- 172.21.15.133:0/2577411393 >> v1:172.21.15.190:6789/0 conn(0x7f690c0b4cf0 legacy=0x7f690c142570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:11.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6910d51700 1 -- 172.21.15.133:0/2577411393 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1600884068 0 0) 0x7f690c0b2ae0 con 0x7f690c0b4cf0 2023-10-08T16:04:11.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6911d53700 1 -- 172.21.15.133:0/2577411393 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690c0b60c0 con 0x7f690c0b57b0 2023-10-08T16:04:11.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6911d53700 1 --2- 172.21.15.133:0/2577411393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f690c0b57b0 0x7f690c0b5b80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f69080099a0 tx=0x7f6908009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea42f9bdfd2f82d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:11.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6910d51700 1 -- 172.21.15.133:0/2577411393 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6908009e90 con 0x7f690c0b57b0 2023-10-08T16:04:11.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6910d51700 1 -- 172.21.15.133:0/2577411393 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690800b860 con 0x7f690c0b57b0 2023-10-08T16:04:11.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6910d51700 1 -- 172.21.15.133:0/2577411393 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690800bc20 con 0x7f690c0b57b0 2023-10-08T16:04:11.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6913fb7700 1 -- 172.21.15.133:0/2577411393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f690c0b57b0 msgr2=0x7f690c0b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:11.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6913fb7700 1 --2- 172.21.15.133:0/2577411393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f690c0b57b0 0x7f690c0b5b80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f69080099a0 tx=0x7f6908009250 comp rx=0 tx=0).stop 2023-10-08T16:04:11.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6913fb7700 1 -- 172.21.15.133:0/2577411393 shutdown_connections 2023-10-08T16:04:11.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6913fb7700 1 --2- 172.21.15.133:0/2577411393 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f690c0b0860 0x7f690c145af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:11.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6913fb7700 1 --2- 172.21.15.133:0/2577411393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f690c0b57b0 0x7f690c0b5b80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:11.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6913fb7700 1 -- 172.21.15.133:0/2577411393 >> 172.21.15.133:0/2577411393 conn(0x7f690c062ba0 msgr2=0x7f690c062fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:11.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6913fb7700 1 -- 172.21.15.133:0/2577411393 shutdown_connections 2023-10-08T16:04:11.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.039+0000 7f6913fb7700 1 -- 172.21.15.133:0/2577411393 wait complete. 2023-10-08T16:04:11.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.043+0000 7f6913fb7700 1 Processor -- start 2023-10-08T16:04:11.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.043+0000 7f6913fb7700 1 -- start start 2023-10-08T16:04:11.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.043+0000 7f6913fb7700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f690c0b0860 0x7f690c0a7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:11.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.043+0000 7f6913fb7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f690c0b4cf0 0x7f690c152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:11.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.043+0000 7f6913fb7700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f690c0b57b0 0x7f690c152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:11.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.043+0000 7f6913fb7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c1520b0 con 0x7f690c0b4cf0 2023-10-08T16:04:11.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.043+0000 7f6913fb7700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c0a6740 con 0x7f690c0b0860 2023-10-08T16:04:11.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.043+0000 7f6911552700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f690c0b4cf0 0x7f690c152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:11.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.043+0000 7f6913fb7700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690c0a69e0 con 0x7f690c0b57b0 2023-10-08T16:04:11.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.043+0000 7f6911552700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f690c0b4cf0 0x7f690c152540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52608/0 (socket says 172.21.15.133:52608) 2023-10-08T16:04:11.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.043+0000 7f6911552700 1 -- 172.21.15.133:0/1033405130 learned_addr learned my addr 172.21.15.133:0/1033405130 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:11.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.043+0000 7f6911d53700 1 --2- 172.21.15.133:0/1033405130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f690c0b0860 0x7f690c0a7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:11.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.043+0000 7f6912554700 1 --2- 172.21.15.133:0/1033405130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f690c0b57b0 0x7f690c152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:11.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.043+0000 7f6911552700 1 -- 172.21.15.133:0/1033405130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f690c0b57b0 msgr2=0x7f690c152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:11.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.043+0000 7f6911552700 1 --2- 172.21.15.133:0/1033405130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f690c0b57b0 0x7f690c152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:11.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.043+0000 7f6911552700 1 -- 172.21.15.133:0/1033405130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f690c0b0860 msgr2=0x7f690c0a7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:11.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.043+0000 7f6911552700 1 --2- 172.21.15.133:0/1033405130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f690c0b0860 0x7f690c0a7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:11.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.043+0000 7f6911552700 1 -- 172.21.15.133:0/1033405130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6908009490 con 0x7f690c0b4cf0 2023-10-08T16:04:11.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.043+0000 7f6912554700 1 --2- 172.21.15.133:0/1033405130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f690c0b57b0 0x7f690c152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:04:11.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.047+0000 7f6911552700 1 --2- 172.21.15.133:0/1033405130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f690c0b4cf0 0x7f690c152540 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f690000e930 tx=0x7f69000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:11.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.047+0000 7f68fdffb700 1 -- 172.21.15.133:0/1033405130 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690000eed0 con 0x7f690c0b4cf0 2023-10-08T16:04:11.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.047+0000 7f68fdffb700 1 -- 172.21.15.133:0/1033405130 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690000c850 con 0x7f690c0b4cf0 2023-10-08T16:04:11.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.047+0000 7f6913fb7700 1 -- 172.21.15.133:0/1033405130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f690c0a7d60 con 0x7f690c0b4cf0 2023-10-08T16:04:11.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.047+0000 7f68fdffb700 1 -- 172.21.15.133:0/1033405130 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690000cbf0 con 0x7f690c0b4cf0 2023-10-08T16:04:11.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.047+0000 7f6913fb7700 1 -- 172.21.15.133:0/1033405130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690c0a70e0 con 0x7f690c0b4cf0 2023-10-08T16:04:11.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.047+0000 7f6913fb7700 1 -- 172.21.15.133:0/1033405130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f690c064810 con 0x7f690c0b4cf0 2023-10-08T16:04:11.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.047+0000 7f68fdffb700 1 -- 172.21.15.133:0/1033405130 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6900013470 con 0x7f690c0b4cf0 2023-10-08T16:04:11.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.047+0000 7f68fdffb700 1 --2- 172.21.15.133:0/1033405130 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f68f0060550 0x7f68f0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:11.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.047+0000 7f68fdffb700 1 -- 172.21.15.133:0/1033405130 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f690007c670 con 0x7f690c0b4cf0 2023-10-08T16:04:11.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.047+0000 7f6911d53700 1 --2- 172.21.15.133:0/1033405130 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f68f0060550 0x7f68f0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:11.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.047+0000 7f6911d53700 1 --2- 172.21.15.133:0/1033405130 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f68f0060550 0x7f68f0062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f69080099a0 tx=0x7f6908017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:11.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.055+0000 7f68fdffb700 1 -- 172.21.15.133:0/1033405130 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f690004cfb0 con 0x7f690c0b4cf0 2023-10-08T16:04:11.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.251+0000 7f6913fb7700 1 -- 172.21.15.133:0/1033405130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f690c0b2770 con 0x7f690c0b4cf0 2023-10-08T16:04:11.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.251+0000 7f68fdffb700 1 -- 172.21.15.133:0/1033405130 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1259 (secure 0 0 0) 0x7f69000505d0 con 0x7f690c0b4cf0 2023-10-08T16:04:11.255 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:04:11.255 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3690493804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3690493804},{"type":"v1","addr":"172.21.15.190:6833","nonce":3690493804}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-08T16:04:11.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.255+0000 7f6913fb7700 1 -- 172.21.15.133:0/1033405130 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f68f0060550 msgr2=0x7f68f0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:11.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.255+0000 7f6913fb7700 1 --2- 172.21.15.133:0/1033405130 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f68f0060550 0x7f68f0062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f69080099a0 tx=0x7f6908017000 comp rx=0 tx=0).stop 2023-10-08T16:04:11.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.255+0000 7f6913fb7700 1 -- 172.21.15.133:0/1033405130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f690c0b4cf0 msgr2=0x7f690c152540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:11.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.255+0000 7f6913fb7700 1 --2- 172.21.15.133:0/1033405130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f690c0b4cf0 0x7f690c152540 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f690000e930 tx=0x7f69000091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:11.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.255+0000 7f6913fb7700 1 -- 172.21.15.133:0/1033405130 shutdown_connections 2023-10-08T16:04:11.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.255+0000 7f6913fb7700 1 --2- 172.21.15.133:0/1033405130 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f68f0060550 0x7f68f0062a00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:11.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.255+0000 7f6913fb7700 1 --2- 172.21.15.133:0/1033405130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f690c0b57b0 0x7f690c152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:11.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.255+0000 7f6913fb7700 1 --2- 172.21.15.133:0/1033405130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f690c0b4cf0 0x7f690c152540 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:11.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.255+0000 7f6913fb7700 1 --2- 172.21.15.133:0/1033405130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f690c0b0860 0x7f690c0a7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:11.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.255+0000 7f6913fb7700 1 -- 172.21.15.133:0/1033405130 >> 172.21.15.133:0/1033405130 conn(0x7f690c062ba0 msgr2=0x7f690c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:11.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.255+0000 7f6913fb7700 1 -- 172.21.15.133:0/1033405130 shutdown_connections 2023-10-08T16:04:11.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:11.255+0000 7f6913fb7700 1 -- 172.21.15.133:0/1033405130 wait complete. 2023-10-08T16:04:11.259 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 2 2023-10-08T16:04:13.270 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:04:13.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.383+0000 7fbf6316d700 1 Processor -- start 2023-10-08T16:04:13.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.383+0000 7fbf6316d700 1 -- start start 2023-10-08T16:04:13.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.383+0000 7fbf6316d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf5c0b06f0 0x7fbf5c0aea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:13.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.383+0000 7fbf6316d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbf5c067ea0 0x7fbf5c0b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:13.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.383+0000 7fbf6316d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf5c0b1260 con 0x7fbf5c142130 2023-10-08T16:04:13.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.383+0000 7fbf6316d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf5c0ad980 con 0x7fbf5c067ea0 2023-10-08T16:04:13.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.383+0000 7fbf6316d700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c0adda0 con 0x7fbf5c0b06f0 2023-10-08T16:04:13.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.383+0000 7fbf6296c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbf5c142130 0x7fbf5c142550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34648/0 (socket says 172.21.15.133:34648) 2023-10-08T16:04:13.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.383+0000 7fbf6196a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbf5c067ea0 0x7fbf5c0b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:13.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.383+0000 7fbf6296c700 1 -- 172.21.15.133:0/2406104817 learned_addr learned my addr 172.21.15.133:0/2406104817 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:13.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.383+0000 7fbf6216b700 1 --2- 172.21.15.133:0/2406104817 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf5c0b06f0 0x7fbf5c0aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:13.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.383+0000 7fbf61169700 1 -- 172.21.15.133:0/2406104817 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732121568 0 0) 0x7fbf5c0b1260 con 0x7fbf5c142130 2023-10-08T16:04:13.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.383+0000 7fbf61169700 1 -- 172.21.15.133:0/2406104817 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf48003570 con 0x7fbf5c142130 2023-10-08T16:04:13.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.387+0000 7fbf6196a700 1 -- 172.21.15.133:0/2406104817 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf5c0b06f0 msgr2=0x7fbf5c0aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:13.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.387+0000 7fbf6196a700 1 --2- 172.21.15.133:0/2406104817 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf5c0b06f0 0x7fbf5c0aea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:13.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.387+0000 7fbf6196a700 1 -- 172.21.15.133:0/2406104817 >> v1:172.21.15.133:6789/0 conn(0x7fbf5c142130 legacy=0x7fbf5c142550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:13.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.387+0000 7fbf6196a700 1 -- 172.21.15.133:0/2406104817 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5c0682d0 con 0x7fbf5c067ea0 2023-10-08T16:04:13.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.387+0000 7fbf6196a700 1 --2- 172.21.15.133:0/2406104817 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf5c067ea0 0x7fbf5c0b1b90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009e60 tx=0x7fbf58009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=849a7acbe17ff4e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:13.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.387+0000 7fbf61169700 1 -- 172.21.15.133:0/2406104817 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5800e070 con 0x7fbf5c067ea0 2023-10-08T16:04:13.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.387+0000 7fbf61169700 1 -- 172.21.15.133:0/2406104817 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5800bab0 con 0x7fbf5c067ea0 2023-10-08T16:04:13.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.387+0000 7fbf61169700 1 -- 172.21.15.133:0/2406104817 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5800be50 con 0x7fbf5c067ea0 2023-10-08T16:04:13.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.387+0000 7fbf6316d700 1 -- 172.21.15.133:0/2406104817 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf5c067ea0 msgr2=0x7fbf5c0b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:13.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.387+0000 7fbf6316d700 1 --2- 172.21.15.133:0/2406104817 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf5c067ea0 0x7fbf5c0b1b90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009e60 tx=0x7fbf58009780 comp rx=0 tx=0).stop 2023-10-08T16:04:13.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.387+0000 7fbf6316d700 1 -- 172.21.15.133:0/2406104817 shutdown_connections 2023-10-08T16:04:13.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.387+0000 7fbf6316d700 1 --2- 172.21.15.133:0/2406104817 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf5c067ea0 0x7fbf5c0b1b90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:13.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.387+0000 7fbf6316d700 1 --2- 172.21.15.133:0/2406104817 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf5c0b06f0 0x7fbf5c0aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:13.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.387+0000 7fbf6316d700 1 -- 172.21.15.133:0/2406104817 >> 172.21.15.133:0/2406104817 conn(0x7fbf5c063670 msgr2=0x7fbf5c0b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:13.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.387+0000 7fbf6316d700 1 -- 172.21.15.133:0/2406104817 shutdown_connections 2023-10-08T16:04:13.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.387+0000 7fbf6316d700 1 -- 172.21.15.133:0/2406104817 wait complete. 2023-10-08T16:04:13.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.387+0000 7fbf6316d700 1 Processor -- start 2023-10-08T16:04:13.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.387+0000 7fbf6316d700 1 -- start start 2023-10-08T16:04:13.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.391+0000 7fbf6316d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf5c067ea0 0x7fbf5c138710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:13.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.391+0000 7fbf6316d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf5c0b06f0 0x7fbf5c153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:13.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.391+0000 7fbf6316d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf5c142130 0x7fbf5c153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:13.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.391+0000 7fbf6316d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c154010 con 0x7fbf5c142130 2023-10-08T16:04:13.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.391+0000 7fbf6316d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c137f20 con 0x7fbf5c0b06f0 2023-10-08T16:04:13.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.391+0000 7fbf6316d700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c138c50 con 0x7fbf5c067ea0 2023-10-08T16:04:13.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.391+0000 7fbf6296c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf5c142130 0x7fbf5c153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:13.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.391+0000 7fbf6296c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf5c142130 0x7fbf5c153ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52624/0 (socket says 172.21.15.133:52624) 2023-10-08T16:04:13.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.391+0000 7fbf6296c700 1 -- 172.21.15.133:0/3043075803 learned_addr learned my addr 172.21.15.133:0/3043075803 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:13.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.391+0000 7fbf6196a700 1 --2- 172.21.15.133:0/3043075803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf5c0b06f0 0x7fbf5c153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:13.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.391+0000 7fbf6216b700 1 --2- 172.21.15.133:0/3043075803 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf5c067ea0 0x7fbf5c138710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:13.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.391+0000 7fbf6296c700 1 -- 172.21.15.133:0/3043075803 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf5c067ea0 msgr2=0x7fbf5c138710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:13.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.391+0000 7fbf6296c700 1 --2- 172.21.15.133:0/3043075803 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf5c067ea0 0x7fbf5c138710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:13.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.391+0000 7fbf6296c700 1 -- 172.21.15.133:0/3043075803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf5c0b06f0 msgr2=0x7fbf5c153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:13.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.391+0000 7fbf6296c700 1 --2- 172.21.15.133:0/3043075803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf5c0b06f0 0x7fbf5c153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:13.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.391+0000 7fbf6296c700 1 -- 172.21.15.133:0/3043075803 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf58009a20 con 0x7fbf5c142130 2023-10-08T16:04:13.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.391+0000 7fbf6296c700 1 --2- 172.21.15.133:0/3043075803 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf5c142130 0x7fbf5c153ad0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbf540010e0 tx=0x7fbf54007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:13.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.391+0000 7fbf527fc700 1 -- 172.21.15.133:0/3043075803 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf54005b30 con 0x7fbf5c142130 2023-10-08T16:04:13.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.391+0000 7fbf527fc700 1 -- 172.21.15.133:0/3043075803 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf54005c90 con 0x7fbf5c142130 2023-10-08T16:04:13.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.391+0000 7fbf6316d700 1 -- 172.21.15.133:0/3043075803 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf5c1370c0 con 0x7fbf5c142130 2023-10-08T16:04:13.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.391+0000 7fbf527fc700 1 -- 172.21.15.133:0/3043075803 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf540072e0 con 0x7fbf5c142130 2023-10-08T16:04:13.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.391+0000 7fbf6316d700 1 -- 172.21.15.133:0/3043075803 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf5c137360 con 0x7fbf5c142130 2023-10-08T16:04:13.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.391+0000 7fbf6316d700 1 -- 172.21.15.133:0/3043075803 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf5c138160 con 0x7fbf5c142130 2023-10-08T16:04:13.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.395+0000 7fbf527fc700 1 -- 172.21.15.133:0/3043075803 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbf54012400 con 0x7fbf5c142130 2023-10-08T16:04:13.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.395+0000 7fbf527fc700 1 --2- 172.21.15.133:0/3043075803 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fbf40060550 0x7fbf40062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:13.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.395+0000 7fbf527fc700 1 -- 172.21.15.133:0/3043075803 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbf5407b750 con 0x7fbf5c142130 2023-10-08T16:04:13.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.395+0000 7fbf6216b700 1 --2- 172.21.15.133:0/3043075803 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fbf40060550 0x7fbf40062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:13.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.395+0000 7fbf6216b700 1 --2- 172.21.15.133:0/3043075803 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fbf40060550 0x7fbf40062a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c009db0 tx=0x7fbf4c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:13.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.403+0000 7fbf527fc700 1 -- 172.21.15.133:0/3043075803 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbf54049be0 con 0x7fbf5c142130 2023-10-08T16:04:13.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.591+0000 7fbf6316d700 1 -- 172.21.15.133:0/3043075803 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf5c04be40 con 0x7fbf5c142130 2023-10-08T16:04:13.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.591+0000 7fbf527fc700 1 -- 172.21.15.133:0/3043075803 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2015 (secure 0 0 0) 0x7fbf540177f0 con 0x7fbf5c142130 2023-10-08T16:04:13.596 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:04:13.596 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3690493804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3690493804},{"type":"v1","addr":"172.21.15.190:6833","nonce":3690493804}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/443398897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":443398897},{"type":"v1","addr":"172.21.15.133:6835","nonce":443398897}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-08T16:04:13.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.595+0000 7fbf6316d700 1 -- 172.21.15.133:0/3043075803 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fbf40060550 msgr2=0x7fbf40062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:13.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.595+0000 7fbf6316d700 1 --2- 172.21.15.133:0/3043075803 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fbf40060550 0x7fbf40062a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c009db0 tx=0x7fbf4c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:13.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.595+0000 7fbf6316d700 1 -- 172.21.15.133:0/3043075803 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf5c142130 msgr2=0x7fbf5c153ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:13.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.595+0000 7fbf6316d700 1 --2- 172.21.15.133:0/3043075803 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf5c142130 0x7fbf5c153ad0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbf540010e0 tx=0x7fbf54007dd0 comp rx=0 tx=0).stop 2023-10-08T16:04:13.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.595+0000 7fbf6316d700 1 -- 172.21.15.133:0/3043075803 shutdown_connections 2023-10-08T16:04:13.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.595+0000 7fbf6316d700 1 --2- 172.21.15.133:0/3043075803 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fbf40060550 0x7fbf40062a00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:13.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.595+0000 7fbf6316d700 1 --2- 172.21.15.133:0/3043075803 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf5c142130 0x7fbf5c153ad0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:13.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.595+0000 7fbf6316d700 1 --2- 172.21.15.133:0/3043075803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf5c0b06f0 0x7fbf5c153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:13.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.595+0000 7fbf6316d700 1 --2- 172.21.15.133:0/3043075803 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf5c067ea0 0x7fbf5c138710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:13.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.595+0000 7fbf6316d700 1 -- 172.21.15.133:0/3043075803 >> 172.21.15.133:0/3043075803 conn(0x7fbf5c063670 msgr2=0x7fbf5c0ac260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:13.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.599+0000 7fbf6316d700 1 -- 172.21.15.133:0/3043075803 shutdown_connections 2023-10-08T16:04:13.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.599+0000 7fbf6316d700 1 -- 172.21.15.133:0/3043075803 wait complete. 2023-10-08T16:04:13.602 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 3 2023-10-08T16:04:13.613 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:04:13.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.711+0000 7f9710e33700 1 Processor -- start 2023-10-08T16:04:13.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.711+0000 7f9710e33700 1 -- start start 2023-10-08T16:04:13.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.711+0000 7f9710e33700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f970c067ea0 0x7f970c0aea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:13.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.711+0000 7f9710e33700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f970c0b06f0 0x7f970c142130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:13.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.711+0000 7f9710e33700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f970c0b1260 con 0x7f970c142670 2023-10-08T16:04:13.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.711+0000 7f9710e33700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f970c0ad980 con 0x7f970c0b06f0 2023-10-08T16:04:13.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.711+0000 7f9710e33700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f970c0b22a0 con 0x7f970c067ea0 2023-10-08T16:04:13.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.711+0000 7f970affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f970c0b06f0 0x7f970c142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:13.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.711+0000 7f970affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f970c0b06f0 0x7f970c142130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52638/0 (socket says 172.21.15.133:52638) 2023-10-08T16:04:13.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.711+0000 7f970affd700 1 -- 172.21.15.133:0/3289375660 learned_addr learned my addr 172.21.15.133:0/3289375660 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:13.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.711+0000 7f970b7fe700 1 --2- 172.21.15.133:0/3289375660 >> v2:172.21.15.190:3300/0 conn(0x7f970c067ea0 0x7f970c0aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:13.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.711+0000 7f970affd700 1 -- 172.21.15.133:0/3289375660 >> v2:172.21.15.190:3300/0 conn(0x7f970c067ea0 msgr2=0x7f970c0aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:13.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.711+0000 7f970affd700 1 --2- 172.21.15.133:0/3289375660 >> v2:172.21.15.190:3300/0 conn(0x7f970c067ea0 0x7f970c0aea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:13.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.711+0000 7f970affd700 1 -- 172.21.15.133:0/3289375660 >> v1:172.21.15.190:6789/0 conn(0x7f970c142670 legacy=0x7f970c0b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:13.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.711+0000 7f970affd700 1 -- 172.21.15.133:0/3289375660 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970c0adda0 con 0x7f970c0b06f0 2023-10-08T16:04:13.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.711+0000 7f970affd700 1 --2- 172.21.15.133:0/3289375660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970c0b06f0 0x7f970c142130 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f970c063aa0 tx=0x7f9704009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f12a009834780c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:13.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.711+0000 7f970a7fc700 1 -- 172.21.15.133:0/3289375660 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970400e070 con 0x7f970c0b06f0 2023-10-08T16:04:13.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.711+0000 7f970a7fc700 1 -- 172.21.15.133:0/3289375660 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970400b990 con 0x7f970c0b06f0 2023-10-08T16:04:13.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.711+0000 7f970a7fc700 1 -- 172.21.15.133:0/3289375660 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97040092e0 con 0x7f970c0b06f0 2023-10-08T16:04:13.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.711+0000 7f9710e33700 1 -- 172.21.15.133:0/3289375660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970c0b06f0 msgr2=0x7f970c142130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:13.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.711+0000 7f9710e33700 1 --2- 172.21.15.133:0/3289375660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970c0b06f0 0x7f970c142130 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f970c063aa0 tx=0x7f9704009840 comp rx=0 tx=0).stop 2023-10-08T16:04:13.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.711+0000 7f9710e33700 1 -- 172.21.15.133:0/3289375660 shutdown_connections 2023-10-08T16:04:13.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.711+0000 7f9710e33700 1 --2- 172.21.15.133:0/3289375660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970c0b06f0 0x7f970c142130 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:13.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.711+0000 7f9710e33700 1 --2- 172.21.15.133:0/3289375660 >> v2:172.21.15.190:3300/0 conn(0x7f970c067ea0 0x7f970c0aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:13.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.711+0000 7f9710e33700 1 -- 172.21.15.133:0/3289375660 >> 172.21.15.133:0/3289375660 conn(0x7f970c063670 msgr2=0x7f970c0b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:13.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f9710e33700 1 -- 172.21.15.133:0/3289375660 shutdown_connections 2023-10-08T16:04:13.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f9710e33700 1 -- 172.21.15.133:0/3289375660 wait complete. 2023-10-08T16:04:13.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f9710e33700 1 Processor -- start 2023-10-08T16:04:13.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f9710e33700 1 -- start start 2023-10-08T16:04:13.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f9710e33700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f970c067ea0 0x7f970c1378e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:13.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f9710e33700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970c0b06f0 0x7f970c13ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:13.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f9710e33700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f970c142670 0x7f970c138a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:13.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f9710e33700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c139150 con 0x7f970c0b06f0 2023-10-08T16:04:13.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f9710e33700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c139360 con 0x7f970c142670 2023-10-08T16:04:13.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f9710e33700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970c13fa30 con 0x7f970c067ea0 2023-10-08T16:04:13.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f970affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970c0b06f0 0x7f970c13ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:13.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f970affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970c0b06f0 0x7f970c13ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52650/0 (socket says 172.21.15.133:52650) 2023-10-08T16:04:13.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f970affd700 1 -- 172.21.15.133:0/130395727 learned_addr learned my addr 172.21.15.133:0/130395727 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:13.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f970b7fe700 1 --2- 172.21.15.133:0/130395727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f970c067ea0 0x7f970c1378e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:13.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f970bfff700 1 --2- 172.21.15.133:0/130395727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f970c142670 0x7f970c138a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:13.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f970affd700 1 -- 172.21.15.133:0/130395727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f970c067ea0 msgr2=0x7f970c1378e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:13.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f970affd700 1 --2- 172.21.15.133:0/130395727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f970c067ea0 0x7f970c1378e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:13.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f970affd700 1 -- 172.21.15.133:0/130395727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f970c142670 msgr2=0x7f970c138a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:13.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f970affd700 1 --2- 172.21.15.133:0/130395727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f970c142670 0x7f970c138a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:13.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f970affd700 1 -- 172.21.15.133:0/130395727 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9704009ae0 con 0x7f970c0b06f0 2023-10-08T16:04:13.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f970b7fe700 1 --2- 172.21.15.133:0/130395727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f970c067ea0 0x7f970c1378e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:13.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f970bfff700 1 --2- 172.21.15.133:0/130395727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f970c142670 0x7f970c138a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:13.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f970affd700 1 --2- 172.21.15.133:0/130395727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970c0b06f0 0x7f970c13ac00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9704012000 tx=0x7f9704018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:13.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f96f37fe700 1 -- 172.21.15.133:0/130395727 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9704007930 con 0x7f970c0b06f0 2023-10-08T16:04:13.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f96f37fe700 1 -- 172.21.15.133:0/130395727 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9704007ab0 con 0x7f970c0b06f0 2023-10-08T16:04:13.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f9710e33700 1 -- 172.21.15.133:0/130395727 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f970c136c40 con 0x7f970c0b06f0 2023-10-08T16:04:13.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f96f37fe700 1 -- 172.21.15.133:0/130395727 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9704007e70 con 0x7f970c0b06f0 2023-10-08T16:04:13.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.715+0000 7f9710e33700 1 -- 172.21.15.133:0/130395727 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f970c13f300 con 0x7f970c0b06f0 2023-10-08T16:04:13.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.719+0000 7f9710e33700 1 -- 172.21.15.133:0/130395727 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f970c13ee80 con 0x7f970c0b06f0 2023-10-08T16:04:13.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.719+0000 7f96f37fe700 1 -- 172.21.15.133:0/130395727 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f970401d420 con 0x7f970c0b06f0 2023-10-08T16:04:13.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.719+0000 7f96f37fe700 1 --2- 172.21.15.133:0/130395727 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f96f8060580 0x7f96f8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:13.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.719+0000 7f96f37fe700 1 -- 172.21.15.133:0/130395727 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f970407e200 con 0x7f970c0b06f0 2023-10-08T16:04:13.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.719+0000 7f970b7fe700 1 --2- 172.21.15.133:0/130395727 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f96f8060580 0x7f96f8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:13.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.723+0000 7f970b7fe700 1 --2- 172.21.15.133:0/130395727 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f96f8060580 0x7f96f8062a30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f970c13bb00 tx=0x7f9700008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:13.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.727+0000 7f96f37fe700 1 -- 172.21.15.133:0/130395727 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f970c13ee80 con 0x7f970c0b06f0 2023-10-08T16:04:13.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.887+0000 7f9710e33700 1 -- 172.21.15.133:0/130395727 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f970c1396d0 con 0x7f970c0b06f0 2023-10-08T16:04:13.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.891+0000 7f96f37fe700 1 -- 172.21.15.133:0/130395727 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12175 (secure 0 0 0) 0x7f970c1396d0 con 0x7f970c0b06f0 2023-10-08T16:04:13.894 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:04:13.894 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":16,"fsid":"f2546191-d59e-4805-8e1b-3d8d3d1dad86","created":"2023-10-08T16:03:52.631855+0000","modified":"2023-10-08T16:04:07.090975+0000","last_up_change":"2023-10-08T16:04:04.030581+0000","last_in_change":"2023-10-08T16:03:54.835293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:04.898316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"8c5deadf-a203-4d30-aa7f-6e2e492b6ffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6809","nonce":33493},{"type":"v1","addr":"172.21.15.133:6811","nonce":33493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":33493},{"type":"v1","addr":"172.21.15.133:6815","nonce":33493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":33493},{"type":"v1","addr":"172.21.15.133:6822","nonce":33493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":33493},{"type":"v1","addr":"172.21.15.133:6818","nonce":33493}]},"public_addr":"172.21.15.133:6811/33493","cluster_addr":"172.21.15.133:6815/33493","heartbeat_back_addr":"172.21.15.133:6822/33493","heartbeat_front_addr":"172.21.15.133:6818/33493","state":["exists","up"]},{"osd":1,"uuid":"9b081c42-c915-48c3-a1ad-410f09a78576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":33490},{"type":"v1","addr":"172.21.15.133:6801","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":33490},{"type":"v1","addr":"172.21.15.133:6803","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":33490},{"type":"v1","addr":"172.21.15.133:6807","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":33490},{"type":"v1","addr":"172.21.15.133:6805","nonce":33490}]},"public_addr":"172.21.15.133:6801/33490","cluster_addr":"172.21.15.133:6803/33490","heartbeat_back_addr":"172.21.15.133:6807/33490","heartbeat_front_addr":"172.21.15.133:6805/33490","state":["exists","up"]},{"osd":2,"uuid":"88ecda43-01cd-4644-ab0c-92c91fd38966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":33492},{"type":"v1","addr":"172.21.15.133:6825","nonce":33492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":33492},{"type":"v1","addr":"172.21.15.133:6827","nonce":33492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":33492},{"type":"v1","addr":"172.21.15.133:6831","nonce":33492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":33492},{"type":"v1","addr":"172.21.15.133:6829","nonce":33492}]},"public_addr":"172.21.15.133:6825/33492","cluster_addr":"172.21.15.133:6827/33492","heartbeat_back_addr":"172.21.15.133:6831/33492","heartbeat_front_addr":"172.21.15.133:6829/33492","state":["exists","up"]},{"osd":3,"uuid":"39faf38d-b8e2-4e11-9b3b-84dc834c977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":33491},{"type":"v1","addr":"172.21.15.133:6810","nonce":33491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":33491},{"type":"v1","addr":"172.21.15.133:6814","nonce":33491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":33491},{"type":"v1","addr":"172.21.15.133:6823","nonce":33491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":33491},{"type":"v1","addr":"172.21.15.133:6819","nonce":33491}]},"public_addr":"172.21.15.133:6810/33491","cluster_addr":"172.21.15.133:6814/33491","heartbeat_back_addr":"172.21.15.133:6823/33491","heartbeat_front_addr":"172.21.15.133:6819/33491","state":["exists","up"]},{"osd":4,"uuid":"4c097e61-1cad-4b61-9183-4e7bc486bd32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":33678},{"type":"v1","addr":"172.21.15.190:6810","nonce":33678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":33678},{"type":"v1","addr":"172.21.15.190:6814","nonce":33678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":33678},{"type":"v1","addr":"172.21.15.190:6822","nonce":33678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":33678},{"type":"v1","addr":"172.21.15.190:6818","nonce":33678}]},"public_addr":"172.21.15.190:6810/33678","cluster_addr":"172.21.15.190:6814/33678","heartbeat_back_addr":"172.21.15.190:6822/33678","heartbeat_front_addr":"172.21.15.190:6818/33678","state":["exists","up"]},{"osd":5,"uuid":"05f072e0-7bc0-40f0-8cb6-8e322c82d6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":33676},{"type":"v1","addr":"172.21.15.190:6811","nonce":33676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":33676},{"type":"v1","addr":"172.21.15.190:6815","nonce":33676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":33676},{"type":"v1","addr":"172.21.15.190:6823","nonce":33676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":33676},{"type":"v1","addr":"172.21.15.190:6819","nonce":33676}]},"public_addr":"172.21.15.190:6811/33676","cluster_addr":"172.21.15.190:6815/33676","heartbeat_back_addr":"172.21.15.190:6823/33676","heartbeat_front_addr":"172.21.15.190:6819/33676","state":["exists","up"]},{"osd":6,"uuid":"1bcce8d7-14f3-442d-b135-68c7d66cdedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":33677},{"type":"v1","addr":"172.21.15.190:6801","nonce":33677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":33677},{"type":"v1","addr":"172.21.15.190:6803","nonce":33677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":33677},{"type":"v1","addr":"172.21.15.190:6807","nonce":33677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":33677},{"type":"v1","addr":"172.21.15.190:6805","nonce":33677}]},"public_addr":"172.21.15.190:6801/33677","cluster_addr":"172.21.15.190:6803/33677","heartbeat_back_addr":"172.21.15.190:6807/33677","heartbeat_front_addr":"172.21.15.190:6805/33677","state":["exists","up"]},{"osd":7,"uuid":"9157dbf7-2bf9-43d7-a89a-a8e3dae7514c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":33686},{"type":"v1","addr":"172.21.15.190:6825","nonce":33686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":33686},{"type":"v1","addr":"172.21.15.190:6827","nonce":33686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":33686},{"type":"v1","addr":"172.21.15.190:6831","nonce":33686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":33686},{"type":"v1","addr":"172.21.15.190:6829","nonce":33686}]},"public_addr":"172.21.15.190:6825/33686","cluster_addr":"172.21.15.190:6827/33686","heartbeat_back_addr":"172.21.15.190:6831/33686","heartbeat_front_addr":"172.21.15.190:6829/33686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.886742+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.199618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.871695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.115926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.069650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.841448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.132320+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.315132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:04:13.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.895+0000 7f9710e33700 1 -- 172.21.15.133:0/130395727 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f96f8060580 msgr2=0x7f96f8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:13.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.895+0000 7f9710e33700 1 --2- 172.21.15.133:0/130395727 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f96f8060580 0x7f96f8062a30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f970c13bb00 tx=0x7f9700008040 comp rx=0 tx=0).stop 2023-10-08T16:04:13.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.895+0000 7f9710e33700 1 -- 172.21.15.133:0/130395727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970c0b06f0 msgr2=0x7f970c13ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:13.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.895+0000 7f9710e33700 1 --2- 172.21.15.133:0/130395727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970c0b06f0 0x7f970c13ac00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9704012000 tx=0x7f9704018000 comp rx=0 tx=0).stop 2023-10-08T16:04:13.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.895+0000 7f9710e33700 1 -- 172.21.15.133:0/130395727 shutdown_connections 2023-10-08T16:04:13.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.895+0000 7f9710e33700 1 --2- 172.21.15.133:0/130395727 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f96f8060580 0x7f96f8062a30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:13.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.895+0000 7f9710e33700 1 --2- 172.21.15.133:0/130395727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f970c142670 0x7f970c138a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:13.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.895+0000 7f9710e33700 1 --2- 172.21.15.133:0/130395727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970c0b06f0 0x7f970c13ac00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:13.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.895+0000 7f9710e33700 1 --2- 172.21.15.133:0/130395727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f970c067ea0 0x7f970c1378e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:13.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.895+0000 7f9710e33700 1 -- 172.21.15.133:0/130395727 >> 172.21.15.133:0/130395727 conn(0x7f970c063670 msgr2=0x7f970c0b48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:13.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.895+0000 7f9710e33700 1 -- 172.21.15.133:0/130395727 shutdown_connections 2023-10-08T16:04:13.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:13.895+0000 7f9710e33700 1 -- 172.21.15.133:0/130395727 wait complete. 2023-10-08T16:04:13.914 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:04.898316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:04:13.914 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:04:14.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f92556c6700 1 Processor -- start 2023-10-08T16:04:14.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f92556c6700 1 -- start start 2023-10-08T16:04:14.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f92556c6700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9250067ed0 0x7f92500addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:14.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f92556c6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f92500afc20 0x7f92501516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:14.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f92556c6700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92500b1460 con 0x7f92500ae2f0 2023-10-08T16:04:14.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f92556c6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92500abd20 con 0x7f92500afc20 2023-10-08T16:04:14.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f92556c6700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92500ae770 con 0x7f9250067ed0 2023-10-08T16:04:14.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f924f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f92500afc20 0x7f92501516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:14.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f924f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f92500afc20 0x7f92501516b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52660/0 (socket says 172.21.15.133:52660) 2023-10-08T16:04:14.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f924f7fe700 1 -- 172.21.15.133:0/4126147878 learned_addr learned my addr 172.21.15.133:0/4126147878 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:14.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f924effd700 1 --2- 172.21.15.133:0/4126147878 >> v2:172.21.15.190:3300/0 conn(0x7f9250067ed0 0x7f92500addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:14.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f924f7fe700 1 -- 172.21.15.133:0/4126147878 >> v2:172.21.15.190:3300/0 conn(0x7f9250067ed0 msgr2=0x7f92500addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:14.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f924f7fe700 1 --2- 172.21.15.133:0/4126147878 >> v2:172.21.15.190:3300/0 conn(0x7f9250067ed0 0x7f92500addb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:14.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f924f7fe700 1 -- 172.21.15.133:0/4126147878 >> v1:172.21.15.190:6789/0 conn(0x7f92500ae2f0 legacy=0x7f92500af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:14.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f924f7fe700 1 -- 172.21.15.133:0/4126147878 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9250068bb0 con 0x7f92500afc20 2023-10-08T16:04:14.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f924f7fe700 1 --2- 172.21.15.133:0/4126147878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92500afc20 0x7f92501516b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f92400099e0 tx=0x7f9240009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4daa8530b5adde0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:14.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f924dffb700 1 -- 172.21.15.133:0/4126147878 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924000b7e0 con 0x7f92500afc20 2023-10-08T16:04:14.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f924dffb700 1 -- 172.21.15.133:0/4126147878 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924000b940 con 0x7f92500afc20 2023-10-08T16:04:14.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f924dffb700 1 -- 172.21.15.133:0/4126147878 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924000bd00 con 0x7f92500afc20 2023-10-08T16:04:14.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f92556c6700 1 -- 172.21.15.133:0/4126147878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92500afc20 msgr2=0x7f92501516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:14.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f92556c6700 1 --2- 172.21.15.133:0/4126147878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92500afc20 0x7f92501516b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f92400099e0 tx=0x7f9240009250 comp rx=0 tx=0).stop 2023-10-08T16:04:14.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f92556c6700 1 -- 172.21.15.133:0/4126147878 shutdown_connections 2023-10-08T16:04:14.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f92556c6700 1 --2- 172.21.15.133:0/4126147878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92500afc20 0x7f92501516b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:14.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f92556c6700 1 --2- 172.21.15.133:0/4126147878 >> v2:172.21.15.190:3300/0 conn(0x7f9250067ed0 0x7f92500addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:14.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f92556c6700 1 -- 172.21.15.133:0/4126147878 >> 172.21.15.133:0/4126147878 conn(0x7f9250063670 msgr2=0x7f92500b4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:14.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f92556c6700 1 -- 172.21.15.133:0/4126147878 shutdown_connections 2023-10-08T16:04:14.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.023+0000 7f92556c6700 1 -- 172.21.15.133:0/4126147878 wait complete. 2023-10-08T16:04:14.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.027+0000 7f92556c6700 1 Processor -- start 2023-10-08T16:04:14.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.027+0000 7f92556c6700 1 -- start start 2023-10-08T16:04:14.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.027+0000 7f92556c6700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9250067ed0 0x7f925014a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:14.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.027+0000 7f92556c6700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92500ae2f0 0x7f925014b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:14.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.027+0000 7f92556c6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92500afc20 0x7f925013f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:14.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.027+0000 7f92556c6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9250149b90 con 0x7f92500afc20 2023-10-08T16:04:14.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.027+0000 7f92556c6700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925014c250 con 0x7f9250067ed0 2023-10-08T16:04:14.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.027+0000 7f92556c6700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925014aae0 con 0x7f92500ae2f0 2023-10-08T16:04:14.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.027+0000 7f924f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92500afc20 0x7f925013f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:14.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.027+0000 7f924f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92500afc20 0x7f925013f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52666/0 (socket says 172.21.15.133:52666) 2023-10-08T16:04:14.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.027+0000 7f924f7fe700 1 -- 172.21.15.133:0/3699979881 learned_addr learned my addr 172.21.15.133:0/3699979881 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:14.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.027+0000 7f924effd700 1 --2- 172.21.15.133:0/3699979881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9250067ed0 0x7f925014a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:14.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.027+0000 7f924e7fc700 1 --2- 172.21.15.133:0/3699979881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92500ae2f0 0x7f925014b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:14.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.027+0000 7f924f7fe700 1 -- 172.21.15.133:0/3699979881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92500ae2f0 msgr2=0x7f925014b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:14.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.027+0000 7f924f7fe700 1 --2- 172.21.15.133:0/3699979881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92500ae2f0 0x7f925014b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:14.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.027+0000 7f924f7fe700 1 -- 172.21.15.133:0/3699979881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9250067ed0 msgr2=0x7f925014a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:14.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.027+0000 7f924f7fe700 1 --2- 172.21.15.133:0/3699979881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9250067ed0 0x7f925014a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:14.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.027+0000 7f924f7fe700 1 -- 172.21.15.133:0/3699979881 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92400094f0 con 0x7f92500afc20 2023-10-08T16:04:14.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.031+0000 7f924f7fe700 1 --2- 172.21.15.133:0/3699979881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92500afc20 0x7f925013f1c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9240006fd0 tx=0x7f9240016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:14.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.031+0000 7f9236ffd700 1 -- 172.21.15.133:0/3699979881 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924000b7e0 con 0x7f92500afc20 2023-10-08T16:04:14.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.031+0000 7f9236ffd700 1 -- 172.21.15.133:0/3699979881 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924001c460 con 0x7f92500afc20 2023-10-08T16:04:14.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.031+0000 7f92556c6700 1 -- 172.21.15.133:0/3699979881 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f925014c4f0 con 0x7f92500afc20 2023-10-08T16:04:14.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.031+0000 7f9236ffd700 1 -- 172.21.15.133:0/3699979881 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9240011ea0 con 0x7f92500afc20 2023-10-08T16:04:14.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.031+0000 7f92556c6700 1 -- 172.21.15.133:0/3699979881 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925006afd0 con 0x7f92500afc20 2023-10-08T16:04:14.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.031+0000 7f92556c6700 1 -- 172.21.15.133:0/3699979881 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f925013f8a0 con 0x7f92500afc20 2023-10-08T16:04:14.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.031+0000 7f9236ffd700 1 -- 172.21.15.133:0/3699979881 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f924001caf0 con 0x7f92500afc20 2023-10-08T16:04:14.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.031+0000 7f9236ffd700 1 --2- 172.21.15.133:0/3699979881 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f923c060550 0x7f923c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:14.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.031+0000 7f9236ffd700 1 -- 172.21.15.133:0/3699979881 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f924007e8c0 con 0x7f92500afc20 2023-10-08T16:04:14.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.031+0000 7f924effd700 1 --2- 172.21.15.133:0/3699979881 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f923c060550 0x7f923c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:14.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.035+0000 7f924effd700 1 --2- 172.21.15.133:0/3699979881 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f923c060550 0x7f923c062a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f92480075a0 tx=0x7f92480097e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:14.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.039+0000 7f9236ffd700 1 -- 172.21.15.133:0/3699979881 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f925013f8a0 con 0x7f92500afc20 2023-10-08T16:04:14.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.203+0000 7f92556c6700 1 -- 172.21.15.133:0/3699979881 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f925013f8a0 con 0x7f92500afc20 2023-10-08T16:04:14.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.203+0000 7f9236ffd700 1 -- 172.21.15.133:0/3699979881 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f925013f8a0 con 0x7f92500afc20 2023-10-08T16:04:14.208 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-10-08T16:04:14.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.207+0000 7f92556c6700 1 -- 172.21.15.133:0/3699979881 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f923c060550 msgr2=0x7f923c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:14.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.207+0000 7f92556c6700 1 --2- 172.21.15.133:0/3699979881 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f923c060550 0x7f923c062a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f92480075a0 tx=0x7f92480097e0 comp rx=0 tx=0).stop 2023-10-08T16:04:14.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.207+0000 7f92556c6700 1 -- 172.21.15.133:0/3699979881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92500afc20 msgr2=0x7f925013f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:14.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.207+0000 7f92556c6700 1 --2- 172.21.15.133:0/3699979881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92500afc20 0x7f925013f1c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9240006fd0 tx=0x7f9240016000 comp rx=0 tx=0).stop 2023-10-08T16:04:14.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.207+0000 7f92556c6700 1 -- 172.21.15.133:0/3699979881 shutdown_connections 2023-10-08T16:04:14.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.207+0000 7f92556c6700 1 --2- 172.21.15.133:0/3699979881 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f923c060550 0x7f923c062a00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:14.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.207+0000 7f92556c6700 1 --2- 172.21.15.133:0/3699979881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92500afc20 0x7f925013f1c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:14.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.207+0000 7f92556c6700 1 --2- 172.21.15.133:0/3699979881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92500ae2f0 0x7f925014b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:14.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.207+0000 7f92556c6700 1 --2- 172.21.15.133:0/3699979881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9250067ed0 0x7f925014a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:14.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.207+0000 7f92556c6700 1 -- 172.21.15.133:0/3699979881 >> 172.21.15.133:0/3699979881 conn(0x7f9250063670 msgr2=0x7f925014d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:14.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.207+0000 7f92556c6700 1 -- 172.21.15.133:0/3699979881 shutdown_connections 2023-10-08T16:04:14.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.207+0000 7f92556c6700 1 -- 172.21.15.133:0/3699979881 wait complete. 2023-10-08T16:04:14.228 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T16:04:14.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.327+0000 7ff34334f700 1 Processor -- start 2023-10-08T16:04:14.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.327+0000 7ff34334f700 1 -- start start 2023-10-08T16:04:14.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.327+0000 7ff34334f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff33c0ae200 0x7ff33c142610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:14.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.327+0000 7ff34334f700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff33c0ae5d0 0x7ff33c0ac680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:14.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.327+0000 7ff34334f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff33c142180 con 0x7ff33c06e070 2023-10-08T16:04:14.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.327+0000 7ff34334f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33c0acbc0 con 0x7ff33c0ae200 2023-10-08T16:04:14.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.327+0000 7ff34334f700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33c0abd20 con 0x7ff33c0ae5d0 2023-10-08T16:04:14.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.327+0000 7ff3418ec700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff33c06e070 0x7ff33c06e4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34650/0 (socket says 172.21.15.133:34650) 2023-10-08T16:04:14.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.327+0000 7ff3410eb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff33c0ae200 0x7ff33c142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:14.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.327+0000 7ff3418ec700 1 -- 172.21.15.133:0/2497346281 learned_addr learned my addr 172.21.15.133:0/2497346281 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:14.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.331+0000 7ff3408ea700 1 --2- 172.21.15.133:0/2497346281 >> v2:172.21.15.190:3300/0 conn(0x7ff33c0ae5d0 0x7ff33c0ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:14.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.331+0000 7ff3410eb700 1 -- 172.21.15.133:0/2497346281 >> v2:172.21.15.190:3300/0 conn(0x7ff33c0ae5d0 msgr2=0x7ff33c0ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:14.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.331+0000 7ff3410eb700 1 --2- 172.21.15.133:0/2497346281 >> v2:172.21.15.190:3300/0 conn(0x7ff33c0ae5d0 0x7ff33c0ac680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:14.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.331+0000 7ff3410eb700 1 -- 172.21.15.133:0/2497346281 >> v1:172.21.15.133:6789/0 conn(0x7ff33c06e070 legacy=0x7ff33c06e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:14.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.331+0000 7ff3410eb700 1 -- 172.21.15.133:0/2497346281 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c141b70 con 0x7ff33c0ae200 2023-10-08T16:04:14.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.331+0000 7ff333fff700 1 -- 172.21.15.133:0/2497346281 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 653393183 0 0) 0x7ff33c142180 con 0x7ff33c06e070 2023-10-08T16:04:14.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.331+0000 7ff3408ea700 1 --2- 172.21.15.133:0/2497346281 >> v2:172.21.15.190:3300/0 conn(0x7ff33c0ae5d0 0x7ff33c0ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:14.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.331+0000 7ff3410eb700 1 --2- 172.21.15.133:0/2497346281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff33c0ae200 0x7ff33c142610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff33c13c0e0 tx=0x7ff32c00a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee9ee2ba47fbe15 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:14.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.331+0000 7ff333fff700 1 -- 172.21.15.133:0/2497346281 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00c970 con 0x7ff33c0ae200 2023-10-08T16:04:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.331+0000 7ff333fff700 1 -- 172.21.15.133:0/2497346281 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32c00cad0 con 0x7ff33c0ae200 2023-10-08T16:04:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.331+0000 7ff333fff700 1 -- 172.21.15.133:0/2497346281 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00ce70 con 0x7ff33c0ae200 2023-10-08T16:04:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.331+0000 7ff34334f700 1 -- 172.21.15.133:0/2497346281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff33c0ae200 msgr2=0x7ff33c142610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.331+0000 7ff34334f700 1 --2- 172.21.15.133:0/2497346281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff33c0ae200 0x7ff33c142610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff33c13c0e0 tx=0x7ff32c00a330 comp rx=0 tx=0).stop 2023-10-08T16:04:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.331+0000 7ff34334f700 1 -- 172.21.15.133:0/2497346281 shutdown_connections 2023-10-08T16:04:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.331+0000 7ff34334f700 1 --2- 172.21.15.133:0/2497346281 >> v2:172.21.15.190:3300/0 conn(0x7ff33c0ae5d0 0x7ff33c0ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.331+0000 7ff34334f700 1 --2- 172.21.15.133:0/2497346281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff33c0ae200 0x7ff33c142610 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.331+0000 7ff34334f700 1 -- 172.21.15.133:0/2497346281 >> 172.21.15.133:0/2497346281 conn(0x7ff33c0b4ba0 msgr2=0x7ff33c0b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.331+0000 7ff34334f700 1 -- 172.21.15.133:0/2497346281 shutdown_connections 2023-10-08T16:04:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.331+0000 7ff34334f700 1 -- 172.21.15.133:0/2497346281 wait complete. 2023-10-08T16:04:14.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.331+0000 7ff34334f700 1 Processor -- start 2023-10-08T16:04:14.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.331+0000 7ff34334f700 1 -- start start 2023-10-08T16:04:14.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.335+0000 7ff34334f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff33c06e070 0x7ff33c151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:14.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.335+0000 7ff34334f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff33c0ae5d0 0x7ff33c068420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:14.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.335+0000 7ff34334f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff33c14d8e0 0x7ff33c13a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:14.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.335+0000 7ff34334f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c142c80 con 0x7ff33c0ae5d0 2023-10-08T16:04:14.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.335+0000 7ff34334f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c14e890 con 0x7ff33c14d8e0 2023-10-08T16:04:14.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.335+0000 7ff34334f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c13a700 con 0x7ff33c06e070 2023-10-08T16:04:14.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.335+0000 7ff3408ea700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff33c0ae5d0 0x7ff33c068420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:14.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.335+0000 7ff3408ea700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff33c0ae5d0 0x7ff33c068420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52674/0 (socket says 172.21.15.133:52674) 2023-10-08T16:04:14.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.335+0000 7ff3408ea700 1 -- 172.21.15.133:0/3288191630 learned_addr learned my addr 172.21.15.133:0/3288191630 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:14.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.335+0000 7ff3410eb700 1 --2- 172.21.15.133:0/3288191630 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff33c06e070 0x7ff33c151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:14.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.335+0000 7ff3418ec700 1 --2- 172.21.15.133:0/3288191630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff33c14d8e0 0x7ff33c13a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:14.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.335+0000 7ff3408ea700 1 -- 172.21.15.133:0/3288191630 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff33c06e070 msgr2=0x7ff33c151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:14.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.335+0000 7ff3408ea700 1 --2- 172.21.15.133:0/3288191630 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff33c06e070 0x7ff33c151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:14.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.335+0000 7ff3408ea700 1 -- 172.21.15.133:0/3288191630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff33c14d8e0 msgr2=0x7ff33c13a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:14.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.335+0000 7ff3408ea700 1 --2- 172.21.15.133:0/3288191630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff33c14d8e0 0x7ff33c13a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:14.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.335+0000 7ff3408ea700 1 -- 172.21.15.133:0/3288191630 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c00a5d0 con 0x7ff33c0ae5d0 2023-10-08T16:04:14.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.335+0000 7ff3418ec700 1 --2- 172.21.15.133:0/3288191630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff33c14d8e0 0x7ff33c13a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:14.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.335+0000 7ff3408ea700 1 --2- 172.21.15.133:0/3288191630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff33c0ae5d0 0x7ff33c068420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff33800d890 tx=0x7ff338008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:14.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.335+0000 7ff3317fa700 1 -- 172.21.15.133:0/3288191630 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3380125f0 con 0x7ff33c0ae5d0 2023-10-08T16:04:14.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.335+0000 7ff3317fa700 1 -- 172.21.15.133:0/3288191630 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff338012750 con 0x7ff33c0ae5d0 2023-10-08T16:04:14.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.335+0000 7ff3317fa700 1 -- 172.21.15.133:0/3288191630 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff338012af0 con 0x7ff33c0ae5d0 2023-10-08T16:04:14.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.335+0000 7ff34334f700 1 -- 172.21.15.133:0/3288191630 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff33c150f80 con 0x7ff33c0ae5d0 2023-10-08T16:04:14.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.335+0000 7ff34334f700 1 -- 172.21.15.133:0/3288191630 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff33c143950 con 0x7ff33c0ae5d0 2023-10-08T16:04:14.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.335+0000 7ff34334f700 1 -- 172.21.15.133:0/3288191630 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff33c064810 con 0x7ff33c0ae5d0 2023-10-08T16:04:14.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.339+0000 7ff3317fa700 1 -- 172.21.15.133:0/3288191630 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff338027430 con 0x7ff33c0ae5d0 2023-10-08T16:04:14.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.339+0000 7ff3317fa700 1 --2- 172.21.15.133:0/3288191630 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff320060550 0x7ff320062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:14.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.339+0000 7ff3410eb700 1 --2- 172.21.15.133:0/3288191630 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff320060550 0x7ff320062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:14.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.339+0000 7ff3317fa700 1 -- 172.21.15.133:0/3288191630 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff33807d3e0 con 0x7ff33c0ae5d0 2023-10-08T16:04:14.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.339+0000 7ff3410eb700 1 --2- 172.21.15.133:0/3288191630 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff320060550 0x7ff320062a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff33c069570 tx=0x7ff32c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:14.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.343+0000 7ff3317fa700 1 -- 172.21.15.133:0/3288191630 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff33804dd20 con 0x7ff33c0ae5d0 2023-10-08T16:04:14.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.507+0000 7ff34334f700 1 -- 172.21.15.133:0/3288191630 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff33c13bec0 con 0x7ff33c0ae5d0 2023-10-08T16:04:14.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.507+0000 7ff3317fa700 1 -- 172.21.15.133:0/3288191630 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff338051340 con 0x7ff33c0ae5d0 2023-10-08T16:04:14.510 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:04:14.510 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2023-10-08T16:04:14.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:04:14.510 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2023-10-08T16:04:14.510 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": ".mgr" 2023-10-08T16:04:14.511 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:04:14.511 INFO:teuthology.orchestra.run.smithi133.stdout:] 2023-10-08T16:04:14.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.507+0000 7ff34334f700 1 -- 172.21.15.133:0/3288191630 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff320060550 msgr2=0x7ff320062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:14.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.507+0000 7ff34334f700 1 --2- 172.21.15.133:0/3288191630 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff320060550 0x7ff320062a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff33c069570 tx=0x7ff32c017000 comp rx=0 tx=0).stop 2023-10-08T16:04:14.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.511+0000 7ff34334f700 1 -- 172.21.15.133:0/3288191630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff33c0ae5d0 msgr2=0x7ff33c068420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:14.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.511+0000 7ff34334f700 1 --2- 172.21.15.133:0/3288191630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff33c0ae5d0 0x7ff33c068420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff33800d890 tx=0x7ff338008040 comp rx=0 tx=0).stop 2023-10-08T16:04:14.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.511+0000 7ff34334f700 1 -- 172.21.15.133:0/3288191630 shutdown_connections 2023-10-08T16:04:14.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.511+0000 7ff34334f700 1 --2- 172.21.15.133:0/3288191630 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff320060550 0x7ff320062a00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:14.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.511+0000 7ff34334f700 1 --2- 172.21.15.133:0/3288191630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff33c14d8e0 0x7ff33c13a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:14.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.511+0000 7ff34334f700 1 --2- 172.21.15.133:0/3288191630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff33c0ae5d0 0x7ff33c068420 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:14.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.511+0000 7ff34334f700 1 --2- 172.21.15.133:0/3288191630 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff33c06e070 0x7ff33c151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:14.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.511+0000 7ff34334f700 1 -- 172.21.15.133:0/3288191630 >> 172.21.15.133:0/3288191630 conn(0x7ff33c0b4ba0 msgr2=0x7ff33c06e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:14.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.511+0000 7ff34334f700 1 -- 172.21.15.133:0/3288191630 shutdown_connections 2023-10-08T16:04:14.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.511+0000 7ff34334f700 1 -- 172.21.15.133:0/3288191630 wait complete. 2023-10-08T16:04:14.528 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T16:04:14.528 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T16:04:14.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac694b700 1 Processor -- start 2023-10-08T16:04:14.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac694b700 1 -- start start 2023-10-08T16:04:14.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac694b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6ac0142bb0 0x7f6ac013c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:14.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac694b700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6ac0143010 0x7f6ac013c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:14.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac694b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac013cb20 con 0x7f6ac0070a60 2023-10-08T16:04:14.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac694b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac0145820 con 0x7f6ac0142bb0 2023-10-08T16:04:14.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac694b700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac00ab280 con 0x7f6ac0143010 2023-10-08T16:04:14.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac5148700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6ac0142bb0 0x7f6ac013c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:14.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac5148700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6ac0142bb0 0x7f6ac013c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52680/0 (socket says 172.21.15.133:52680) 2023-10-08T16:04:14.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac5148700 1 -- 172.21.15.133:0/3971209786 learned_addr learned my addr 172.21.15.133:0/3971209786 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:14.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac5949700 1 --1- 172.21.15.133:0/3971209786 >> v1:172.21.15.133:6789/0 conn(0x7f6ac0070a60 0x7f6ac00ab910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34652/0 (socket says 172.21.15.133:34652) 2023-10-08T16:04:14.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac614a700 1 --2- 172.21.15.133:0/3971209786 >> v2:172.21.15.190:3300/0 conn(0x7f6ac0143010 0x7f6ac013c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:14.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac5148700 1 -- 172.21.15.133:0/3971209786 >> v2:172.21.15.190:3300/0 conn(0x7f6ac0143010 msgr2=0x7f6ac013c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:14.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac5148700 1 --2- 172.21.15.133:0/3971209786 >> v2:172.21.15.190:3300/0 conn(0x7f6ac0143010 0x7f6ac013c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:14.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac4947700 1 -- 172.21.15.133:0/3971209786 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1763819540 0 0) 0x7f6ac013cb20 con 0x7f6ac0070a60 2023-10-08T16:04:14.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac5148700 1 -- 172.21.15.133:0/3971209786 >> v1:172.21.15.133:6789/0 conn(0x7f6ac0070a60 legacy=0x7f6ac00ab910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:14.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac5148700 1 -- 172.21.15.133:0/3971209786 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac01423d0 con 0x7f6ac0142bb0 2023-10-08T16:04:14.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac5148700 1 --2- 172.21.15.133:0/3971209786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ac0142bb0 0x7f6ac013c0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6ac00b0510 tx=0x7f6abc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe415ac7705c2b1b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:14.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac4947700 1 -- 172.21.15.133:0/3971209786 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc00b860 con 0x7f6ac0142bb0 2023-10-08T16:04:14.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac4947700 1 -- 172.21.15.133:0/3971209786 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6abc00b9c0 con 0x7f6ac0142bb0 2023-10-08T16:04:14.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac4947700 1 -- 172.21.15.133:0/3971209786 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc00bd60 con 0x7f6ac0142bb0 2023-10-08T16:04:14.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac694b700 1 -- 172.21.15.133:0/3971209786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ac0142bb0 msgr2=0x7f6ac013c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:14.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac694b700 1 --2- 172.21.15.133:0/3971209786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ac0142bb0 0x7f6ac013c0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6ac00b0510 tx=0x7f6abc009250 comp rx=0 tx=0).stop 2023-10-08T16:04:14.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac694b700 1 -- 172.21.15.133:0/3971209786 shutdown_connections 2023-10-08T16:04:14.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac694b700 1 --2- 172.21.15.133:0/3971209786 >> v2:172.21.15.190:3300/0 conn(0x7f6ac0143010 0x7f6ac013c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:14.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac694b700 1 --2- 172.21.15.133:0/3971209786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ac0142bb0 0x7f6ac013c0a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:14.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac694b700 1 -- 172.21.15.133:0/3971209786 >> 172.21.15.133:0/3971209786 conn(0x7f6ac0066f90 msgr2=0x7f6ac0067390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:14.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac694b700 1 -- 172.21.15.133:0/3971209786 shutdown_connections 2023-10-08T16:04:14.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.647+0000 7f6ac694b700 1 -- 172.21.15.133:0/3971209786 wait complete. 2023-10-08T16:04:14.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.651+0000 7f6ac694b700 1 Processor -- start 2023-10-08T16:04:14.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.651+0000 7f6ac694b700 1 -- start start 2023-10-08T16:04:14.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.651+0000 7f6ac694b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ac0070a60 0x7f6ac00ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:14.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.651+0000 7f6ac694b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ac0142bb0 0x7f6ac006e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:14.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.651+0000 7f6ac694b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ac0143010 0x7f6ac006b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:14.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.651+0000 7f6ac694b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac01562f0 con 0x7f6ac0143010 2023-10-08T16:04:14.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.651+0000 7f6ac694b700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac0156780 con 0x7f6ac0142bb0 2023-10-08T16:04:14.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.651+0000 7f6ac694b700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac0155ca0 con 0x7f6ac0070a60 2023-10-08T16:04:14.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.651+0000 7f6ac614a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ac0143010 0x7f6ac006b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:14.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.651+0000 7f6ac614a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ac0143010 0x7f6ac006b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52696/0 (socket says 172.21.15.133:52696) 2023-10-08T16:04:14.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.651+0000 7f6ac614a700 1 -- 172.21.15.133:0/3790123534 learned_addr learned my addr 172.21.15.133:0/3790123534 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:14.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.651+0000 7f6ac5148700 1 --2- 172.21.15.133:0/3790123534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ac0142bb0 0x7f6ac006e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:14.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.651+0000 7f6ac5949700 1 --2- 172.21.15.133:0/3790123534 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ac0070a60 0x7f6ac00ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:14.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.651+0000 7f6ac614a700 1 -- 172.21.15.133:0/3790123534 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ac0070a60 msgr2=0x7f6ac00ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:14.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.651+0000 7f6ac614a700 1 --2- 172.21.15.133:0/3790123534 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ac0070a60 0x7f6ac00ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:14.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.651+0000 7f6ac614a700 1 -- 172.21.15.133:0/3790123534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ac0142bb0 msgr2=0x7f6ac006e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:14.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.651+0000 7f6ac614a700 1 --2- 172.21.15.133:0/3790123534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ac0142bb0 0x7f6ac006e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:14.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.651+0000 7f6ac614a700 1 -- 172.21.15.133:0/3790123534 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6abc0094f0 con 0x7f6ac0143010 2023-10-08T16:04:14.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.655+0000 7f6ac614a700 1 --2- 172.21.15.133:0/3790123534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ac0143010 0x7f6ac006b6f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8009fa0 tx=0x7f6ab8009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:14.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.655+0000 7f6ab1ffb700 1 -- 172.21.15.133:0/3790123534 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab800ebc0 con 0x7f6ac0143010 2023-10-08T16:04:14.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.655+0000 7f6ab1ffb700 1 -- 172.21.15.133:0/3790123534 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab800ed20 con 0x7f6ac0143010 2023-10-08T16:04:14.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.655+0000 7f6ab1ffb700 1 -- 172.21.15.133:0/3790123534 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8014670 con 0x7f6ac0143010 2023-10-08T16:04:14.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.655+0000 7f6ac694b700 1 -- 172.21.15.133:0/3790123534 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac0155f80 con 0x7f6ac0143010 2023-10-08T16:04:14.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.655+0000 7f6ac694b700 1 -- 172.21.15.133:0/3790123534 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac00af460 con 0x7f6ac0143010 2023-10-08T16:04:14.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.655+0000 7f6ac694b700 1 -- 172.21.15.133:0/3790123534 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac0156460 con 0x7f6ac0143010 2023-10-08T16:04:14.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.655+0000 7f6ab1ffb700 1 -- 172.21.15.133:0/3790123534 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6ab80149e0 con 0x7f6ac0143010 2023-10-08T16:04:14.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.655+0000 7f6ab1ffb700 1 --2- 172.21.15.133:0/3790123534 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6aa4060550 0x7f6aa4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:14.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.655+0000 7f6ab1ffb700 1 -- 172.21.15.133:0/3790123534 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6ab807d980 con 0x7f6ac0143010 2023-10-08T16:04:14.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.655+0000 7f6ac5949700 1 --2- 172.21.15.133:0/3790123534 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6aa4060550 0x7f6aa4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:14.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.659+0000 7f6ac5949700 1 --2- 172.21.15.133:0/3790123534 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6aa4060550 0x7f6aa4062a00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4007180 tx=0x7f6ab4007ef0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:14.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.663+0000 7f6ab1ffb700 1 -- 172.21.15.133:0/3790123534 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6ab804e340 con 0x7f6ac0143010 2023-10-08T16:04:14.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:14.823+0000 7f6ac694b700 1 -- 172.21.15.133:0/3790123534 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6ac00af5f0 con 0x7f6ac0143010 2023-10-08T16:04:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.623+0000 7f6ab1ffb700 1 -- 172.21.15.133:0/3790123534 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6ab8051960 con 0x7f6ac0143010 2023-10-08T16:04:15.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.635+0000 7f6ac694b700 1 -- 172.21.15.133:0/3790123534 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6aa4060550 msgr2=0x7f6aa4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:15.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.635+0000 7f6ac694b700 1 --2- 172.21.15.133:0/3790123534 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6aa4060550 0x7f6aa4062a00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4007180 tx=0x7f6ab4007ef0 comp rx=0 tx=0).stop 2023-10-08T16:04:15.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.635+0000 7f6ac694b700 1 -- 172.21.15.133:0/3790123534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ac0143010 msgr2=0x7f6ac006b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:15.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.635+0000 7f6ac694b700 1 --2- 172.21.15.133:0/3790123534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ac0143010 0x7f6ac006b6f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8009fa0 tx=0x7f6ab8009900 comp rx=0 tx=0).stop 2023-10-08T16:04:15.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.635+0000 7f6ac694b700 1 -- 172.21.15.133:0/3790123534 shutdown_connections 2023-10-08T16:04:15.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.635+0000 7f6ac694b700 1 --2- 172.21.15.133:0/3790123534 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6aa4060550 0x7f6aa4062a00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:15.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.635+0000 7f6ac694b700 1 --2- 172.21.15.133:0/3790123534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ac0143010 0x7f6ac006b6f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:15.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.635+0000 7f6ac694b700 1 --2- 172.21.15.133:0/3790123534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ac0142bb0 0x7f6ac006e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:15.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.635+0000 7f6ac694b700 1 --2- 172.21.15.133:0/3790123534 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ac0070a60 0x7f6ac00ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:15.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.635+0000 7f6ac694b700 1 -- 172.21.15.133:0/3790123534 >> 172.21.15.133:0/3790123534 conn(0x7f6ac0066f90 msgr2=0x7f6ac0140860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:15.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.635+0000 7f6ac694b700 1 -- 172.21.15.133:0/3790123534 shutdown_connections 2023-10-08T16:04:15.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.635+0000 7f6ac694b700 1 -- 172.21.15.133:0/3790123534 wait complete. 2023-10-08T16:04:15.639 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2023-10-08T16:04:15.649 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T16:04:15.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.759+0000 7f64c2cf5700 1 Processor -- start 2023-10-08T16:04:15.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.759+0000 7f64c2cf5700 1 -- start start 2023-10-08T16:04:15.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.759+0000 7f64c2cf5700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f64bc0b0db0 0x7f64bc14a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:15.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.759+0000 7f64c2cf5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64bc0ad130 con 0x7f64bc0b1b90 2023-10-08T16:04:15.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.759+0000 7f64c2cf5700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64bc0ac6c0 con 0x7f64bc0b1f60 2023-10-08T16:04:15.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.759+0000 7f64c2cf5700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64bc0acf30 con 0x7f64bc0b0db0 2023-10-08T16:04:15.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.759+0000 7f64c1cf3700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f64bc0b1b90 0x7f64bc0ade30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34666/0 (socket says 172.21.15.133:34666) 2023-10-08T16:04:15.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.759+0000 7f64c1cf3700 1 -- 172.21.15.133:0/3168707584 learned_addr learned my addr 172.21.15.133:0/3168707584 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:15.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.759+0000 7f64c14f2700 1 --2- 172.21.15.133:0/3168707584 >> v2:172.21.15.190:3300/0 conn(0x7f64bc0b0db0 0x7f64bc14a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:15.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c0cf1700 1 -- 172.21.15.133:0/3168707584 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702400725 0 0) 0x7f64bc0ad130 con 0x7f64bc0b1b90 2023-10-08T16:04:15.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c0cf1700 1 -- 172.21.15.133:0/3168707584 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64a8003570 con 0x7f64bc0b1b90 2023-10-08T16:04:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c0cf1700 1 -- 172.21.15.133:0/3168707584 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3956852979 0 0) 0x7f64a8003570 con 0x7f64bc0b1b90 2023-10-08T16:04:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c0cf1700 1 -- 172.21.15.133:0/3168707584 >> v2:172.21.15.190:3300/0 conn(0x7f64bc0b0db0 msgr2=0x7f64bc14a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c0cf1700 1 --2- 172.21.15.133:0/3168707584 >> v2:172.21.15.190:3300/0 conn(0x7f64bc0b0db0 0x7f64bc14a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c0cf1700 1 -- 172.21.15.133:0/3168707584 >> v1:172.21.15.190:6789/0 conn(0x7f64bc0b1f60 legacy=0x7f64bc14a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c0cf1700 1 -- 172.21.15.133:0/3168707584 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64bc0ac420 con 0x7f64bc0b1b90 2023-10-08T16:04:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c0cf1700 1 -- 172.21.15.133:0/3168707584 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2883817959 0 0) 0x7f64b0001490 con 0x7f64bc0b1b90 2023-10-08T16:04:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c0cf1700 1 -- 172.21.15.133:0/3168707584 >> v1:172.21.15.133:6789/0 conn(0x7f64bc0b1b90 legacy=0x7f64bc0ade30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c0cf1700 1 --2- 172.21.15.133:0/3168707584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64a8003a60 0x7f64a8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c0cf1700 1 --2- 172.21.15.133:0/3168707584 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64a8004810 0x7f64a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c0cf1700 1 --2- 172.21.15.133:0/3168707584 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64a80051c0 0x7f64a800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c0cf1700 1 -- 172.21.15.133:0/3168707584 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc0acf30 con 0x7f64a8003a60 2023-10-08T16:04:15.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c0cf1700 1 -- 172.21.15.133:0/3168707584 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a800c160 con 0x7f64a8004810 2023-10-08T16:04:15.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c0cf1700 1 -- 172.21.15.133:0/3168707584 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a800c320 con 0x7f64a80051c0 2023-10-08T16:04:15.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c1cf3700 1 --2- 172.21.15.133:0/3168707584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64a8003a60 0x7f64a8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:15.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c14f2700 1 --2- 172.21.15.133:0/3168707584 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64a8004810 0x7f64a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:15.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c24f4700 1 --2- 172.21.15.133:0/3168707584 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64a80051c0 0x7f64a800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:15.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c1cf3700 1 -- 172.21.15.133:0/3168707584 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64a80051c0 msgr2=0x7f64a800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:15.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c1cf3700 1 --2- 172.21.15.133:0/3168707584 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64a80051c0 0x7f64a800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:15.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c1cf3700 1 -- 172.21.15.133:0/3168707584 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64a8004810 msgr2=0x7f64a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:15.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c1cf3700 1 --2- 172.21.15.133:0/3168707584 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64a8004810 0x7f64a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:15.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c1cf3700 1 -- 172.21.15.133:0/3168707584 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a8003570 con 0x7f64a8003a60 2023-10-08T16:04:15.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c24f4700 1 -- 172.21.15.133:0/3168707584 reap_dead start 2023-10-08T16:04:15.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c14f2700 1 --2- 172.21.15.133:0/3168707584 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64a8004810 0x7f64a8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:15.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c1cf3700 1 --2- 172.21.15.133:0/3168707584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64a8003a60 0x7f64a8003e70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f64bc0ad2c0 tx=0x7f64bc0ac5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03bc84c68ca821c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:15.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c0cf1700 1 -- 172.21.15.133:0/3168707584 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b000cc30 con 0x7f64a8003a60 2023-10-08T16:04:15.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c0cf1700 1 -- 172.21.15.133:0/3168707584 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b000cd90 con 0x7f64a8003a60 2023-10-08T16:04:15.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c0cf1700 1 -- 172.21.15.133:0/3168707584 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b0004b20 con 0x7f64a8003a60 2023-10-08T16:04:15.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c2cf5700 1 -- 172.21.15.133:0/3168707584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64a8003a60 msgr2=0x7f64a8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:15.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c2cf5700 1 --2- 172.21.15.133:0/3168707584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64a8003a60 0x7f64a8003e70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f64bc0ad2c0 tx=0x7f64bc0ac5b0 comp rx=0 tx=0).stop 2023-10-08T16:04:15.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c2cf5700 1 -- 172.21.15.133:0/3168707584 shutdown_connections 2023-10-08T16:04:15.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c2cf5700 1 --2- 172.21.15.133:0/3168707584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64a8003a60 0x7f64a8003e70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:15.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c2cf5700 1 -- 172.21.15.133:0/3168707584 >> 172.21.15.133:0/3168707584 conn(0x7f64bc063670 msgr2=0x7f64bc0b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:15.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c2cf5700 1 -- 172.21.15.133:0/3168707584 shutdown_connections 2023-10-08T16:04:15.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.763+0000 7f64c2cf5700 1 -- 172.21.15.133:0/3168707584 wait complete. 2023-10-08T16:04:15.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.767+0000 7f64c2cf5700 1 Processor -- start 2023-10-08T16:04:15.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.767+0000 7f64c2cf5700 1 -- start start 2023-10-08T16:04:15.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.767+0000 7f64c2cf5700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64a8003a60 0x7f64bc06ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:15.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.767+0000 7f64c2cf5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64bc14a320 0x7f64bc14a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:15.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.767+0000 7f64c2cf5700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64bc159590 0x7f64bc1599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:15.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.767+0000 7f64c2cf5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc143010 con 0x7f64bc14a320 2023-10-08T16:04:15.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.767+0000 7f64c2cf5700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc149e90 con 0x7f64a8003a60 2023-10-08T16:04:15.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.767+0000 7f64c2cf5700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc14acd0 con 0x7f64bc159590 2023-10-08T16:04:15.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.767+0000 7f64c14f2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64bc14a320 0x7f64bc14a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:15.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.767+0000 7f64c14f2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64bc14a320 0x7f64bc14a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52706/0 (socket says 172.21.15.133:52706) 2023-10-08T16:04:15.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.767+0000 7f64c14f2700 1 -- 172.21.15.133:0/3566815852 learned_addr learned my addr 172.21.15.133:0/3566815852 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:15.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.767+0000 7f64c1cf3700 1 --2- 172.21.15.133:0/3566815852 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64a8003a60 0x7f64bc06ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:15.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.767+0000 7f64c24f4700 1 --2- 172.21.15.133:0/3566815852 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64bc159590 0x7f64bc1599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:15.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.767+0000 7f64c14f2700 1 -- 172.21.15.133:0/3566815852 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64bc159590 msgr2=0x7f64bc1599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:15.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.767+0000 7f64c14f2700 1 --2- 172.21.15.133:0/3566815852 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64bc159590 0x7f64bc1599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:15.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.767+0000 7f64c14f2700 1 -- 172.21.15.133:0/3566815852 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64a8003a60 msgr2=0x7f64bc06ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:15.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.767+0000 7f64c14f2700 1 --2- 172.21.15.133:0/3566815852 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64a8003a60 0x7f64bc06ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:15.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.767+0000 7f64c14f2700 1 -- 172.21.15.133:0/3566815852 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64bc144060 con 0x7f64bc14a320 2023-10-08T16:04:15.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.767+0000 7f64c14f2700 1 --2- 172.21.15.133:0/3566815852 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64bc14a320 0x7f64bc14a790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f64b8011730 tx=0x7f64b8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:15.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.767+0000 7f64adffb700 1 -- 172.21.15.133:0/3566815852 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b8015670 con 0x7f64bc14a320 2023-10-08T16:04:15.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.767+0000 7f64adffb700 1 -- 172.21.15.133:0/3566815852 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b80157d0 con 0x7f64bc14a320 2023-10-08T16:04:15.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.767+0000 7f64c2cf5700 1 -- 172.21.15.133:0/3566815852 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64bc149b20 con 0x7f64bc14a320 2023-10-08T16:04:15.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.767+0000 7f64adffb700 1 -- 172.21.15.133:0/3566815852 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b8015b90 con 0x7f64bc14a320 2023-10-08T16:04:15.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.767+0000 7f64c2cf5700 1 -- 172.21.15.133:0/3566815852 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64bc143ca0 con 0x7f64bc14a320 2023-10-08T16:04:15.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.767+0000 7f64c2cf5700 1 -- 172.21.15.133:0/3566815852 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64bc04be40 con 0x7f64bc14a320 2023-10-08T16:04:15.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.771+0000 7f64adffb700 1 -- 172.21.15.133:0/3566815852 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f64b8013410 con 0x7f64bc14a320 2023-10-08T16:04:15.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.771+0000 7f64adffb700 1 --2- 172.21.15.133:0/3566815852 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f64a0060550 0x7f64a0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:15.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.771+0000 7f64adffb700 1 -- 172.21.15.133:0/3566815852 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f64b807cc10 con 0x7f64bc14a320 2023-10-08T16:04:15.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.771+0000 7f64c1cf3700 1 --2- 172.21.15.133:0/3566815852 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f64a0060550 0x7f64a0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:15.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.771+0000 7f64c1cf3700 1 --2- 172.21.15.133:0/3566815852 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f64a0060550 0x7f64a0062a00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f64b0007d10 tx=0x7f64b0015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:15.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.779+0000 7f64adffb700 1 -- 172.21.15.133:0/3566815852 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f64b804d3e0 con 0x7f64bc14a320 2023-10-08T16:04:15.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:15.943+0000 7f64c2cf5700 1 -- 172.21.15.133:0/3566815852 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f64bc0ad410 con 0x7f64bc14a320 2023-10-08T16:04:16.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.639+0000 7f64adffb700 1 -- 172.21.15.133:0/3566815852 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f64b80220d0 con 0x7f64bc14a320 2023-10-08T16:04:16.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.655+0000 7f64c2cf5700 1 -- 172.21.15.133:0/3566815852 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f64a0060550 msgr2=0x7f64a0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:16.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.655+0000 7f64c2cf5700 1 --2- 172.21.15.133:0/3566815852 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f64a0060550 0x7f64a0062a00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f64b0007d10 tx=0x7f64b0015000 comp rx=0 tx=0).stop 2023-10-08T16:04:16.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.655+0000 7f64c2cf5700 1 -- 172.21.15.133:0/3566815852 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64bc14a320 msgr2=0x7f64bc14a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:16.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.655+0000 7f64c2cf5700 1 --2- 172.21.15.133:0/3566815852 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64bc14a320 0x7f64bc14a790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f64b8011730 tx=0x7f64b8008040 comp rx=0 tx=0).stop 2023-10-08T16:04:16.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.655+0000 7f64c2cf5700 1 -- 172.21.15.133:0/3566815852 shutdown_connections 2023-10-08T16:04:16.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.655+0000 7f64c2cf5700 1 --2- 172.21.15.133:0/3566815852 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f64a0060550 0x7f64a0062a00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:16.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.655+0000 7f64c2cf5700 1 --2- 172.21.15.133:0/3566815852 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64bc159590 0x7f64bc1599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:16.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.655+0000 7f64c2cf5700 1 --2- 172.21.15.133:0/3566815852 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64bc14a320 0x7f64bc14a790 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:16.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.655+0000 7f64c2cf5700 1 --2- 172.21.15.133:0/3566815852 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64a8003a60 0x7f64bc06ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:16.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.655+0000 7f64c2cf5700 1 -- 172.21.15.133:0/3566815852 >> 172.21.15.133:0/3566815852 conn(0x7f64bc063670 msgr2=0x7f64bc142700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:16.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.659+0000 7f64c2cf5700 1 -- 172.21.15.133:0/3566815852 shutdown_connections 2023-10-08T16:04:16.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.659+0000 7f64c2cf5700 1 -- 172.21.15.133:0/3566815852 wait complete. 2023-10-08T16:04:16.663 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2023-10-08T16:04:16.674 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T16:04:16.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.775+0000 7f0f19ebf700 1 Processor -- start 2023-10-08T16:04:16.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.775+0000 7f0f19ebf700 1 -- start start 2023-10-08T16:04:16.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.775+0000 7f0f19ebf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0f140634e0 0x7f0f140b4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:16.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.775+0000 7f0f19ebf700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f1413cc60 con 0x7f0f1413c130 2023-10-08T16:04:16.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.775+0000 7f0f19ebf700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f140b4d50 con 0x7f0f140b0ae0 2023-10-08T16:04:16.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.775+0000 7f0f19ebf700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f140b1e30 con 0x7f0f140634e0 2023-10-08T16:04:16.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.775+0000 7f0f18ebd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0f140634e0 0x7f0f140b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:16.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.775+0000 7f0f196be700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0f1413c130 0x7f0f1413c550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34678/0 (socket says 172.21.15.133:34678) 2023-10-08T16:04:16.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.775+0000 7f0f196be700 1 -- 172.21.15.133:0/1773680778 learned_addr learned my addr 172.21.15.133:0/1773680778 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:16.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.775+0000 7f0f137fe700 1 -- 172.21.15.133:0/1773680778 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 992780417 0 0) 0x7f0f1413cc60 con 0x7f0f1413c130 2023-10-08T16:04:16.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.775+0000 7f0f137fe700 1 -- 172.21.15.133:0/1773680778 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f00003570 con 0x7f0f1413c130 2023-10-08T16:04:16.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.775+0000 7f0f137fe700 1 -- 172.21.15.133:0/1773680778 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3149260588 0 0) 0x7f0f00003570 con 0x7f0f1413c130 2023-10-08T16:04:16.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.775+0000 7f0f18ebd700 1 -- 172.21.15.133:0/1773680778 >> v1:172.21.15.190:6789/0 conn(0x7f0f140b0ae0 legacy=0x7f0f140b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:16.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.775+0000 7f0f18ebd700 1 -- 172.21.15.133:0/1773680778 >> v1:172.21.15.133:6789/0 conn(0x7f0f1413c130 legacy=0x7f0f1413c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:16.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.775+0000 7f0f18ebd700 1 -- 172.21.15.133:0/1773680778 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f140b1bc0 con 0x7f0f140634e0 2023-10-08T16:04:16.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.775+0000 7f0f18ebd700 1 --2- 172.21.15.133:0/1773680778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f140634e0 0x7f0f140b4730 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009e60 tx=0x7f0f04009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9dc1729d9b9c94 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:16.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f137fe700 1 -- 172.21.15.133:0/1773680778 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0400e070 con 0x7f0f140634e0 2023-10-08T16:04:16.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f137fe700 1 -- 172.21.15.133:0/1773680778 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0400b850 con 0x7f0f140634e0 2023-10-08T16:04:16.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f137fe700 1 -- 172.21.15.133:0/1773680778 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c001470 con 0x7f0f140634e0 2023-10-08T16:04:16.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f19ebf700 1 -- 172.21.15.133:0/1773680778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f140634e0 msgr2=0x7f0f140b4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:16.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f19ebf700 1 --2- 172.21.15.133:0/1773680778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f140634e0 0x7f0f140b4730 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009e60 tx=0x7f0f04009780 comp rx=0 tx=0).stop 2023-10-08T16:04:16.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f19ebf700 1 -- 172.21.15.133:0/1773680778 shutdown_connections 2023-10-08T16:04:16.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f19ebf700 1 --2- 172.21.15.133:0/1773680778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f140634e0 0x7f0f140b4730 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:16.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f19ebf700 1 -- 172.21.15.133:0/1773680778 >> 172.21.15.133:0/1773680778 conn(0x7f0f14067cd0 msgr2=0x7f0f14062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:16.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f19ebf700 1 -- 172.21.15.133:0/1773680778 shutdown_connections 2023-10-08T16:04:16.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f19ebf700 1 -- 172.21.15.133:0/1773680778 wait complete. 2023-10-08T16:04:16.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f19ebf700 1 Processor -- start 2023-10-08T16:04:16.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f19ebf700 1 -- start start 2023-10-08T16:04:16.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f19ebf700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f140634e0 0x7f0f141410e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:16.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f19ebf700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f140b0ae0 0x7f0f14152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:16.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f19ebf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f1413c130 0x7f0f14152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:16.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f19ebf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f140b7030 con 0x7f0f1413c130 2023-10-08T16:04:16.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f19ebf700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f14155c60 con 0x7f0f140b0ae0 2023-10-08T16:04:16.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f19ebf700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f14155f40 con 0x7f0f140634e0 2023-10-08T16:04:16.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f196be700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f1413c130 0x7f0f14152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:16.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f196be700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f1413c130 0x7f0f14152a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52732/0 (socket says 172.21.15.133:52732) 2023-10-08T16:04:16.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f196be700 1 -- 172.21.15.133:0/377471749 learned_addr learned my addr 172.21.15.133:0/377471749 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:16.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f18ebd700 1 --2- 172.21.15.133:0/377471749 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f140634e0 0x7f0f141410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:16.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f13fff700 1 --2- 172.21.15.133:0/377471749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f140b0ae0 0x7f0f14152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:16.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f196be700 1 -- 172.21.15.133:0/377471749 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f140634e0 msgr2=0x7f0f141410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:16.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f196be700 1 --2- 172.21.15.133:0/377471749 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f140634e0 0x7f0f141410e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:16.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f196be700 1 -- 172.21.15.133:0/377471749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f140b0ae0 msgr2=0x7f0f14152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:16.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f196be700 1 --2- 172.21.15.133:0/377471749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f140b0ae0 0x7f0f14152520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:16.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f196be700 1 -- 172.21.15.133:0/377471749 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f04009a20 con 0x7f0f1413c130 2023-10-08T16:04:16.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f13fff700 1 --2- 172.21.15.133:0/377471749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f140b0ae0 0x7f0f14152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:16.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f196be700 1 --2- 172.21.15.133:0/377471749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f1413c130 0x7f0f14152a60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00cb90 tx=0x7f0f0c001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:16.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f10ff9700 1 -- 172.21.15.133:0/377471749 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c001d80 con 0x7f0f1413c130 2023-10-08T16:04:16.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f10ff9700 1 -- 172.21.15.133:0/377471749 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0c007360 con 0x7f0f1413c130 2023-10-08T16:04:16.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f19ebf700 1 -- 172.21.15.133:0/377471749 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f14156220 con 0x7f0f1413c130 2023-10-08T16:04:16.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f10ff9700 1 -- 172.21.15.133:0/377471749 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c004830 con 0x7f0f1413c130 2023-10-08T16:04:16.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.779+0000 7f0f19ebf700 1 -- 172.21.15.133:0/377471749 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f14140320 con 0x7f0f1413c130 2023-10-08T16:04:16.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.783+0000 7f0f19ebf700 1 -- 172.21.15.133:0/377471749 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f14152240 con 0x7f0f1413c130 2023-10-08T16:04:16.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.783+0000 7f0f10ff9700 1 -- 172.21.15.133:0/377471749 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0f0c004ba0 con 0x7f0f1413c130 2023-10-08T16:04:16.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.783+0000 7f0f10ff9700 1 --2- 172.21.15.133:0/377471749 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f0ef4060550 0x7f0ef4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:16.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.783+0000 7f0f10ff9700 1 -- 172.21.15.133:0/377471749 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f0f0c07be60 con 0x7f0f1413c130 2023-10-08T16:04:16.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.783+0000 7f0f18ebd700 1 --2- 172.21.15.133:0/377471749 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f0ef4060550 0x7f0ef4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:16.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.783+0000 7f0f18ebd700 1 --2- 172.21.15.133:0/377471749 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f0ef4060550 0x7f0ef4062a00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009d30 tx=0x7f0f04017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:16.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.791+0000 7f0f10ff9700 1 -- 172.21.15.133:0/377471749 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0f14152240 con 0x7f0f1413c130 2023-10-08T16:04:16.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:16.991+0000 7f0f19ebf700 1 -- 172.21.15.133:0/377471749 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0f14152240 con 0x7f0f1413c130 2023-10-08T16:04:17.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.643+0000 7f0f10ff9700 1 -- 172.21.15.133:0/377471749 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0f14152240 con 0x7f0f1413c130 2023-10-08T16:04:17.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.651+0000 7f0f19ebf700 1 -- 172.21.15.133:0/377471749 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f0ef4060550 msgr2=0x7f0ef4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:17.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.651+0000 7f0f19ebf700 1 --2- 172.21.15.133:0/377471749 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f0ef4060550 0x7f0ef4062a00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009d30 tx=0x7f0f04017000 comp rx=0 tx=0).stop 2023-10-08T16:04:17.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.651+0000 7f0f19ebf700 1 -- 172.21.15.133:0/377471749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f1413c130 msgr2=0x7f0f14152a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:17.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.651+0000 7f0f19ebf700 1 --2- 172.21.15.133:0/377471749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f1413c130 0x7f0f14152a60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00cb90 tx=0x7f0f0c001a10 comp rx=0 tx=0).stop 2023-10-08T16:04:17.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.651+0000 7f0f19ebf700 1 -- 172.21.15.133:0/377471749 shutdown_connections 2023-10-08T16:04:17.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.651+0000 7f0f19ebf700 1 --2- 172.21.15.133:0/377471749 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f0ef4060550 0x7f0ef4062a00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:17.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.651+0000 7f0f19ebf700 1 --2- 172.21.15.133:0/377471749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f1413c130 0x7f0f14152a60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:17.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.651+0000 7f0f19ebf700 1 --2- 172.21.15.133:0/377471749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f140b0ae0 0x7f0f14152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:17.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.651+0000 7f0f19ebf700 1 --2- 172.21.15.133:0/377471749 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f140634e0 0x7f0f141410e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:17.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.651+0000 7f0f19ebf700 1 -- 172.21.15.133:0/377471749 >> 172.21.15.133:0/377471749 conn(0x7f0f14067cd0 msgr2=0x7f0f1406fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:17.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.651+0000 7f0f19ebf700 1 -- 172.21.15.133:0/377471749 shutdown_connections 2023-10-08T16:04:17.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.651+0000 7f0f19ebf700 1 -- 172.21.15.133:0/377471749 wait complete. 2023-10-08T16:04:17.658 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 2 and data pool 3 2023-10-08T16:04:17.669 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:04:17.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.767+0000 7f5585c8b700 1 Processor -- start 2023-10-08T16:04:17.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.767+0000 7f5585c8b700 1 -- start start 2023-10-08T16:04:17.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.767+0000 7f5585c8b700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f558006e4e0 0x7f5580143960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:17.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.767+0000 7f5585c8b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5580066f90 0x7f5580139bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:17.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.771+0000 7f5585c8b700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55800b1eb0 con 0x7f55800b05c0 2023-10-08T16:04:17.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.771+0000 7f5585c8b700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55800b1cb0 con 0x7f558006e4e0 2023-10-08T16:04:17.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.771+0000 7f5585c8b700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55800b0a20 con 0x7f5580066f90 2023-10-08T16:04:17.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.771+0000 7f557f7fe700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f558006e4e0 0x7f5580143960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:17.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.771+0000 7f5576ffd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5580066f90 0x7f5580139bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:17.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.771+0000 7f557ffff700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f55800b05c0 0x7f558013a130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.133:54316/0 (socket says 172.21.15.133:54316) 2023-10-08T16:04:17.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.771+0000 7f557f7fe700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f558006e4e0 0x7f5580143960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.133:49632/0 (socket says 172.21.15.133:49632) 2023-10-08T16:04:17.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.771+0000 7f557ffff700 1 -- 172.21.15.133:0/352315672 learned_addr learned my addr 172.21.15.133:0/352315672 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:17.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.771+0000 7f557f7fe700 1 -- 172.21.15.133:0/352315672 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5580066f90 msgr2=0x7f5580139bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:17.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.771+0000 7f557f7fe700 1 --2- 172.21.15.133:0/352315672 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5580066f90 0x7f5580139bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:17.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.771+0000 7f557f7fe700 1 -- 172.21.15.133:0/352315672 >> v1:172.21.15.190:6789/0 conn(0x7f55800b05c0 legacy=0x7f558013a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:17.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.771+0000 7f557effd700 1 -- 172.21.15.133:0/352315672 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3922716316 0 0) 0x7f55800b1eb0 con 0x7f55800b05c0 2023-10-08T16:04:17.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.771+0000 7f557f7fe700 1 -- 172.21.15.133:0/352315672 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5580067a80 con 0x7f558006e4e0 2023-10-08T16:04:17.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.771+0000 7f557f7fe700 1 --2- 172.21.15.133:0/352315672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f558006e4e0 0x7f5580143960 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f55700098d0 tx=0x7f5570009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aff2bea513bc4c5d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:17.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.771+0000 7f557effd700 1 -- 172.21.15.133:0/352315672 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570005c10 con 0x7f558006e4e0 2023-10-08T16:04:17.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.771+0000 7f557effd700 1 -- 172.21.15.133:0/352315672 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5570005d70 con 0x7f558006e4e0 2023-10-08T16:04:17.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.771+0000 7f557effd700 1 -- 172.21.15.133:0/352315672 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570006280 con 0x7f558006e4e0 2023-10-08T16:04:17.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.771+0000 7f5585c8b700 1 -- 172.21.15.133:0/352315672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f558006e4e0 msgr2=0x7f5580143960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:17.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.771+0000 7f5585c8b700 1 --2- 172.21.15.133:0/352315672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f558006e4e0 0x7f5580143960 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f55700098d0 tx=0x7f5570009120 comp rx=0 tx=0).stop 2023-10-08T16:04:17.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.771+0000 7f5585c8b700 1 -- 172.21.15.133:0/352315672 shutdown_connections 2023-10-08T16:04:17.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.771+0000 7f5585c8b700 1 --2- 172.21.15.133:0/352315672 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5580066f90 0x7f5580139bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:17.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.771+0000 7f5585c8b700 1 --2- 172.21.15.133:0/352315672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f558006e4e0 0x7f5580143960 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:17.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.771+0000 7f5585c8b700 1 -- 172.21.15.133:0/352315672 >> 172.21.15.133:0/352315672 conn(0x7f5580068db0 msgr2=0x7f55800691b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:17.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.771+0000 7f5585c8b700 1 -- 172.21.15.133:0/352315672 shutdown_connections 2023-10-08T16:04:17.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.771+0000 7f5585c8b700 1 -- 172.21.15.133:0/352315672 wait complete. 2023-10-08T16:04:17.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.775+0000 7f5585c8b700 1 Processor -- start 2023-10-08T16:04:17.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.775+0000 7f5585c8b700 1 -- start start 2023-10-08T16:04:17.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.775+0000 7f5585c8b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5580066f90 0x7f55800a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:17.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.775+0000 7f5585c8b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f558006e4e0 0x7f55801523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:17.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.775+0000 7f5585c8b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55800b05c0 0x7f5580152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:17.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.775+0000 7f5585c8b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5580151fc0 con 0x7f5580066f90 2023-10-08T16:04:17.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.775+0000 7f5585c8b700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55800ab0e0 con 0x7f55800b05c0 2023-10-08T16:04:17.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.775+0000 7f5585c8b700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55800ab3c0 con 0x7f558006e4e0 2023-10-08T16:04:17.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.775+0000 7f557f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5580066f90 0x7f55800a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:17.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.775+0000 7f557f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5580066f90 0x7f55800a9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52736/0 (socket says 172.21.15.133:52736) 2023-10-08T16:04:17.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.775+0000 7f557f7fe700 1 -- 172.21.15.133:0/119124675 learned_addr learned my addr 172.21.15.133:0/119124675 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:17.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.775+0000 7f557ffff700 1 --2- 172.21.15.133:0/119124675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55800b05c0 0x7f5580152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:17.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.775+0000 7f5576ffd700 1 --2- 172.21.15.133:0/119124675 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f558006e4e0 0x7f55801523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:17.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.775+0000 7f557f7fe700 1 -- 172.21.15.133:0/119124675 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f558006e4e0 msgr2=0x7f55801523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:17.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.775+0000 7f557f7fe700 1 --2- 172.21.15.133:0/119124675 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f558006e4e0 0x7f55801523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:17.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.775+0000 7f557f7fe700 1 -- 172.21.15.133:0/119124675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55800b05c0 msgr2=0x7f5580152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:17.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.775+0000 7f557f7fe700 1 --2- 172.21.15.133:0/119124675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55800b05c0 0x7f5580152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:17.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.775+0000 7f557f7fe700 1 -- 172.21.15.133:0/119124675 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55700093c0 con 0x7f5580066f90 2023-10-08T16:04:17.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.775+0000 7f5576ffd700 1 --2- 172.21.15.133:0/119124675 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f558006e4e0 0x7f55801523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:17.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.775+0000 7f557f7fe700 1 --2- 172.21.15.133:0/119124675 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5580066f90 0x7f55800a9b00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5570009f70 tx=0x7f5570016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:17.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.775+0000 7f5577fff700 1 -- 172.21.15.133:0/119124675 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557001d7b0 con 0x7f5580066f90 2023-10-08T16:04:17.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.775+0000 7f5577fff700 1 -- 172.21.15.133:0/119124675 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557001d930 con 0x7f5580066f90 2023-10-08T16:04:17.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.775+0000 7f5585c8b700 1 -- 172.21.15.133:0/119124675 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f558006d0a0 con 0x7f5580066f90 2023-10-08T16:04:17.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.775+0000 7f5577fff700 1 -- 172.21.15.133:0/119124675 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557001dcf0 con 0x7f5580066f90 2023-10-08T16:04:17.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.775+0000 7f5585c8b700 1 -- 172.21.15.133:0/119124675 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55800aa040 con 0x7f5580066f90 2023-10-08T16:04:17.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.779+0000 7f5585c8b700 1 -- 172.21.15.133:0/119124675 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f558006cf00 con 0x7f5580066f90 2023-10-08T16:04:17.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.779+0000 7f5577fff700 1 -- 172.21.15.133:0/119124675 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f557001b690 con 0x7f5580066f90 2023-10-08T16:04:17.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.779+0000 7f5577fff700 1 --2- 172.21.15.133:0/119124675 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5560060550 0x7f5560062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:17.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.779+0000 7f5577fff700 1 -- 172.21.15.133:0/119124675 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f557007ebd0 con 0x7f5580066f90 2023-10-08T16:04:17.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.779+0000 7f5576ffd700 1 --2- 172.21.15.133:0/119124675 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5560060550 0x7f5560062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:17.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.783+0000 7f5576ffd700 1 --2- 172.21.15.133:0/119124675 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5560060550 0x7f5560062a00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5580138b30 tx=0x7f5568008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:17.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.783+0000 7f5577fff700 1 -- 172.21.15.133:0/119124675 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f557004f120 con 0x7f5580066f90 2023-10-08T16:04:17.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.947+0000 7f5585c8b700 1 -- 172.21.15.133:0/119124675 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f558006cf00 con 0x7f5580066f90 2023-10-08T16:04:17.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.947+0000 7f5577fff700 1 -- 172.21.15.133:0/119124675 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f558006cf00 con 0x7f5580066f90 2023-10-08T16:04:17.952 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:04:17.952 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":19,"fsid":"f2546191-d59e-4805-8e1b-3d8d3d1dad86","created":"2023-10-08T16:03:52.631855+0000","modified":"2023-10-08T16:04:16.997180+0000","last_up_change":"2023-10-08T16:04:04.030581+0000","last_in_change":"2023-10-08T16:03:54.835293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:04.898316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:14.869859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:15.983795+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8c5deadf-a203-4d30-aa7f-6e2e492b6ffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6809","nonce":33493},{"type":"v1","addr":"172.21.15.133:6811","nonce":33493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":33493},{"type":"v1","addr":"172.21.15.133:6815","nonce":33493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":33493},{"type":"v1","addr":"172.21.15.133:6822","nonce":33493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":33493},{"type":"v1","addr":"172.21.15.133:6818","nonce":33493}]},"public_addr":"172.21.15.133:6811/33493","cluster_addr":"172.21.15.133:6815/33493","heartbeat_back_addr":"172.21.15.133:6822/33493","heartbeat_front_addr":"172.21.15.133:6818/33493","state":["exists","up"]},{"osd":1,"uuid":"9b081c42-c915-48c3-a1ad-410f09a78576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":33490},{"type":"v1","addr":"172.21.15.133:6801","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":33490},{"type":"v1","addr":"172.21.15.133:6803","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":33490},{"type":"v1","addr":"172.21.15.133:6807","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":33490},{"type":"v1","addr":"172.21.15.133:6805","nonce":33490}]},"public_addr":"172.21.15.133:6801/33490","cluster_addr":"172.21.15.133:6803/33490","heartbeat_back_addr":"172.21.15.133:6807/33490","heartbeat_front_addr":"172.21.15.133:6805/33490","state":["exists","up"]},{"osd":2,"uuid":"88ecda43-01cd-4644-ab0c-92c91fd38966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":33492},{"type":"v1","addr":"172.21.15.133:6825","nonce":33492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":33492},{"type":"v1","addr":"172.21.15.133:6827","nonce":33492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":33492},{"type":"v1","addr":"172.21.15.133:6831","nonce":33492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":33492},{"type":"v1","addr":"172.21.15.133:6829","nonce":33492}]},"public_addr":"172.21.15.133:6825/33492","cluster_addr":"172.21.15.133:6827/33492","heartbeat_back_addr":"172.21.15.133:6831/33492","heartbeat_front_addr":"172.21.15.133:6829/33492","state":["exists","up"]},{"osd":3,"uuid":"39faf38d-b8e2-4e11-9b3b-84dc834c977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":33491},{"type":"v1","addr":"172.21.15.133:6810","nonce":33491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":33491},{"type":"v1","addr":"172.21.15.133:6814","nonce":33491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":33491},{"type":"v1","addr":"172.21.15.133:6823","nonce":33491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":33491},{"type":"v1","addr":"172.21.15.133:6819","nonce":33491}]},"public_addr":"172.21.15.133:6810/33491","cluster_addr":"172.21.15.133:6814/33491","heartbeat_back_addr":"172.21.15.133:6823/33491","heartbeat_front_addr":"172.21.15.133:6819/33491","state":["exists","up"]},{"osd":4,"uuid":"4c097e61-1cad-4b61-9183-4e7bc486bd32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":33678},{"type":"v1","addr":"172.21.15.190:6810","nonce":33678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":33678},{"type":"v1","addr":"172.21.15.190:6814","nonce":33678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":33678},{"type":"v1","addr":"172.21.15.190:6822","nonce":33678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":33678},{"type":"v1","addr":"172.21.15.190:6818","nonce":33678}]},"public_addr":"172.21.15.190:6810/33678","cluster_addr":"172.21.15.190:6814/33678","heartbeat_back_addr":"172.21.15.190:6822/33678","heartbeat_front_addr":"172.21.15.190:6818/33678","state":["exists","up"]},{"osd":5,"uuid":"05f072e0-7bc0-40f0-8cb6-8e322c82d6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":33676},{"type":"v1","addr":"172.21.15.190:6811","nonce":33676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":33676},{"type":"v1","addr":"172.21.15.190:6815","nonce":33676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":33676},{"type":"v1","addr":"172.21.15.190:6823","nonce":33676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":33676},{"type":"v1","addr":"172.21.15.190:6819","nonce":33676}]},"public_addr":"172.21.15.190:6811/33676","cluster_addr":"172.21.15.190:6815/33676","heartbeat_back_addr":"172.21.15.190:6823/33676","heartbeat_front_addr":"172.21.15.190:6819/33676","state":["exists","up"]},{"osd":6,"uuid":"1bcce8d7-14f3-442d-b135-68c7d66cdedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":33677},{"type":"v1","addr":"172.21.15.190:6801","nonce":33677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":33677},{"type":"v1","addr":"172.21.15.190:6803","nonce":33677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":33677},{"type":"v1","addr":"172.21.15.190:6807","nonce":33677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":33677},{"type":"v1","addr":"172.21.15.190:6805","nonce":33677}]},"public_addr":"172.21.15.190:6801/33677","cluster_addr":"172.21.15.190:6803/33677","heartbeat_back_addr":"172.21.15.190:6807/33677","heartbeat_front_addr":"172.21.15.190:6805/33677","state":["exists","up"]},{"osd":7,"uuid":"9157dbf7-2bf9-43d7-a89a-a8e3dae7514c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":33686},{"type":"v1","addr":"172.21.15.190:6825","nonce":33686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":33686},{"type":"v1","addr":"172.21.15.190:6827","nonce":33686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":33686},{"type":"v1","addr":"172.21.15.190:6831","nonce":33686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":33686},{"type":"v1","addr":"172.21.15.190:6829","nonce":33686}]},"public_addr":"172.21.15.190:6825/33686","cluster_addr":"172.21.15.190:6827/33686","heartbeat_back_addr":"172.21.15.190:6831/33686","heartbeat_front_addr":"172.21.15.190:6829/33686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.886742+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.199618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.871695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.115926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.069650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.841448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.132320+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.315132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:04:17.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.951+0000 7f5585c8b700 1 -- 172.21.15.133:0/119124675 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5560060550 msgr2=0x7f5560062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:17.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.951+0000 7f5585c8b700 1 --2- 172.21.15.133:0/119124675 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5560060550 0x7f5560062a00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5580138b30 tx=0x7f5568008040 comp rx=0 tx=0).stop 2023-10-08T16:04:17.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.951+0000 7f5585c8b700 1 -- 172.21.15.133:0/119124675 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5580066f90 msgr2=0x7f55800a9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:17.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.951+0000 7f5585c8b700 1 --2- 172.21.15.133:0/119124675 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5580066f90 0x7f55800a9b00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5570009f70 tx=0x7f5570016000 comp rx=0 tx=0).stop 2023-10-08T16:04:17.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.951+0000 7f5585c8b700 1 -- 172.21.15.133:0/119124675 shutdown_connections 2023-10-08T16:04:17.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.951+0000 7f5585c8b700 1 --2- 172.21.15.133:0/119124675 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5560060550 0x7f5560062a00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:17.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.951+0000 7f5585c8b700 1 --2- 172.21.15.133:0/119124675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55800b05c0 0x7f5580152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:17.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.951+0000 7f5585c8b700 1 --2- 172.21.15.133:0/119124675 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f558006e4e0 0x7f55801523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:17.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.951+0000 7f5585c8b700 1 --2- 172.21.15.133:0/119124675 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5580066f90 0x7f55800a9b00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:17.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.951+0000 7f5585c8b700 1 -- 172.21.15.133:0/119124675 >> 172.21.15.133:0/119124675 conn(0x7f5580068db0 msgr2=0x7f558013a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:17.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.951+0000 7f5585c8b700 1 -- 172.21.15.133:0/119124675 shutdown_connections 2023-10-08T16:04:17.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:17.951+0000 7f5585c8b700 1 -- 172.21.15.133:0/119124675 wait complete. 2023-10-08T16:04:17.966 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:04:18.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7efff1ed7700 1 Processor -- start 2023-10-08T16:04:18.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7efff1ed7700 1 -- start start 2023-10-08T16:04:18.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7efff1ed7700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effec0a9b00 0x7effec0ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:18.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7efff1ed7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7effec145b60 0x7effec145fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:18.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7efff1ed7700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effec0abca0 con 0x7effec146510 2023-10-08T16:04:18.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7efff1ed7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effec0ab6c0 con 0x7effec145b60 2023-10-08T16:04:18.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7efff1ed7700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effec146970 con 0x7effec0a9b00 2023-10-08T16:04:18.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7effeaffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7effec145b60 0x7effec145fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:18.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7effeaffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7effec145b60 0x7effec145fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52752/0 (socket says 172.21.15.133:52752) 2023-10-08T16:04:18.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7effeaffd700 1 -- 172.21.15.133:0/750140221 learned_addr learned my addr 172.21.15.133:0/750140221 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:18.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7effeb7fe700 1 --2- 172.21.15.133:0/750140221 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effec0a9b00 0x7effec0ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:18.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7effeaffd700 1 -- 172.21.15.133:0/750140221 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effec0a9b00 msgr2=0x7effec0ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:18.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7effeaffd700 1 --2- 172.21.15.133:0/750140221 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effec0a9b00 0x7effec0ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:18.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7effeaffd700 1 -- 172.21.15.133:0/750140221 >> v1:172.21.15.190:6789/0 conn(0x7effec146510 legacy=0x7effec144a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:18.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7effeaffd700 1 -- 172.21.15.133:0/750140221 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec0b01e0 con 0x7effec145b60 2023-10-08T16:04:18.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7effeaffd700 1 --2- 172.21.15.133:0/750140221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effec145b60 0x7effec145fd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7effdc009f20 tx=0x7effdc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420849aad418d51d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:18.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7effea7fc700 1 -- 172.21.15.133:0/750140221 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc00e070 con 0x7effec145b60 2023-10-08T16:04:18.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7effea7fc700 1 -- 172.21.15.133:0/750140221 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effdc00ba80 con 0x7effec145b60 2023-10-08T16:04:18.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7effea7fc700 1 -- 172.21.15.133:0/750140221 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc0092e0 con 0x7effec145b60 2023-10-08T16:04:18.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7efff1ed7700 1 -- 172.21.15.133:0/750140221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effec145b60 msgr2=0x7effec145fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:18.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7efff1ed7700 1 --2- 172.21.15.133:0/750140221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effec145b60 0x7effec145fd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7effdc009f20 tx=0x7effdc009840 comp rx=0 tx=0).stop 2023-10-08T16:04:18.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7efff1ed7700 1 -- 172.21.15.133:0/750140221 shutdown_connections 2023-10-08T16:04:18.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7efff1ed7700 1 --2- 172.21.15.133:0/750140221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effec145b60 0x7effec145fd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:18.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7efff1ed7700 1 --2- 172.21.15.133:0/750140221 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effec0a9b00 0x7effec0ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:18.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7efff1ed7700 1 -- 172.21.15.133:0/750140221 >> 172.21.15.133:0/750140221 conn(0x7effec0b4ba0 msgr2=0x7effec0b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:18.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7efff1ed7700 1 -- 172.21.15.133:0/750140221 shutdown_connections 2023-10-08T16:04:18.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.067+0000 7efff1ed7700 1 -- 172.21.15.133:0/750140221 wait complete. 2023-10-08T16:04:18.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.071+0000 7efff1ed7700 1 Processor -- start 2023-10-08T16:04:18.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.071+0000 7efff1ed7700 1 -- start start 2023-10-08T16:04:18.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.071+0000 7efff1ed7700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effec0a9b00 0x7effec11e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:18.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.071+0000 7efff1ed7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effec145b60 0x7effec1559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:18.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.071+0000 7efff1ed7700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effec146510 0x7effec155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:18.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.071+0000 7efff1ed7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec153090 con 0x7effec145b60 2023-10-08T16:04:18.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.071+0000 7efff1ed7700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec11f940 con 0x7effec0a9b00 2023-10-08T16:04:18.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.071+0000 7efff1ed7700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effec152a40 con 0x7effec146510 2023-10-08T16:04:18.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.071+0000 7effeaffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effec145b60 0x7effec1559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:18.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.071+0000 7effeaffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effec145b60 0x7effec1559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52760/0 (socket says 172.21.15.133:52760) 2023-10-08T16:04:18.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.071+0000 7effeaffd700 1 -- 172.21.15.133:0/1817901815 learned_addr learned my addr 172.21.15.133:0/1817901815 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:18.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.071+0000 7effeb7fe700 1 --2- 172.21.15.133:0/1817901815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effec0a9b00 0x7effec11e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:18.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.071+0000 7effebfff700 1 --2- 172.21.15.133:0/1817901815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effec146510 0x7effec155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:18.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.071+0000 7effeaffd700 1 -- 172.21.15.133:0/1817901815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effec146510 msgr2=0x7effec155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:18.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.071+0000 7effeaffd700 1 --2- 172.21.15.133:0/1817901815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effec146510 0x7effec155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:18.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.071+0000 7effeaffd700 1 -- 172.21.15.133:0/1817901815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effec0a9b00 msgr2=0x7effec11e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:18.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.071+0000 7effeaffd700 1 --2- 172.21.15.133:0/1817901815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effec0a9b00 0x7effec11e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:18.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.071+0000 7effeaffd700 1 -- 172.21.15.133:0/1817901815 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effdc009ae0 con 0x7effec145b60 2023-10-08T16:04:18.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.071+0000 7effeaffd700 1 --2- 172.21.15.133:0/1817901815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effec145b60 0x7effec1559f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7effdc009430 tx=0x7effdc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:18.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.071+0000 7effe37fe700 1 -- 172.21.15.133:0/1817901815 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc007170 con 0x7effec145b60 2023-10-08T16:04:18.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.071+0000 7effe37fe700 1 -- 172.21.15.133:0/1817901815 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effdc008b70 con 0x7effec145b60 2023-10-08T16:04:18.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.071+0000 7efff1ed7700 1 -- 172.21.15.133:0/1817901815 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effec152d20 con 0x7effec145b60 2023-10-08T16:04:18.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.071+0000 7effe37fe700 1 -- 172.21.15.133:0/1817901815 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc026460 con 0x7effec145b60 2023-10-08T16:04:18.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.071+0000 7efff1ed7700 1 -- 172.21.15.133:0/1817901815 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effec11dd70 con 0x7effec145b60 2023-10-08T16:04:18.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.075+0000 7efff1ed7700 1 -- 172.21.15.133:0/1817901815 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effec152890 con 0x7effec145b60 2023-10-08T16:04:18.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.075+0000 7effe37fe700 1 -- 172.21.15.133:0/1817901815 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7effdc003040 con 0x7effec145b60 2023-10-08T16:04:18.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.075+0000 7effe37fe700 1 --2- 172.21.15.133:0/1817901815 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7effcc060580 0x7effcc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:18.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.075+0000 7effe37fe700 1 -- 172.21.15.133:0/1817901815 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7effdc07e6c0 con 0x7effec145b60 2023-10-08T16:04:18.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.075+0000 7effeb7fe700 1 --2- 172.21.15.133:0/1817901815 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7effcc060580 0x7effcc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:18.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.075+0000 7effeb7fe700 1 --2- 172.21.15.133:0/1817901815 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7effcc060580 0x7effcc062a30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7effd4006fd0 tx=0x7effd4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:18.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.087+0000 7effe37fe700 1 -- 172.21.15.133:0/1817901815 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7effdc04ecb0 con 0x7effec145b60 2023-10-08T16:04:18.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.251+0000 7efff1ed7700 1 -- 172.21.15.133:0/1817901815 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effec064810 con 0x7effec145b60 2023-10-08T16:04:18.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.251+0000 7effe37fe700 1 -- 172.21.15.133:0/1817901815 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15411 (secure 0 0 0) 0x7effdc008f30 con 0x7effec145b60 2023-10-08T16:04:18.256 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:04:18.256 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":19,"fsid":"f2546191-d59e-4805-8e1b-3d8d3d1dad86","created":"2023-10-08T16:03:52.631855+0000","modified":"2023-10-08T16:04:16.997180+0000","last_up_change":"2023-10-08T16:04:04.030581+0000","last_in_change":"2023-10-08T16:03:54.835293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:04.898316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:14.869859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:15.983795+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8c5deadf-a203-4d30-aa7f-6e2e492b6ffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6809","nonce":33493},{"type":"v1","addr":"172.21.15.133:6811","nonce":33493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":33493},{"type":"v1","addr":"172.21.15.133:6815","nonce":33493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":33493},{"type":"v1","addr":"172.21.15.133:6822","nonce":33493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":33493},{"type":"v1","addr":"172.21.15.133:6818","nonce":33493}]},"public_addr":"172.21.15.133:6811/33493","cluster_addr":"172.21.15.133:6815/33493","heartbeat_back_addr":"172.21.15.133:6822/33493","heartbeat_front_addr":"172.21.15.133:6818/33493","state":["exists","up"]},{"osd":1,"uuid":"9b081c42-c915-48c3-a1ad-410f09a78576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":33490},{"type":"v1","addr":"172.21.15.133:6801","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":33490},{"type":"v1","addr":"172.21.15.133:6803","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":33490},{"type":"v1","addr":"172.21.15.133:6807","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":33490},{"type":"v1","addr":"172.21.15.133:6805","nonce":33490}]},"public_addr":"172.21.15.133:6801/33490","cluster_addr":"172.21.15.133:6803/33490","heartbeat_back_addr":"172.21.15.133:6807/33490","heartbeat_front_addr":"172.21.15.133:6805/33490","state":["exists","up"]},{"osd":2,"uuid":"88ecda43-01cd-4644-ab0c-92c91fd38966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":33492},{"type":"v1","addr":"172.21.15.133:6825","nonce":33492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":33492},{"type":"v1","addr":"172.21.15.133:6827","nonce":33492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":33492},{"type":"v1","addr":"172.21.15.133:6831","nonce":33492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":33492},{"type":"v1","addr":"172.21.15.133:6829","nonce":33492}]},"public_addr":"172.21.15.133:6825/33492","cluster_addr":"172.21.15.133:6827/33492","heartbeat_back_addr":"172.21.15.133:6831/33492","heartbeat_front_addr":"172.21.15.133:6829/33492","state":["exists","up"]},{"osd":3,"uuid":"39faf38d-b8e2-4e11-9b3b-84dc834c977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":33491},{"type":"v1","addr":"172.21.15.133:6810","nonce":33491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":33491},{"type":"v1","addr":"172.21.15.133:6814","nonce":33491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":33491},{"type":"v1","addr":"172.21.15.133:6823","nonce":33491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":33491},{"type":"v1","addr":"172.21.15.133:6819","nonce":33491}]},"public_addr":"172.21.15.133:6810/33491","cluster_addr":"172.21.15.133:6814/33491","heartbeat_back_addr":"172.21.15.133:6823/33491","heartbeat_front_addr":"172.21.15.133:6819/33491","state":["exists","up"]},{"osd":4,"uuid":"4c097e61-1cad-4b61-9183-4e7bc486bd32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":33678},{"type":"v1","addr":"172.21.15.190:6810","nonce":33678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":33678},{"type":"v1","addr":"172.21.15.190:6814","nonce":33678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":33678},{"type":"v1","addr":"172.21.15.190:6822","nonce":33678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":33678},{"type":"v1","addr":"172.21.15.190:6818","nonce":33678}]},"public_addr":"172.21.15.190:6810/33678","cluster_addr":"172.21.15.190:6814/33678","heartbeat_back_addr":"172.21.15.190:6822/33678","heartbeat_front_addr":"172.21.15.190:6818/33678","state":["exists","up"]},{"osd":5,"uuid":"05f072e0-7bc0-40f0-8cb6-8e322c82d6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":33676},{"type":"v1","addr":"172.21.15.190:6811","nonce":33676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":33676},{"type":"v1","addr":"172.21.15.190:6815","nonce":33676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":33676},{"type":"v1","addr":"172.21.15.190:6823","nonce":33676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":33676},{"type":"v1","addr":"172.21.15.190:6819","nonce":33676}]},"public_addr":"172.21.15.190:6811/33676","cluster_addr":"172.21.15.190:6815/33676","heartbeat_back_addr":"172.21.15.190:6823/33676","heartbeat_front_addr":"172.21.15.190:6819/33676","state":["exists","up"]},{"osd":6,"uuid":"1bcce8d7-14f3-442d-b135-68c7d66cdedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":33677},{"type":"v1","addr":"172.21.15.190:6801","nonce":33677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":33677},{"type":"v1","addr":"172.21.15.190:6803","nonce":33677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":33677},{"type":"v1","addr":"172.21.15.190:6807","nonce":33677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":33677},{"type":"v1","addr":"172.21.15.190:6805","nonce":33677}]},"public_addr":"172.21.15.190:6801/33677","cluster_addr":"172.21.15.190:6803/33677","heartbeat_back_addr":"172.21.15.190:6807/33677","heartbeat_front_addr":"172.21.15.190:6805/33677","state":["exists","up"]},{"osd":7,"uuid":"9157dbf7-2bf9-43d7-a89a-a8e3dae7514c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":33686},{"type":"v1","addr":"172.21.15.190:6825","nonce":33686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":33686},{"type":"v1","addr":"172.21.15.190:6827","nonce":33686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":33686},{"type":"v1","addr":"172.21.15.190:6831","nonce":33686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":33686},{"type":"v1","addr":"172.21.15.190:6829","nonce":33686}]},"public_addr":"172.21.15.190:6825/33686","cluster_addr":"172.21.15.190:6827/33686","heartbeat_back_addr":"172.21.15.190:6831/33686","heartbeat_front_addr":"172.21.15.190:6829/33686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.886742+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.199618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.871695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.115926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.069650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.841448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.132320+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.315132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:04:18.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.255+0000 7efff1ed7700 1 -- 172.21.15.133:0/1817901815 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7effcc060580 msgr2=0x7effcc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:18.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.255+0000 7efff1ed7700 1 --2- 172.21.15.133:0/1817901815 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7effcc060580 0x7effcc062a30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7effd4006fd0 tx=0x7effd4008040 comp rx=0 tx=0).stop 2023-10-08T16:04:18.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.255+0000 7efff1ed7700 1 -- 172.21.15.133:0/1817901815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effec145b60 msgr2=0x7effec1559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:18.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.255+0000 7efff1ed7700 1 --2- 172.21.15.133:0/1817901815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effec145b60 0x7effec1559f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7effdc009430 tx=0x7effdc018000 comp rx=0 tx=0).stop 2023-10-08T16:04:18.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.255+0000 7efff1ed7700 1 -- 172.21.15.133:0/1817901815 shutdown_connections 2023-10-08T16:04:18.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.255+0000 7efff1ed7700 1 --2- 172.21.15.133:0/1817901815 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7effcc060580 0x7effcc062a30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:18.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.255+0000 7efff1ed7700 1 --2- 172.21.15.133:0/1817901815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effec146510 0x7effec155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:18.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.255+0000 7efff1ed7700 1 --2- 172.21.15.133:0/1817901815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effec145b60 0x7effec1559f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:18.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.255+0000 7efff1ed7700 1 --2- 172.21.15.133:0/1817901815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effec0a9b00 0x7effec11e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:18.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.255+0000 7efff1ed7700 1 -- 172.21.15.133:0/1817901815 >> 172.21.15.133:0/1817901815 conn(0x7effec0b4ba0 msgr2=0x7effec0b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:18.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.255+0000 7efff1ed7700 1 -- 172.21.15.133:0/1817901815 shutdown_connections 2023-10-08T16:04:18.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.255+0000 7efff1ed7700 1 -- 172.21.15.133:0/1817901815 wait complete. 2023-10-08T16:04:18.271 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T16:04:18.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.379+0000 7fadd1480700 1 Processor -- start 2023-10-08T16:04:18.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.379+0000 7fadd1480700 1 -- start start 2023-10-08T16:04:18.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.379+0000 7fadd1480700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fadcc0634e0 0x7fadcc0b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:18.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.379+0000 7fadd1480700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fadcc0b47b0 0x7fadcc0b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:18.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.379+0000 7fadd1480700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadcc0b2bf0 con 0x7fadcc145b50 2023-10-08T16:04:18.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.379+0000 7fadd1480700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadcc0b5160 con 0x7fadcc0b47b0 2023-10-08T16:04:18.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.379+0000 7fadd1480700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc0b1c90 con 0x7fadcc0634e0 2023-10-08T16:04:18.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.379+0000 7fadca7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fadcc0b47b0 0x7fadcc0b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:18.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.379+0000 7fadca7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fadcc0b47b0 0x7fadcc0b4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52772/0 (socket says 172.21.15.133:52772) 2023-10-08T16:04:18.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.379+0000 7fadca7fc700 1 -- 172.21.15.133:0/415186038 learned_addr learned my addr 172.21.15.133:0/415186038 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:18.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.379+0000 7fadcaffd700 1 --2- 172.21.15.133:0/415186038 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fadcc0634e0 0x7fadcc0b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:18.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.379+0000 7fadc9ffb700 1 -- 172.21.15.133:0/415186038 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609521164 0 0) 0x7fadcc0b2bf0 con 0x7fadcc145b50 2023-10-08T16:04:18.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.379+0000 7fadc9ffb700 1 -- 172.21.15.133:0/415186038 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadb4003570 con 0x7fadcc145b50 2023-10-08T16:04:18.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.379+0000 7fadca7fc700 1 -- 172.21.15.133:0/415186038 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fadcc0634e0 msgr2=0x7fadcc0b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:18.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.379+0000 7fadca7fc700 1 --2- 172.21.15.133:0/415186038 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fadcc0634e0 0x7fadcc0b0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:18.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.379+0000 7fadca7fc700 1 -- 172.21.15.133:0/415186038 >> v1:172.21.15.190:6789/0 conn(0x7fadcc145b50 legacy=0x7fadcc145f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:18.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.379+0000 7fadca7fc700 1 -- 172.21.15.133:0/415186038 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadcc0b1f70 con 0x7fadcc0b47b0 2023-10-08T16:04:18.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.383+0000 7fadca7fc700 1 --2- 172.21.15.133:0/415186038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadcc0b47b0 0x7fadcc0b4c20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fadbc0099b0 tx=0x7fadbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8d12d1cf6948b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:18.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.383+0000 7fadc9ffb700 1 -- 172.21.15.133:0/415186038 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc00b680 con 0x7fadcc0b47b0 2023-10-08T16:04:18.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.383+0000 7fadc9ffb700 1 -- 172.21.15.133:0/415186038 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadbc00b7e0 con 0x7fadcc0b47b0 2023-10-08T16:04:18.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.383+0000 7fadc9ffb700 1 -- 172.21.15.133:0/415186038 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc00bb80 con 0x7fadcc0b47b0 2023-10-08T16:04:18.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.383+0000 7fadd1480700 1 -- 172.21.15.133:0/415186038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadcc0b47b0 msgr2=0x7fadcc0b4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:18.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.383+0000 7fadd1480700 1 --2- 172.21.15.133:0/415186038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadcc0b47b0 0x7fadcc0b4c20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fadbc0099b0 tx=0x7fadbc009250 comp rx=0 tx=0).stop 2023-10-08T16:04:18.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.383+0000 7fadd1480700 1 -- 172.21.15.133:0/415186038 shutdown_connections 2023-10-08T16:04:18.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.383+0000 7fadd1480700 1 --2- 172.21.15.133:0/415186038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadcc0b47b0 0x7fadcc0b4c20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:18.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.383+0000 7fadd1480700 1 --2- 172.21.15.133:0/415186038 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fadcc0634e0 0x7fadcc0b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:18.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.383+0000 7fadd1480700 1 -- 172.21.15.133:0/415186038 >> 172.21.15.133:0/415186038 conn(0x7fadcc067e70 msgr2=0x7fadcc062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:18.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.383+0000 7fadd1480700 1 -- 172.21.15.133:0/415186038 shutdown_connections 2023-10-08T16:04:18.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.383+0000 7fadd1480700 1 -- 172.21.15.133:0/415186038 wait complete. 2023-10-08T16:04:18.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.383+0000 7fadd1480700 1 Processor -- start 2023-10-08T16:04:18.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.383+0000 7fadd1480700 1 -- start start 2023-10-08T16:04:18.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.387+0000 7fadd1480700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadcc0634e0 0x7fadcc13e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:18.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.387+0000 7fadd1480700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fadcc0b47b0 0x7fadcc13ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:18.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.387+0000 7fadd1480700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fadcc145b50 0x7fadcc0aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:18.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.387+0000 7fadd1480700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc156240 con 0x7fadcc0634e0 2023-10-08T16:04:18.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.387+0000 7fadd1480700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc149bc0 con 0x7fadcc0b47b0 2023-10-08T16:04:18.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.387+0000 7fadd1480700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc149950 con 0x7fadcc145b50 2023-10-08T16:04:18.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.387+0000 7fadcaffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadcc0634e0 0x7fadcc13e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:18.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.387+0000 7fadcaffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadcc0634e0 0x7fadcc13e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52778/0 (socket says 172.21.15.133:52778) 2023-10-08T16:04:18.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.387+0000 7fadcaffd700 1 -- 172.21.15.133:0/321460138 learned_addr learned my addr 172.21.15.133:0/321460138 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:18.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.387+0000 7fadca7fc700 1 --2- 172.21.15.133:0/321460138 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fadcc0b47b0 0x7fadcc13ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:18.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.387+0000 7fadcb7fe700 1 --2- 172.21.15.133:0/321460138 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fadcc145b50 0x7fadcc0aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:18.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.387+0000 7fadcaffd700 1 -- 172.21.15.133:0/321460138 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fadcc145b50 msgr2=0x7fadcc0aed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:18.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.387+0000 7fadcaffd700 1 --2- 172.21.15.133:0/321460138 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fadcc145b50 0x7fadcc0aed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:18.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.387+0000 7fadcaffd700 1 -- 172.21.15.133:0/321460138 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fadcc0b47b0 msgr2=0x7fadcc13ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:18.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.387+0000 7fadcaffd700 1 --2- 172.21.15.133:0/321460138 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fadcc0b47b0 0x7fadcc13ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:18.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.387+0000 7fadcaffd700 1 -- 172.21.15.133:0/321460138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc0094f0 con 0x7fadcc0634e0 2023-10-08T16:04:18.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.387+0000 7fadcb7fe700 1 --2- 172.21.15.133:0/321460138 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fadcc145b50 0x7fadcc0aed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:18.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.387+0000 7fadcaffd700 1 --2- 172.21.15.133:0/321460138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadcc0634e0 0x7fadcc13e850 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fadc000ec80 tx=0x7fadc0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:18.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.387+0000 7fadb2ffd700 1 -- 172.21.15.133:0/321460138 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc000c850 con 0x7fadcc0634e0 2023-10-08T16:04:18.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.387+0000 7fadb2ffd700 1 -- 172.21.15.133:0/321460138 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc000c9b0 con 0x7fadcc0634e0 2023-10-08T16:04:18.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.387+0000 7fadd1480700 1 -- 172.21.15.133:0/321460138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadcc155b80 con 0x7fadcc0634e0 2023-10-08T16:04:18.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.387+0000 7fadb2ffd700 1 -- 172.21.15.133:0/321460138 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc000cd30 con 0x7fadcc0634e0 2023-10-08T16:04:18.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.387+0000 7fadd1480700 1 -- 172.21.15.133:0/321460138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadcc146390 con 0x7fadcc0634e0 2023-10-08T16:04:18.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.387+0000 7fadd1480700 1 -- 172.21.15.133:0/321460138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadcc146580 con 0x7fadcc0634e0 2023-10-08T16:04:18.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.391+0000 7fadb2ffd700 1 -- 172.21.15.133:0/321460138 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fadc0013680 con 0x7fadcc0634e0 2023-10-08T16:04:18.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.391+0000 7fadb2ffd700 1 --2- 172.21.15.133:0/321460138 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fadb8060550 0x7fadb8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:18.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.391+0000 7fadca7fc700 1 --2- 172.21.15.133:0/321460138 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fadb8060550 0x7fadb8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:18.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.391+0000 7fadb2ffd700 1 -- 172.21.15.133:0/321460138 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fadc007cd30 con 0x7fadcc0634e0 2023-10-08T16:04:18.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.391+0000 7fadca7fc700 1 --2- 172.21.15.133:0/321460138 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fadb8060550 0x7fadb8062a00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fadbc0099b0 tx=0x7fadbc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:18.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.395+0000 7fadb2ffd700 1 -- 172.21.15.133:0/321460138 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fadc004d320 con 0x7fadcc0634e0 2023-10-08T16:04:18.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.591+0000 7fadd1480700 1 -- 172.21.15.133:0/321460138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fadcc064810 con 0x7fadcc0634e0 2023-10-08T16:04:18.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.647+0000 7fadb2ffd700 1 -- 172.21.15.133:0/321460138 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7fadc00170b0 con 0x7fadcc0634e0 2023-10-08T16:04:18.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.651+0000 7fadd1480700 1 -- 172.21.15.133:0/321460138 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fadb8060550 msgr2=0x7fadb8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:18.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.651+0000 7fadd1480700 1 --2- 172.21.15.133:0/321460138 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fadb8060550 0x7fadb8062a00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fadbc0099b0 tx=0x7fadbc017000 comp rx=0 tx=0).stop 2023-10-08T16:04:18.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.651+0000 7fadd1480700 1 -- 172.21.15.133:0/321460138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadcc0634e0 msgr2=0x7fadcc13e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:18.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.651+0000 7fadd1480700 1 --2- 172.21.15.133:0/321460138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadcc0634e0 0x7fadcc13e850 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fadc000ec80 tx=0x7fadc0009120 comp rx=0 tx=0).stop 2023-10-08T16:04:18.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.651+0000 7fadd1480700 1 -- 172.21.15.133:0/321460138 shutdown_connections 2023-10-08T16:04:18.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.651+0000 7fadd1480700 1 --2- 172.21.15.133:0/321460138 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fadb8060550 0x7fadb8062a00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:18.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.651+0000 7fadd1480700 1 --2- 172.21.15.133:0/321460138 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fadcc145b50 0x7fadcc0aed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:18.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.651+0000 7fadd1480700 1 --2- 172.21.15.133:0/321460138 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fadcc0b47b0 0x7fadcc13ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:18.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.651+0000 7fadd1480700 1 --2- 172.21.15.133:0/321460138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadcc0634e0 0x7fadcc13e850 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:18.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.651+0000 7fadd1480700 1 -- 172.21.15.133:0/321460138 >> 172.21.15.133:0/321460138 conn(0x7fadcc067e70 msgr2=0x7fadcc0b5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:18.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.651+0000 7fadd1480700 1 -- 172.21.15.133:0/321460138 shutdown_connections 2023-10-08T16:04:18.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.651+0000 7fadd1480700 1 -- 172.21.15.133:0/321460138 wait complete. 2023-10-08T16:04:18.671 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T16:04:18.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.767+0000 7f02cf3b0700 1 Processor -- start 2023-10-08T16:04:18.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.767+0000 7f02cf3b0700 1 -- start start 2023-10-08T16:04:18.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.767+0000 7f02cf3b0700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02c806a4e0 0x7f02c8143180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:18.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.767+0000 7f02cf3b0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f02c813cb20 0x7f02c80b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:18.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.767+0000 7f02cf3b0700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c8142cf0 con 0x7f02c806d1b0 2023-10-08T16:04:18.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.767+0000 7f02cf3b0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c806b090 con 0x7f02c813cb20 2023-10-08T16:04:18.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.767+0000 7f02cf3b0700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c806d5a0 con 0x7f02c806a4e0 2023-10-08T16:04:18.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.767+0000 7f02cd94d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f02c813cb20 0x7f02c80b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:18.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.767+0000 7f02cd94d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f02c813cb20 0x7f02c80b1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52782/0 (socket says 172.21.15.133:52782) 2023-10-08T16:04:18.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.767+0000 7f02cd94d700 1 -- 172.21.15.133:0/3397265967 learned_addr learned my addr 172.21.15.133:0/3397265967 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:18.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.771+0000 7f02cd14c700 1 --2- 172.21.15.133:0/3397265967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02c806a4e0 0x7f02c8143180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:18.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.771+0000 7f02cd94d700 1 -- 172.21.15.133:0/3397265967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02c806a4e0 msgr2=0x7f02c8143180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:18.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.771+0000 7f02cd94d700 1 --2- 172.21.15.133:0/3397265967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02c806a4e0 0x7f02c8143180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:18.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.771+0000 7f02cd94d700 1 -- 172.21.15.133:0/3397265967 >> v1:172.21.15.190:6789/0 conn(0x7f02c806d1b0 legacy=0x7f02c813c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:18.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.771+0000 7f02cd94d700 1 -- 172.21.15.133:0/3397265967 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c8142980 con 0x7f02c813cb20 2023-10-08T16:04:18.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.771+0000 7f02cd94d700 1 --2- 172.21.15.133:0/3397265967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02c813cb20 0x7f02c80b1d50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f02c0009f20 tx=0x7f02c0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfba16a96566bf79 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:18.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.771+0000 7f02bffff700 1 -- 172.21.15.133:0/3397265967 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c000e070 con 0x7f02c813cb20 2023-10-08T16:04:18.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.771+0000 7f02bffff700 1 -- 172.21.15.133:0/3397265967 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c000ba80 con 0x7f02c813cb20 2023-10-08T16:04:18.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.771+0000 7f02bffff700 1 -- 172.21.15.133:0/3397265967 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c00092e0 con 0x7f02c813cb20 2023-10-08T16:04:18.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.771+0000 7f02cf3b0700 1 -- 172.21.15.133:0/3397265967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02c813cb20 msgr2=0x7f02c80b1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:18.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.771+0000 7f02cf3b0700 1 --2- 172.21.15.133:0/3397265967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02c813cb20 0x7f02c80b1d50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f02c0009f20 tx=0x7f02c0009840 comp rx=0 tx=0).stop 2023-10-08T16:04:18.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.771+0000 7f02cf3b0700 1 -- 172.21.15.133:0/3397265967 shutdown_connections 2023-10-08T16:04:18.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.771+0000 7f02cf3b0700 1 --2- 172.21.15.133:0/3397265967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02c813cb20 0x7f02c80b1d50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:18.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.771+0000 7f02cf3b0700 1 --2- 172.21.15.133:0/3397265967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02c806a4e0 0x7f02c8143180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:18.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.771+0000 7f02cf3b0700 1 -- 172.21.15.133:0/3397265967 >> 172.21.15.133:0/3397265967 conn(0x7f02c80b6dc0 msgr2=0x7f02c80b71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:18.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.771+0000 7f02cf3b0700 1 -- 172.21.15.133:0/3397265967 shutdown_connections 2023-10-08T16:04:18.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.771+0000 7f02cf3b0700 1 -- 172.21.15.133:0/3397265967 wait complete. 2023-10-08T16:04:18.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.771+0000 7f02cf3b0700 1 Processor -- start 2023-10-08T16:04:18.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.771+0000 7f02cf3b0700 1 -- start start 2023-10-08T16:04:18.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.775+0000 7f02cf3b0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02c806a4e0 0x7f02c81453e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:18.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.775+0000 7f02cf3b0700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02c806d1b0 0x7f02c8140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:18.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.775+0000 7f02cf3b0700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02c813cb20 0x7f02c8141220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:18.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.775+0000 7f02cf3b0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c813d290 con 0x7f02c806a4e0 2023-10-08T16:04:18.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.775+0000 7f02cf3b0700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c8145920 con 0x7f02c806d1b0 2023-10-08T16:04:18.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.775+0000 7f02cf3b0700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c81447e0 con 0x7f02c813cb20 2023-10-08T16:04:18.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.775+0000 7f02cd14c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02c806a4e0 0x7f02c81453e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:18.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.775+0000 7f02cd14c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02c806a4e0 0x7f02c81453e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52798/0 (socket says 172.21.15.133:52798) 2023-10-08T16:04:18.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.775+0000 7f02cd14c700 1 -- 172.21.15.133:0/4292350829 learned_addr learned my addr 172.21.15.133:0/4292350829 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:18.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.775+0000 7f02cc94b700 1 --2- 172.21.15.133:0/4292350829 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02c806d1b0 0x7f02c8140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:18.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.775+0000 7f02cd94d700 1 --2- 172.21.15.133:0/4292350829 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02c813cb20 0x7f02c8141220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:18.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.775+0000 7f02cd14c700 1 -- 172.21.15.133:0/4292350829 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02c813cb20 msgr2=0x7f02c8141220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:18.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.775+0000 7f02cd14c700 1 --2- 172.21.15.133:0/4292350829 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02c813cb20 0x7f02c8141220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:18.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.775+0000 7f02cd14c700 1 -- 172.21.15.133:0/4292350829 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02c806d1b0 msgr2=0x7f02c8140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:18.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.775+0000 7f02cd14c700 1 --2- 172.21.15.133:0/4292350829 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02c806d1b0 0x7f02c8140ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:18.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.775+0000 7f02cd14c700 1 -- 172.21.15.133:0/4292350829 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c0009ae0 con 0x7f02c806a4e0 2023-10-08T16:04:18.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.775+0000 7f02cd14c700 1 --2- 172.21.15.133:0/4292350829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02c806a4e0 0x7f02c81453e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f02c400d8c0 tx=0x7f02c4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:18.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.775+0000 7f02bd7fa700 1 -- 172.21.15.133:0/4292350829 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c40125f0 con 0x7f02c806a4e0 2023-10-08T16:04:18.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.775+0000 7f02bd7fa700 1 -- 172.21.15.133:0/4292350829 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c4012750 con 0x7f02c806a4e0 2023-10-08T16:04:18.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.775+0000 7f02cf3b0700 1 -- 172.21.15.133:0/4292350829 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c8144260 con 0x7f02c806a4e0 2023-10-08T16:04:18.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.775+0000 7f02bd7fa700 1 -- 172.21.15.133:0/4292350829 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c4012af0 con 0x7f02c806a4e0 2023-10-08T16:04:18.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.775+0000 7f02cf3b0700 1 -- 172.21.15.133:0/4292350829 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c8144500 con 0x7f02c806a4e0 2023-10-08T16:04:18.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.775+0000 7f02cf3b0700 1 -- 172.21.15.133:0/4292350829 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c8142ea0 con 0x7f02c806a4e0 2023-10-08T16:04:18.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.779+0000 7f02bd7fa700 1 -- 172.21.15.133:0/4292350829 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f02c401e460 con 0x7f02c806a4e0 2023-10-08T16:04:18.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.779+0000 7f02bd7fa700 1 --2- 172.21.15.133:0/4292350829 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f02ac060580 0x7f02ac062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:18.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.779+0000 7f02bd7fa700 1 -- 172.21.15.133:0/4292350829 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f02c407cc80 con 0x7f02c806a4e0 2023-10-08T16:04:18.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.779+0000 7f02cc94b700 1 --2- 172.21.15.133:0/4292350829 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f02ac060580 0x7f02ac062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:18.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.779+0000 7f02cc94b700 1 --2- 172.21.15.133:0/4292350829 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f02ac060580 0x7f02ac062a30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f02c8142030 tx=0x7f02b8007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:18.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.783+0000 7f02bd7fa700 1 -- 172.21.15.133:0/4292350829 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f02c8142ea0 con 0x7f02c806a4e0 2023-10-08T16:04:18.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:18.983+0000 7f02cf3b0700 1 -- 172.21.15.133:0/4292350829 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f02c8142ea0 con 0x7f02c806a4e0 2023-10-08T16:04:19.068 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:04:19.070 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:04:19.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.667+0000 7f02bd7fa700 1 -- 172.21.15.133:0/4292350829 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f02c8142ea0 con 0x7f02c806a4e0 2023-10-08T16:04:19.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.671+0000 7f02cf3b0700 1 -- 172.21.15.133:0/4292350829 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f02ac060580 msgr2=0x7f02ac062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:19.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.671+0000 7f02cf3b0700 1 --2- 172.21.15.133:0/4292350829 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f02ac060580 0x7f02ac062a30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f02c8142030 tx=0x7f02b8007ec0 comp rx=0 tx=0).stop 2023-10-08T16:04:19.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.671+0000 7f02cf3b0700 1 -- 172.21.15.133:0/4292350829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02c806a4e0 msgr2=0x7f02c81453e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:19.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.671+0000 7f02cf3b0700 1 --2- 172.21.15.133:0/4292350829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02c806a4e0 0x7f02c81453e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f02c400d8c0 tx=0x7f02c4008040 comp rx=0 tx=0).stop 2023-10-08T16:04:19.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.671+0000 7f02cf3b0700 1 -- 172.21.15.133:0/4292350829 shutdown_connections 2023-10-08T16:04:19.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.671+0000 7f02cf3b0700 1 --2- 172.21.15.133:0/4292350829 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f02ac060580 0x7f02ac062a30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:19.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.671+0000 7f02cf3b0700 1 --2- 172.21.15.133:0/4292350829 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02c813cb20 0x7f02c8141220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:19.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.671+0000 7f02cf3b0700 1 --2- 172.21.15.133:0/4292350829 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02c806d1b0 0x7f02c8140ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:19.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.671+0000 7f02cf3b0700 1 --2- 172.21.15.133:0/4292350829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02c806a4e0 0x7f02c81453e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:19.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.671+0000 7f02cf3b0700 1 -- 172.21.15.133:0/4292350829 >> 172.21.15.133:0/4292350829 conn(0x7f02c80b6dc0 msgr2=0x7f02c80b4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:19.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.671+0000 7f02cf3b0700 1 -- 172.21.15.133:0/4292350829 shutdown_connections 2023-10-08T16:04:19.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.671+0000 7f02cf3b0700 1 -- 172.21.15.133:0/4292350829 wait complete. 2023-10-08T16:04:19.691 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:04:19.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.803+0000 7f5e9bfff700 1 Processor -- start 2023-10-08T16:04:19.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.803+0000 7f5e9bfff700 1 -- start start 2023-10-08T16:04:19.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.803+0000 7f5e9bfff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e9c0b1dc0 0x7f5e9c140280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:19.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.803+0000 7f5e9bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5e9c0ab960 0x7f5e9c0b0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:19.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.803+0000 7f5e9bfff700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e9c06b610 con 0x7f5e9c06e290 2023-10-08T16:04:19.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.803+0000 7f5e9bfff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e9c0afc70 con 0x7f5e9c0ab960 2023-10-08T16:04:19.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.803+0000 7f5e9bfff700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c0b0060 con 0x7f5e9c0b1dc0 2023-10-08T16:04:19.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.803+0000 7f5e9a7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5e9c0ab960 0x7f5e9c0b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:19.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.803+0000 7f5e9a7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5e9c0ab960 0x7f5e9c0b0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42610/0 (socket says 172.21.15.133:42610) 2023-10-08T16:04:19.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.803+0000 7f5e9a7fc700 1 -- 172.21.15.133:0/2415028143 learned_addr learned my addr 172.21.15.133:0/2415028143 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:19.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.803+0000 7f5e9affd700 1 --2- 172.21.15.133:0/2415028143 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e9c0b1dc0 0x7f5e9c140280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:19.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.803+0000 7f5e9a7fc700 1 -- 172.21.15.133:0/2415028143 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e9c0b1dc0 msgr2=0x7f5e9c140280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:19.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.803+0000 7f5e9a7fc700 1 --2- 172.21.15.133:0/2415028143 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e9c0b1dc0 0x7f5e9c140280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:19.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.803+0000 7f5e9a7fc700 1 -- 172.21.15.133:0/2415028143 >> v1:172.21.15.190:6789/0 conn(0x7f5e9c06e290 legacy=0x7f5e9c06e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:19.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.803+0000 7f5e9a7fc700 1 -- 172.21.15.133:0/2415028143 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9c0b0340 con 0x7f5e9c0ab960 2023-10-08T16:04:19.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.803+0000 7f5e9a7fc700 1 --2- 172.21.15.133:0/2415028143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e9c0ab960 0x7f5e9c0b0860 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c0099b0 tx=0x7f5e8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac2132c8beab40e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:19.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.803+0000 7f5e99ffb700 1 -- 172.21.15.133:0/2415028143 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c00b860 con 0x7f5e9c0ab960 2023-10-08T16:04:19.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.803+0000 7f5e99ffb700 1 -- 172.21.15.133:0/2415028143 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8c00b9c0 con 0x7f5e9c0ab960 2023-10-08T16:04:19.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.803+0000 7f5e99ffb700 1 -- 172.21.15.133:0/2415028143 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c00bd80 con 0x7f5e9c0ab960 2023-10-08T16:04:19.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.807+0000 7f5e9bfff700 1 -- 172.21.15.133:0/2415028143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e9c0ab960 msgr2=0x7f5e9c0b0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:19.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.807+0000 7f5e9bfff700 1 --2- 172.21.15.133:0/2415028143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e9c0ab960 0x7f5e9c0b0860 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c0099b0 tx=0x7f5e8c009250 comp rx=0 tx=0).stop 2023-10-08T16:04:19.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.807+0000 7f5e9bfff700 1 -- 172.21.15.133:0/2415028143 shutdown_connections 2023-10-08T16:04:19.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.807+0000 7f5e9bfff700 1 --2- 172.21.15.133:0/2415028143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e9c0ab960 0x7f5e9c0b0860 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:19.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.807+0000 7f5e9bfff700 1 --2- 172.21.15.133:0/2415028143 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e9c0b1dc0 0x7f5e9c140280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:19.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.807+0000 7f5e9bfff700 1 -- 172.21.15.133:0/2415028143 >> 172.21.15.133:0/2415028143 conn(0x7f5e9c063670 msgr2=0x7f5e9c0b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:19.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.807+0000 7f5e9bfff700 1 -- 172.21.15.133:0/2415028143 shutdown_connections 2023-10-08T16:04:19.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.807+0000 7f5e9bfff700 1 -- 172.21.15.133:0/2415028143 wait complete. 2023-10-08T16:04:19.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.807+0000 7f5e9bfff700 1 Processor -- start 2023-10-08T16:04:19.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.807+0000 7f5e9bfff700 1 -- start start 2023-10-08T16:04:19.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.807+0000 7f5e9bfff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e9c06e290 0x7f5e9c0b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:19.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.807+0000 7f5e9bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e9c0ab960 0x7f5e9c152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:19.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.807+0000 7f5e9bfff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e9c0b1dc0 0x7f5e9c1526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:19.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.807+0000 7f5e9bfff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c0a6ae0 con 0x7f5e9c0ab960 2023-10-08T16:04:19.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.807+0000 7f5e9bfff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c0b4df0 con 0x7f5e9c06e290 2023-10-08T16:04:19.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.807+0000 7f5e9bfff700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c0b56b0 con 0x7f5e9c0b1dc0 2023-10-08T16:04:19.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.811+0000 7f5e9a7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e9c0ab960 0x7f5e9c152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:19.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.811+0000 7f5e9a7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e9c0ab960 0x7f5e9c152170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42622/0 (socket says 172.21.15.133:42622) 2023-10-08T16:04:19.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.811+0000 7f5e9a7fc700 1 -- 172.21.15.133:0/58503046 learned_addr learned my addr 172.21.15.133:0/58503046 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:19.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.811+0000 7f5e9b7fe700 1 --2- 172.21.15.133:0/58503046 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e9c0b1dc0 0x7f5e9c1526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:19.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.811+0000 7f5e9affd700 1 --2- 172.21.15.133:0/58503046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e9c06e290 0x7f5e9c0b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:19.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.811+0000 7f5e9a7fc700 1 -- 172.21.15.133:0/58503046 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e9c0b1dc0 msgr2=0x7f5e9c1526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:19.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.811+0000 7f5e9a7fc700 1 --2- 172.21.15.133:0/58503046 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e9c0b1dc0 0x7f5e9c1526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:19.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.811+0000 7f5e9a7fc700 1 -- 172.21.15.133:0/58503046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e9c06e290 msgr2=0x7f5e9c0b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:19.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.811+0000 7f5e9a7fc700 1 --2- 172.21.15.133:0/58503046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e9c06e290 0x7f5e9c0b48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:19.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.811+0000 7f5e9a7fc700 1 -- 172.21.15.133:0/58503046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8c0094f0 con 0x7f5e9c0ab960 2023-10-08T16:04:19.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.811+0000 7f5e9a7fc700 1 --2- 172.21.15.133:0/58503046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e9c0ab960 0x7f5e9c152170 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c006fd0 tx=0x7f5e8c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:19.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.811+0000 7f5e92ffd700 1 -- 172.21.15.133:0/58503046 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c01f070 con 0x7f5e9c0ab960 2023-10-08T16:04:19.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.811+0000 7f5e92ffd700 1 -- 172.21.15.133:0/58503046 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8c006ab0 con 0x7f5e9c0ab960 2023-10-08T16:04:19.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.811+0000 7f5e9bfff700 1 -- 172.21.15.133:0/58503046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e9c0a5550 con 0x7f5e9c0ab960 2023-10-08T16:04:19.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.811+0000 7f5e92ffd700 1 -- 172.21.15.133:0/58503046 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c00b860 con 0x7f5e9c0ab960 2023-10-08T16:04:19.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.811+0000 7f5e9bfff700 1 -- 172.21.15.133:0/58503046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e9c13c4c0 con 0x7f5e9c0ab960 2023-10-08T16:04:19.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.811+0000 7f5e9bfff700 1 -- 172.21.15.133:0/58503046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e9c141430 con 0x7f5e9c0ab960 2023-10-08T16:04:19.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.815+0000 7f5e92ffd700 1 -- 172.21.15.133:0/58503046 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5e8c01a630 con 0x7f5e9c0ab960 2023-10-08T16:04:19.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.815+0000 7f5e92ffd700 1 --2- 172.21.15.133:0/58503046 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5e7c060550 0x7f5e7c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:19.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.815+0000 7f5e9affd700 1 --2- 172.21.15.133:0/58503046 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5e7c060550 0x7f5e7c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:19.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.815+0000 7f5e92ffd700 1 -- 172.21.15.133:0/58503046 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5e8c07db70 con 0x7f5e9c0ab960 2023-10-08T16:04:19.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.815+0000 7f5e9affd700 1 --2- 172.21.15.133:0/58503046 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5e7c060550 0x7f5e7c062a00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5e84006fd0 tx=0x7f5e84008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:19.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:19.819+0000 7f5e92ffd700 1 -- 172.21.15.133:0/58503046 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5e8c04e140 con 0x7f5e9c0ab960 2023-10-08T16:04:20.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.015+0000 7f5e9bfff700 1 -- 172.21.15.133:0/58503046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e9c04be40 con 0x7f5e9c0ab960 2023-10-08T16:04:20.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.019+0000 7f5e92ffd700 1 -- 172.21.15.133:0/58503046 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3082 (secure 0 0 0) 0x7f5e8c015c20 con 0x7f5e9c0ab960 2023-10-08T16:04:20.021 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:04:20.021 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3690493804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3690493804},{"type":"v1","addr":"172.21.15.190:6833","nonce":3690493804}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:04:16.997946+0000","modified":"2023-10-08T16:04:19.656961+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/443398897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":443398897},{"type":"v1","addr":"172.21.15.133:6835","nonce":443398897}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:04:20.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.019+0000 7f5e9bfff700 1 -- 172.21.15.133:0/58503046 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5e7c060550 msgr2=0x7f5e7c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:20.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.019+0000 7f5e9bfff700 1 --2- 172.21.15.133:0/58503046 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5e7c060550 0x7f5e7c062a00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5e84006fd0 tx=0x7f5e84008040 comp rx=0 tx=0).stop 2023-10-08T16:04:20.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.019+0000 7f5e9bfff700 1 -- 172.21.15.133:0/58503046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e9c0ab960 msgr2=0x7f5e9c152170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:20.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.019+0000 7f5e9bfff700 1 --2- 172.21.15.133:0/58503046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e9c0ab960 0x7f5e9c152170 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c006fd0 tx=0x7f5e8c017000 comp rx=0 tx=0).stop 2023-10-08T16:04:20.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.019+0000 7f5e9bfff700 1 -- 172.21.15.133:0/58503046 shutdown_connections 2023-10-08T16:04:20.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.019+0000 7f5e9bfff700 1 --2- 172.21.15.133:0/58503046 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5e7c060550 0x7f5e7c062a00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.019+0000 7f5e9bfff700 1 --2- 172.21.15.133:0/58503046 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e9c0b1dc0 0x7f5e9c1526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.019+0000 7f5e9bfff700 1 --2- 172.21.15.133:0/58503046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e9c0ab960 0x7f5e9c152170 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.019+0000 7f5e9bfff700 1 --2- 172.21.15.133:0/58503046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e9c06e290 0x7f5e9c0b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.019+0000 7f5e9bfff700 1 -- 172.21.15.133:0/58503046 >> 172.21.15.133:0/58503046 conn(0x7f5e9c063670 msgr2=0x7f5e9c06fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:20.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.019+0000 7f5e9bfff700 1 -- 172.21.15.133:0/58503046 shutdown_connections 2023-10-08T16:04:20.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.019+0000 7f5e9bfff700 1 -- 172.21.15.133:0/58503046 wait complete. 2023-10-08T16:04:20.025 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 6 2023-10-08T16:04:20.036 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:04:20.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.135+0000 7f405e3fc700 1 Processor -- start 2023-10-08T16:04:20.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.135+0000 7f405e3fc700 1 -- start start 2023-10-08T16:04:20.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.135+0000 7f405e3fc700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40580aef90 0x7f405814a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:20.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.135+0000 7f405e3fc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40580b0d80 con 0x7f4058070830 2023-10-08T16:04:20.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.135+0000 7f405e3fc700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40580ad810 con 0x7f40580b1920 2023-10-08T16:04:20.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.135+0000 7f405e3fc700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40580af400 con 0x7f40580aef90 2023-10-08T16:04:20.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.139+0000 7f405d3fa700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4058070830 0x7f40580b1210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49362/0 (socket says 172.21.15.133:49362) 2023-10-08T16:04:20.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.139+0000 7f405d3fa700 1 -- 172.21.15.133:0/1036968595 learned_addr learned my addr 172.21.15.133:0/1036968595 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:20.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.139+0000 7f405cbf9700 1 --2- 172.21.15.133:0/1036968595 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40580aef90 0x7f405814a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:20.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.139+0000 7f404ffff700 1 -- 172.21.15.133:0/1036968595 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 673894564 0 0) 0x7f40580b0d80 con 0x7f4058070830 2023-10-08T16:04:20.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.139+0000 7f404ffff700 1 -- 172.21.15.133:0/1036968595 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4044003570 con 0x7f4058070830 2023-10-08T16:04:20.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.139+0000 7f404ffff700 1 -- 172.21.15.133:0/1036968595 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974893566 0 0) 0x7f40580ad810 con 0x7f40580b1920 2023-10-08T16:04:20.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.139+0000 7f404ffff700 1 -- 172.21.15.133:0/1036968595 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40580b0d80 con 0x7f40580b1920 2023-10-08T16:04:20.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.139+0000 7f405cbf9700 1 -- 172.21.15.133:0/1036968595 >> v1:172.21.15.190:6789/0 conn(0x7f40580b1920 legacy=0x7f405814ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:20.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.139+0000 7f405cbf9700 1 -- 172.21.15.133:0/1036968595 >> v1:172.21.15.133:6789/0 conn(0x7f4058070830 legacy=0x7f40580b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:20.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.139+0000 7f405cbf9700 1 -- 172.21.15.133:0/1036968595 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40580b2a10 con 0x7f40580aef90 2023-10-08T16:04:20.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.139+0000 7f405cbf9700 1 --2- 172.21.15.133:0/1036968595 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40580aef90 0x7f405814a510 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4050009e90 tx=0x7f4050009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e37585bee37f56c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:20.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.139+0000 7f404ffff700 1 -- 172.21.15.133:0/1036968595 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405000e070 con 0x7f40580aef90 2023-10-08T16:04:20.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.139+0000 7f404ffff700 1 -- 172.21.15.133:0/1036968595 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405000bb80 con 0x7f40580aef90 2023-10-08T16:04:20.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.139+0000 7f404ffff700 1 -- 172.21.15.133:0/1036968595 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050012430 con 0x7f40580aef90 2023-10-08T16:04:20.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.139+0000 7f405e3fc700 1 -- 172.21.15.133:0/1036968595 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40580aef90 msgr2=0x7f405814a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:20.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.139+0000 7f405e3fc700 1 --2- 172.21.15.133:0/1036968595 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40580aef90 0x7f405814a510 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4050009e90 tx=0x7f4050009780 comp rx=0 tx=0).stop 2023-10-08T16:04:20.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.139+0000 7f405e3fc700 1 -- 172.21.15.133:0/1036968595 shutdown_connections 2023-10-08T16:04:20.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.139+0000 7f405e3fc700 1 --2- 172.21.15.133:0/1036968595 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40580aef90 0x7f405814a510 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.139+0000 7f405e3fc700 1 -- 172.21.15.133:0/1036968595 >> 172.21.15.133:0/1036968595 conn(0x7f4058066f90 msgr2=0x7f4058067390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:20.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.139+0000 7f405e3fc700 1 -- 172.21.15.133:0/1036968595 shutdown_connections 2023-10-08T16:04:20.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.139+0000 7f405e3fc700 1 -- 172.21.15.133:0/1036968595 wait complete. 2023-10-08T16:04:20.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.139+0000 7f405e3fc700 1 Processor -- start 2023-10-08T16:04:20.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.139+0000 7f405e3fc700 1 -- start start 2023-10-08T16:04:20.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.143+0000 7f405e3fc700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4058070830 0x7f405806be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:20.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.143+0000 7f405e3fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40580aef90 0x7f405806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:20.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.143+0000 7f405e3fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40580b1920 0x7f405806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:20.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.143+0000 7f405e3fc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405806e810 con 0x7f40580aef90 2023-10-08T16:04:20.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.143+0000 7f405e3fc700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405806dd30 con 0x7f40580b1920 2023-10-08T16:04:20.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.143+0000 7f405e3fc700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405806c420 con 0x7f4058070830 2023-10-08T16:04:20.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.143+0000 7f405cbf9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40580aef90 0x7f405806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:20.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.143+0000 7f405d3fa700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4058070830 0x7f405806be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:20.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.143+0000 7f405d3fa700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4058070830 0x7f405806be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.133:45484/0 (socket says 172.21.15.133:45484) 2023-10-08T16:04:20.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.143+0000 7f405d3fa700 1 -- 172.21.15.133:0/1016110005 learned_addr learned my addr 172.21.15.133:0/1016110005 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:20.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.143+0000 7f405cbf9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40580aef90 0x7f405806d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42628/0 (socket says 172.21.15.133:42628) 2023-10-08T16:04:20.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.143+0000 7f405dbfb700 1 --2- 172.21.15.133:0/1016110005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40580b1920 0x7f405806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:20.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.143+0000 7f405cbf9700 1 -- 172.21.15.133:0/1016110005 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4058070830 msgr2=0x7f405806be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:20.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.143+0000 7f405cbf9700 1 --2- 172.21.15.133:0/1016110005 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4058070830 0x7f405806be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.143+0000 7f405cbf9700 1 -- 172.21.15.133:0/1016110005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40580b1920 msgr2=0x7f405806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:20.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.143+0000 7f405cbf9700 1 --2- 172.21.15.133:0/1016110005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40580b1920 0x7f405806d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.143+0000 7f405cbf9700 1 -- 172.21.15.133:0/1016110005 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4050009a20 con 0x7f40580aef90 2023-10-08T16:04:20.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.143+0000 7f405cbf9700 1 --2- 172.21.15.133:0/1016110005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40580aef90 0x7f405806d2b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4050016000 tx=0x7f4050019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:20.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.143+0000 7f404d7fa700 1 -- 172.21.15.133:0/1016110005 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050012b00 con 0x7f40580aef90 2023-10-08T16:04:20.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.143+0000 7f404d7fa700 1 -- 172.21.15.133:0/1016110005 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4050012c80 con 0x7f40580aef90 2023-10-08T16:04:20.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.143+0000 7f405e3fc700 1 -- 172.21.15.133:0/1016110005 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40581558a0 con 0x7f40580aef90 2023-10-08T16:04:20.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.143+0000 7f404d7fa700 1 -- 172.21.15.133:0/1016110005 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40500263f0 con 0x7f40580aef90 2023-10-08T16:04:20.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.143+0000 7f405e3fc700 1 -- 172.21.15.133:0/1016110005 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f405806ea10 con 0x7f40580aef90 2023-10-08T16:04:20.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.143+0000 7f405e3fc700 1 -- 172.21.15.133:0/1016110005 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40581556d0 con 0x7f40580aef90 2023-10-08T16:04:20.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.147+0000 7f404d7fa700 1 -- 172.21.15.133:0/1016110005 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f405001b3f0 con 0x7f40580aef90 2023-10-08T16:04:20.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.147+0000 7f404d7fa700 1 --2- 172.21.15.133:0/1016110005 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f403c060550 0x7f403c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:20.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.147+0000 7f404d7fa700 1 -- 172.21.15.133:0/1016110005 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f405007e270 con 0x7f40580aef90 2023-10-08T16:04:20.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.147+0000 7f405d3fa700 1 --2- 172.21.15.133:0/1016110005 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f403c060550 0x7f403c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:20.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.147+0000 7f405d3fa700 1 --2- 172.21.15.133:0/1016110005 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f403c060550 0x7f403c062a00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f40480058d0 tx=0x7f4048009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:20.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.155+0000 7f404d7fa700 1 -- 172.21.15.133:0/1016110005 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f405004e7c0 con 0x7f40580aef90 2023-10-08T16:04:20.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.315+0000 7f405e3fc700 1 -- 172.21.15.133:0/1016110005 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f405804be40 con 0x7f40580aef90 2023-10-08T16:04:20.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.319+0000 7f404d7fa700 1 -- 172.21.15.133:0/1016110005 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f4050051de0 con 0x7f40580aef90 2023-10-08T16:04:20.322 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:04:20.322 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"f2546191-d59e-4805-8e1b-3d8d3d1dad86","created":"2023-10-08T16:03:52.631855+0000","modified":"2023-10-08T16:04:18.600728+0000","last_up_change":"2023-10-08T16:04:04.030581+0000","last_in_change":"2023-10-08T16:03:54.835293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:04.898316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:14.869859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:15.983795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8c5deadf-a203-4d30-aa7f-6e2e492b6ffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6809","nonce":33493},{"type":"v1","addr":"172.21.15.133:6811","nonce":33493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":33493},{"type":"v1","addr":"172.21.15.133:6815","nonce":33493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":33493},{"type":"v1","addr":"172.21.15.133:6822","nonce":33493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":33493},{"type":"v1","addr":"172.21.15.133:6818","nonce":33493}]},"public_addr":"172.21.15.133:6811/33493","cluster_addr":"172.21.15.133:6815/33493","heartbeat_back_addr":"172.21.15.133:6822/33493","heartbeat_front_addr":"172.21.15.133:6818/33493","state":["exists","up"]},{"osd":1,"uuid":"9b081c42-c915-48c3-a1ad-410f09a78576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":33490},{"type":"v1","addr":"172.21.15.133:6801","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":33490},{"type":"v1","addr":"172.21.15.133:6803","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":33490},{"type":"v1","addr":"172.21.15.133:6807","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":33490},{"type":"v1","addr":"172.21.15.133:6805","nonce":33490}]},"public_addr":"172.21.15.133:6801/33490","cluster_addr":"172.21.15.133:6803/33490","heartbeat_back_addr":"172.21.15.133:6807/33490","heartbeat_front_addr":"172.21.15.133:6805/33490","state":["exists","up"]},{"osd":2,"uuid":"88ecda43-01cd-4644-ab0c-92c91fd38966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":33492},{"type":"v1","addr":"172.21.15.133:6825","nonce":33492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":33492},{"type":"v1","addr":"172.21.15.133:6827","nonce":33492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":33492},{"type":"v1","addr":"172.21.15.133:6831","nonce":33492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":33492},{"type":"v1","addr":"172.21.15.133:6829","nonce":33492}]},"public_addr":"172.21.15.133:6825/33492","cluster_addr":"172.21.15.133:6827/33492","heartbeat_back_addr":"172.21.15.133:6831/33492","heartbeat_front_addr":"172.21.15.133:6829/33492","state":["exists","up"]},{"osd":3,"uuid":"39faf38d-b8e2-4e11-9b3b-84dc834c977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":33491},{"type":"v1","addr":"172.21.15.133:6810","nonce":33491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":33491},{"type":"v1","addr":"172.21.15.133:6814","nonce":33491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":33491},{"type":"v1","addr":"172.21.15.133:6823","nonce":33491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":33491},{"type":"v1","addr":"172.21.15.133:6819","nonce":33491}]},"public_addr":"172.21.15.133:6810/33491","cluster_addr":"172.21.15.133:6814/33491","heartbeat_back_addr":"172.21.15.133:6823/33491","heartbeat_front_addr":"172.21.15.133:6819/33491","state":["exists","up"]},{"osd":4,"uuid":"4c097e61-1cad-4b61-9183-4e7bc486bd32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":33678},{"type":"v1","addr":"172.21.15.190:6810","nonce":33678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":33678},{"type":"v1","addr":"172.21.15.190:6814","nonce":33678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":33678},{"type":"v1","addr":"172.21.15.190:6822","nonce":33678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":33678},{"type":"v1","addr":"172.21.15.190:6818","nonce":33678}]},"public_addr":"172.21.15.190:6810/33678","cluster_addr":"172.21.15.190:6814/33678","heartbeat_back_addr":"172.21.15.190:6822/33678","heartbeat_front_addr":"172.21.15.190:6818/33678","state":["exists","up"]},{"osd":5,"uuid":"05f072e0-7bc0-40f0-8cb6-8e322c82d6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":33676},{"type":"v1","addr":"172.21.15.190:6811","nonce":33676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":33676},{"type":"v1","addr":"172.21.15.190:6815","nonce":33676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":33676},{"type":"v1","addr":"172.21.15.190:6823","nonce":33676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":33676},{"type":"v1","addr":"172.21.15.190:6819","nonce":33676}]},"public_addr":"172.21.15.190:6811/33676","cluster_addr":"172.21.15.190:6815/33676","heartbeat_back_addr":"172.21.15.190:6823/33676","heartbeat_front_addr":"172.21.15.190:6819/33676","state":["exists","up"]},{"osd":6,"uuid":"1bcce8d7-14f3-442d-b135-68c7d66cdedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":33677},{"type":"v1","addr":"172.21.15.190:6801","nonce":33677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":33677},{"type":"v1","addr":"172.21.15.190:6803","nonce":33677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":33677},{"type":"v1","addr":"172.21.15.190:6807","nonce":33677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":33677},{"type":"v1","addr":"172.21.15.190:6805","nonce":33677}]},"public_addr":"172.21.15.190:6801/33677","cluster_addr":"172.21.15.190:6803/33677","heartbeat_back_addr":"172.21.15.190:6807/33677","heartbeat_front_addr":"172.21.15.190:6805/33677","state":["exists","up"]},{"osd":7,"uuid":"9157dbf7-2bf9-43d7-a89a-a8e3dae7514c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":33686},{"type":"v1","addr":"172.21.15.190:6825","nonce":33686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":33686},{"type":"v1","addr":"172.21.15.190:6827","nonce":33686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":33686},{"type":"v1","addr":"172.21.15.190:6831","nonce":33686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":33686},{"type":"v1","addr":"172.21.15.190:6829","nonce":33686}]},"public_addr":"172.21.15.190:6825/33686","cluster_addr":"172.21.15.190:6827/33686","heartbeat_back_addr":"172.21.15.190:6831/33686","heartbeat_front_addr":"172.21.15.190:6829/33686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.886742+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.199618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.871695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.115926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.069650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.841448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.132320+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.315132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:04:20.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.319+0000 7f405e3fc700 1 -- 172.21.15.133:0/1016110005 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f403c060550 msgr2=0x7f403c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:20.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.319+0000 7f405e3fc700 1 --2- 172.21.15.133:0/1016110005 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f403c060550 0x7f403c062a00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f40480058d0 tx=0x7f4048009040 comp rx=0 tx=0).stop 2023-10-08T16:04:20.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.319+0000 7f405e3fc700 1 -- 172.21.15.133:0/1016110005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40580aef90 msgr2=0x7f405806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:20.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.319+0000 7f405e3fc700 1 --2- 172.21.15.133:0/1016110005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40580aef90 0x7f405806d2b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4050016000 tx=0x7f4050019000 comp rx=0 tx=0).stop 2023-10-08T16:04:20.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.319+0000 7f405e3fc700 1 -- 172.21.15.133:0/1016110005 shutdown_connections 2023-10-08T16:04:20.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.319+0000 7f405e3fc700 1 --2- 172.21.15.133:0/1016110005 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f403c060550 0x7f403c062a00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.319+0000 7f405e3fc700 1 --2- 172.21.15.133:0/1016110005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40580b1920 0x7f405806d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.319+0000 7f405e3fc700 1 --2- 172.21.15.133:0/1016110005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40580aef90 0x7f405806d2b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.319+0000 7f405e3fc700 1 --2- 172.21.15.133:0/1016110005 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4058070830 0x7f405806be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.319+0000 7f405e3fc700 1 -- 172.21.15.133:0/1016110005 >> 172.21.15.133:0/1016110005 conn(0x7f4058066f90 msgr2=0x7f4058148290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:20.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.319+0000 7f405e3fc700 1 -- 172.21.15.133:0/1016110005 shutdown_connections 2023-10-08T16:04:20.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.319+0000 7f405e3fc700 1 -- 172.21.15.133:0/1016110005 wait complete. 2023-10-08T16:04:20.335 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T16:04:20.336 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:04:20.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.435+0000 7f1d0620f700 1 Processor -- start 2023-10-08T16:04:20.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.435+0000 7f1d0620f700 1 -- start start 2023-10-08T16:04:20.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.439+0000 7f1d0620f700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1d000acb60 0x7f1d001423f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:20.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.439+0000 7f1d0620f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d0013fca0 con 0x7f1d00141170 2023-10-08T16:04:20.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.439+0000 7f1d0620f700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d000af5c0 con 0x7f1d000acf30 2023-10-08T16:04:20.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.439+0000 7f1d0620f700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d00141ce0 con 0x7f1d000acb60 2023-10-08T16:04:20.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.439+0000 7f1d05a0e700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1d00141170 0x7f1d001415d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49366/0 (socket says 172.21.15.133:49366) 2023-10-08T16:04:20.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.439+0000 7f1d05a0e700 1 -- 172.21.15.133:0/1525785587 learned_addr learned my addr 172.21.15.133:0/1525785587 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:20.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.439+0000 7f1d0520d700 1 --2- 172.21.15.133:0/1525785587 >> v2:172.21.15.190:3300/0 conn(0x7f1d000acb60 0x7f1d001423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:20.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.439+0000 7f1cf7fff700 1 -- 172.21.15.133:0/1525785587 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262376814 0 0) 0x7f1d0013fca0 con 0x7f1d00141170 2023-10-08T16:04:20.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.439+0000 7f1cf7fff700 1 -- 172.21.15.133:0/1525785587 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cec003570 con 0x7f1d00141170 2023-10-08T16:04:20.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.439+0000 7f1d0520d700 1 -- 172.21.15.133:0/1525785587 >> v1:172.21.15.190:6789/0 conn(0x7f1d000acf30 legacy=0x7f1d000ae940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:20.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.439+0000 7f1d0520d700 1 -- 172.21.15.133:0/1525785587 >> v1:172.21.15.133:6789/0 conn(0x7f1d00141170 legacy=0x7f1d001415d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:20.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.439+0000 7f1d0520d700 1 -- 172.21.15.133:0/1525785587 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d000af050 con 0x7f1d000acb60 2023-10-08T16:04:20.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.439+0000 7f1d0520d700 1 --2- 172.21.15.133:0/1525785587 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d000acb60 0x7f1d001423f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc009910 tx=0x7f1cfc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=996ce45612546bc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:20.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.439+0000 7f1cf7fff700 1 -- 172.21.15.133:0/1525785587 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc00b640 con 0x7f1d000acb60 2023-10-08T16:04:20.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.439+0000 7f1cf7fff700 1 -- 172.21.15.133:0/1525785587 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cfc00b7a0 con 0x7f1d000acb60 2023-10-08T16:04:20.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.439+0000 7f1cf7fff700 1 -- 172.21.15.133:0/1525785587 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc00bb20 con 0x7f1d000acb60 2023-10-08T16:04:20.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.439+0000 7f1d0620f700 1 -- 172.21.15.133:0/1525785587 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d000acb60 msgr2=0x7f1d001423f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:20.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.439+0000 7f1d0620f700 1 --2- 172.21.15.133:0/1525785587 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d000acb60 0x7f1d001423f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc009910 tx=0x7f1cfc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.439+0000 7f1d0620f700 1 -- 172.21.15.133:0/1525785587 shutdown_connections 2023-10-08T16:04:20.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.439+0000 7f1d0620f700 1 --2- 172.21.15.133:0/1525785587 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d000acb60 0x7f1d001423f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.439+0000 7f1d0620f700 1 -- 172.21.15.133:0/1525785587 >> 172.21.15.133:0/1525785587 conn(0x7f1d00066f90 msgr2=0x7f1d00067390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:20.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.439+0000 7f1d0620f700 1 -- 172.21.15.133:0/1525785587 shutdown_connections 2023-10-08T16:04:20.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.439+0000 7f1d0620f700 1 -- 172.21.15.133:0/1525785587 wait complete. 2023-10-08T16:04:20.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.439+0000 7f1d0620f700 1 Processor -- start 2023-10-08T16:04:20.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.443+0000 7f1d0620f700 1 -- start start 2023-10-08T16:04:20.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.443+0000 7f1d0620f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d000acb60 0x7f1d0013eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:20.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.443+0000 7f1d0620f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d000acf30 0x7f1d000a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:20.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.443+0000 7f1d0620f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d00141170 0x7f1d00138720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:20.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.443+0000 7f1d0620f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0006da00 con 0x7f1d00141170 2023-10-08T16:04:20.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.443+0000 7f1d0620f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0006dce0 con 0x7f1d000acf30 2023-10-08T16:04:20.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.443+0000 7f1d0620f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0006dfc0 con 0x7f1d000acb60 2023-10-08T16:04:20.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.443+0000 7f1d05a0e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d00141170 0x7f1d00138720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:20.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.443+0000 7f1d05a0e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d00141170 0x7f1d00138720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42638/0 (socket says 172.21.15.133:42638) 2023-10-08T16:04:20.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.443+0000 7f1d05a0e700 1 -- 172.21.15.133:0/2314528705 learned_addr learned my addr 172.21.15.133:0/2314528705 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:20.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.443+0000 7f1d0520d700 1 --2- 172.21.15.133:0/2314528705 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d000acb60 0x7f1d0013eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:20.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.443+0000 7f1d04a0c700 1 --2- 172.21.15.133:0/2314528705 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d000acf30 0x7f1d000a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:20.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.443+0000 7f1d05a0e700 1 -- 172.21.15.133:0/2314528705 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d000acb60 msgr2=0x7f1d0013eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:20.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.443+0000 7f1d05a0e700 1 --2- 172.21.15.133:0/2314528705 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d000acb60 0x7f1d0013eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.443+0000 7f1d05a0e700 1 -- 172.21.15.133:0/2314528705 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d000acf30 msgr2=0x7f1d000a5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:20.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.443+0000 7f1d05a0e700 1 --2- 172.21.15.133:0/2314528705 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d000acf30 0x7f1d000a5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.443+0000 7f1d05a0e700 1 -- 172.21.15.133:0/2314528705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cfc009420 con 0x7f1d00141170 2023-10-08T16:04:20.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.443+0000 7f1d05a0e700 1 --2- 172.21.15.133:0/2314528705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d00141170 0x7f1d00138720 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1cf800cc60 tx=0x7f1cf8001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:20.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.443+0000 7f1cf57fa700 1 -- 172.21.15.133:0/2314528705 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf800a8b0 con 0x7f1d00141170 2023-10-08T16:04:20.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.443+0000 7f1cf57fa700 1 -- 172.21.15.133:0/2314528705 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf800aa10 con 0x7f1d00141170 2023-10-08T16:04:20.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.443+0000 7f1d0620f700 1 -- 172.21.15.133:0/2314528705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d0013f6b0 con 0x7f1d00141170 2023-10-08T16:04:20.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.443+0000 7f1cf57fa700 1 -- 172.21.15.133:0/2314528705 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf800adb0 con 0x7f1d00141170 2023-10-08T16:04:20.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.443+0000 7f1d0620f700 1 -- 172.21.15.133:0/2314528705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d000a64d0 con 0x7f1d00141170 2023-10-08T16:04:20.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.443+0000 7f1d0620f700 1 -- 172.21.15.133:0/2314528705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d0006e1e0 con 0x7f1d00141170 2023-10-08T16:04:20.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.447+0000 7f1cf57fa700 1 -- 172.21.15.133:0/2314528705 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1cf8007300 con 0x7f1d00141170 2023-10-08T16:04:20.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.447+0000 7f1cf57fa700 1 --2- 172.21.15.133:0/2314528705 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f1ce4060550 0x7f1ce4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:20.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.447+0000 7f1cf57fa700 1 -- 172.21.15.133:0/2314528705 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1cf807cb90 con 0x7f1d00141170 2023-10-08T16:04:20.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.447+0000 7f1d0520d700 1 --2- 172.21.15.133:0/2314528705 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f1ce4060550 0x7f1ce4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:20.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.447+0000 7f1d0520d700 1 --2- 172.21.15.133:0/2314528705 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f1ce4060550 0x7f1ce4062a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1d000ac0e0 tx=0x7f1cfc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:20.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.451+0000 7f1cf57fa700 1 -- 172.21.15.133:0/2314528705 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1cf804d160 con 0x7f1d00141170 2023-10-08T16:04:20.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.611+0000 7f1d0620f700 1 -- 172.21.15.133:0/2314528705 --> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1d0006db40 con 0x7f1ce4060550 2023-10-08T16:04:20.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.627+0000 7f1cf57fa700 1 -- 172.21.15.133:0/2314528705 <== mgr.4104 v2:172.21.15.133:6832/33362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249703 (secure 0 0 0) 0x7f1d0006db40 con 0x7f1ce4060550 2023-10-08T16:04:20.634 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:04:20.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.631+0000 7f1d0620f700 1 -- 172.21.15.133:0/2314528705 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f1ce4060550 msgr2=0x7f1ce4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:20.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.631+0000 7f1d0620f700 1 --2- 172.21.15.133:0/2314528705 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f1ce4060550 0x7f1ce4062a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1d000ac0e0 tx=0x7f1cfc017000 comp rx=0 tx=0).stop 2023-10-08T16:04:20.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.631+0000 7f1d0620f700 1 -- 172.21.15.133:0/2314528705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d00141170 msgr2=0x7f1d00138720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:20.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.631+0000 7f1d0620f700 1 --2- 172.21.15.133:0/2314528705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d00141170 0x7f1d00138720 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1cf800cc60 tx=0x7f1cf8001aa0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.631+0000 7f1d0620f700 1 -- 172.21.15.133:0/2314528705 shutdown_connections 2023-10-08T16:04:20.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.631+0000 7f1d0620f700 1 --2- 172.21.15.133:0/2314528705 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f1ce4060550 0x7f1ce4062a00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.631+0000 7f1d0620f700 1 --2- 172.21.15.133:0/2314528705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d00141170 0x7f1d00138720 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.631+0000 7f1d0620f700 1 --2- 172.21.15.133:0/2314528705 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d000acf30 0x7f1d000a5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.631+0000 7f1d0620f700 1 --2- 172.21.15.133:0/2314528705 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d000acb60 0x7f1d0013eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.631+0000 7f1d0620f700 1 -- 172.21.15.133:0/2314528705 >> 172.21.15.133:0/2314528705 conn(0x7f1d00066f90 msgr2=0x7f1d00070830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:20.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.635+0000 7f1d0620f700 1 -- 172.21.15.133:0/2314528705 shutdown_connections 2023-10-08T16:04:20.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.635+0000 7f1d0620f700 1 -- 172.21.15.133:0/2314528705 wait complete. 2023-10-08T16:04:20.638 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-10-08T16:04:20.652 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-08T16:04:18.837965+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2381428,"kb_used_data":2372,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593292,"statfs":{"total":773094113280,"available":770655531008,"internally_reserved":0,"allocated":2428928,"data_stored":1544105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001468"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":159,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-08T16:04:08.120181+0000","last_change":"2023-10-08T16:04:06.370834+0000","last_active":"2023-10-08T16:04:08.120181+0000","last_peered":"2023-10-08T16:04:08.120181+0000","last_clean":"2023-10-08T16:04:08.120181+0000","last_became_active":"2023-10-08T16:04:06.368022+0000","last_became_peered":"2023-10-08T16:04:06.368022+0000","last_unstale":"2023-10-08T16:04:08.120181+0000","last_undegraded":"2023-10-08T16:04:08.120181+0000","last_fullsized":"2023-10-08T16:04:08.120181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:05.034115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:05.034115+0000","last_clean_scrub_stamp":"2023-10-08T16:04:05.034115+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:37.338076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:16.621866+0000","last_change":"2023-10-08T16:04:16.621866+0000","last_active":"2023-10-08T16:04:16.621866+0000","last_peered":"2023-10-08T16:04:16.621866+0000","last_clean":"2023-10-08T16:04:16.621866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:16.621866+0000","last_undegraded":"2023-10-08T16:04:16.621866+0000","last_fullsized":"2023-10-08T16:04:16.621866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:04:15.610555+0000","last_change":"2023-10-08T16:04:15.610555+0000","last_active":"2023-10-08T16:04:15.610555+0000","last_peered":"2023-10-08T16:04:15.610555+0000","last_clean":"2023-10-08T16:04:15.610555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:04:15.610555+0000","last_undegraded":"2023-10-08T16:04:15.610555+0000","last_fullsized":"2023-10-08T16:04:15.610555+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298644,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073196,"statfs":{"total":96636764160,"available":96330952704,"internally_reserved":0,"allocated":749568,"data_stored":635903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3839999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.458}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":745472,"data_stored":634992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:04:20.657 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:04:20.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.759+0000 7ff5afade700 1 Processor -- start 2023-10-08T16:04:20.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.759+0000 7ff5afade700 1 -- start start 2023-10-08T16:04:20.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.763+0000 7ff5afade700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff5a80ac7a0 0x7ff5a813f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:20.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.763+0000 7ff5afade700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff5a813fb40 0x7ff5a813ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:20.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.763+0000 7ff5afade700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a8142a80 con 0x7ff5a8070a60 2023-10-08T16:04:20.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.763+0000 7ff5afade700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a81404b0 con 0x7ff5a813fb40 2023-10-08T16:04:20.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.763+0000 7ff5afade700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a8143620 con 0x7ff5a80ac7a0 2023-10-08T16:04:20.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.763+0000 7ff5ae07b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff5a813fb40 0x7ff5a813ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:20.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.763+0000 7ff5ae07b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff5a813fb40 0x7ff5a813ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42650/0 (socket says 172.21.15.133:42650) 2023-10-08T16:04:20.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.763+0000 7ff5ae07b700 1 -- 172.21.15.133:0/4194306437 learned_addr learned my addr 172.21.15.133:0/4194306437 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:20.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.763+0000 7ff5ad079700 1 --2- 172.21.15.133:0/4194306437 >> v2:172.21.15.190:3300/0 conn(0x7ff5a80ac7a0 0x7ff5a813f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:20.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.763+0000 7ff5ae07b700 1 -- 172.21.15.133:0/4194306437 >> v2:172.21.15.190:3300/0 conn(0x7ff5a80ac7a0 msgr2=0x7ff5a813f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:20.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.763+0000 7ff5ae07b700 1 --2- 172.21.15.133:0/4194306437 >> v2:172.21.15.190:3300/0 conn(0x7ff5a80ac7a0 0x7ff5a813f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.763+0000 7ff5ae07b700 1 -- 172.21.15.133:0/4194306437 >> v1:172.21.15.190:6789/0 conn(0x7ff5a8070a60 legacy=0x7ff5a8142f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:20.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.763+0000 7ff5ae07b700 1 -- 172.21.15.133:0/4194306437 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a8142730 con 0x7ff5a813fb40 2023-10-08T16:04:20.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.763+0000 7ff5ae07b700 1 --2- 172.21.15.133:0/4194306437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5a813fb40 0x7ff5a813ff70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff5a806b710 tx=0x7ff5a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=206fe5e9a2ff9691 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:20.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.763+0000 7ff5ac878700 1 -- 172.21.15.133:0/4194306437 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a000e070 con 0x7ff5a813fb40 2023-10-08T16:04:20.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.763+0000 7ff5ac878700 1 -- 172.21.15.133:0/4194306437 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a000ba50 con 0x7ff5a813fb40 2023-10-08T16:04:20.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.763+0000 7ff5ac878700 1 -- 172.21.15.133:0/4194306437 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a00092e0 con 0x7ff5a813fb40 2023-10-08T16:04:20.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.763+0000 7ff5afade700 1 -- 172.21.15.133:0/4194306437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5a813fb40 msgr2=0x7ff5a813ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:20.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.763+0000 7ff5afade700 1 --2- 172.21.15.133:0/4194306437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5a813fb40 0x7ff5a813ff70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff5a806b710 tx=0x7ff5a0009840 comp rx=0 tx=0).stop 2023-10-08T16:04:20.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.763+0000 7ff5afade700 1 -- 172.21.15.133:0/4194306437 shutdown_connections 2023-10-08T16:04:20.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.763+0000 7ff5afade700 1 --2- 172.21.15.133:0/4194306437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5a813fb40 0x7ff5a813ff70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.763+0000 7ff5afade700 1 --2- 172.21.15.133:0/4194306437 >> v2:172.21.15.190:3300/0 conn(0x7ff5a80ac7a0 0x7ff5a813f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.763+0000 7ff5afade700 1 -- 172.21.15.133:0/4194306437 >> 172.21.15.133:0/4194306437 conn(0x7ff5a8067a20 msgr2=0x7ff5a80b53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:20.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.763+0000 7ff5afade700 1 -- 172.21.15.133:0/4194306437 shutdown_connections 2023-10-08T16:04:20.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.763+0000 7ff5afade700 1 -- 172.21.15.133:0/4194306437 wait complete. 2023-10-08T16:04:20.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.763+0000 7ff5afade700 1 Processor -- start 2023-10-08T16:04:20.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.767+0000 7ff5afade700 1 -- start start 2023-10-08T16:04:20.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.767+0000 7ff5afade700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5a8070a60 0x7ff5a806bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:20.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.767+0000 7ff5afade700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5a80ac7a0 0x7ff5a80a6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:20.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.767+0000 7ff5afade700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5a813fb40 0x7ff5a81550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:20.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.767+0000 7ff5afade700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a806c820 con 0x7ff5a813fb40 2023-10-08T16:04:20.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.767+0000 7ff5afade700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a80a6d90 con 0x7ff5a80ac7a0 2023-10-08T16:04:20.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.767+0000 7ff5afade700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a80ab570 con 0x7ff5a8070a60 2023-10-08T16:04:20.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.767+0000 7ff5ae07b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5a813fb40 0x7ff5a81550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:20.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.767+0000 7ff5ae07b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5a813fb40 0x7ff5a81550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42652/0 (socket says 172.21.15.133:42652) 2023-10-08T16:04:20.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.767+0000 7ff5ae07b700 1 -- 172.21.15.133:0/3632824110 learned_addr learned my addr 172.21.15.133:0/3632824110 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:20.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.767+0000 7ff5ad079700 1 --2- 172.21.15.133:0/3632824110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5a80ac7a0 0x7ff5a80a6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:20.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.767+0000 7ff5ad87a700 1 --2- 172.21.15.133:0/3632824110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5a8070a60 0x7ff5a806bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:20.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.767+0000 7ff5ae07b700 1 -- 172.21.15.133:0/3632824110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5a8070a60 msgr2=0x7ff5a806bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:20.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.767+0000 7ff5ae07b700 1 --2- 172.21.15.133:0/3632824110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5a8070a60 0x7ff5a806bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.767+0000 7ff5ae07b700 1 -- 172.21.15.133:0/3632824110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5a80ac7a0 msgr2=0x7ff5a80a6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:20.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.767+0000 7ff5ae07b700 1 --2- 172.21.15.133:0/3632824110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5a80ac7a0 0x7ff5a80a6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.767+0000 7ff5ae07b700 1 -- 172.21.15.133:0/3632824110 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a0009ae0 con 0x7ff5a813fb40 2023-10-08T16:04:20.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.767+0000 7ff5ad079700 1 --2- 172.21.15.133:0/3632824110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5a80ac7a0 0x7ff5a80a6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:20.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.767+0000 7ff5ad87a700 1 --2- 172.21.15.133:0/3632824110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5a8070a60 0x7ff5a806bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:20.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.767+0000 7ff5ae07b700 1 --2- 172.21.15.133:0/3632824110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5a813fb40 0x7ff5a81550a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0009430 tx=0x7ff5a0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:20.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.767+0000 7ff59dffb700 1 -- 172.21.15.133:0/3632824110 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0008e70 con 0x7ff5a813fb40 2023-10-08T16:04:20.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.767+0000 7ff59dffb700 1 -- 172.21.15.133:0/3632824110 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a000be60 con 0x7ff5a813fb40 2023-10-08T16:04:20.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.767+0000 7ff5afade700 1 -- 172.21.15.133:0/3632824110 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a80aaf60 con 0x7ff5a813fb40 2023-10-08T16:04:20.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.767+0000 7ff59dffb700 1 -- 172.21.15.133:0/3632824110 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a00266d0 con 0x7ff5a813fb40 2023-10-08T16:04:20.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.767+0000 7ff5afade700 1 -- 172.21.15.133:0/3632824110 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a81555e0 con 0x7ff5a813fb40 2023-10-08T16:04:20.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.767+0000 7ff5afade700 1 -- 172.21.15.133:0/3632824110 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a80ab720 con 0x7ff5a813fb40 2023-10-08T16:04:20.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.771+0000 7ff59dffb700 1 -- 172.21.15.133:0/3632824110 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff5a0003040 con 0x7ff5a813fb40 2023-10-08T16:04:20.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.771+0000 7ff59dffb700 1 --2- 172.21.15.133:0/3632824110 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff58c060550 0x7ff58c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:20.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.771+0000 7ff59dffb700 1 -- 172.21.15.133:0/3632824110 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff5a007e7c0 con 0x7ff5a813fb40 2023-10-08T16:04:20.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.771+0000 7ff5ad87a700 1 --2- 172.21.15.133:0/3632824110 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff58c060550 0x7ff58c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:20.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.771+0000 7ff5ad87a700 1 --2- 172.21.15.133:0/3632824110 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff58c060550 0x7ff58c062a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4007fd0 tx=0x7ff5a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:20.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.779+0000 7ff59dffb700 1 -- 172.21.15.133:0/3632824110 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff5a80ab720 con 0x7ff5a813fb40 2023-10-08T16:04:20.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.935+0000 7ff5afade700 1 -- 172.21.15.133:0/3632824110 --> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5a80ab720 con 0x7ff58c060550 2023-10-08T16:04:20.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.951+0000 7ff59dffb700 1 -- 172.21.15.133:0/3632824110 <== mgr.4104 v2:172.21.15.133:6832/33362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264487 (secure 0 0 0) 0x7ff5a80ab720 con 0x7ff58c060550 2023-10-08T16:04:20.957 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:04:20.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.959+0000 7ff5afade700 1 -- 172.21.15.133:0/3632824110 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff58c060550 msgr2=0x7ff58c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:20.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.959+0000 7ff5afade700 1 --2- 172.21.15.133:0/3632824110 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff58c060550 0x7ff58c062a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4007fd0 tx=0x7ff5a4009040 comp rx=0 tx=0).stop 2023-10-08T16:04:20.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.959+0000 7ff5afade700 1 -- 172.21.15.133:0/3632824110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5a813fb40 msgr2=0x7ff5a81550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:20.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.959+0000 7ff5afade700 1 --2- 172.21.15.133:0/3632824110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5a813fb40 0x7ff5a81550a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0009430 tx=0x7ff5a0018000 comp rx=0 tx=0).stop 2023-10-08T16:04:20.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.959+0000 7ff5afade700 1 -- 172.21.15.133:0/3632824110 shutdown_connections 2023-10-08T16:04:20.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.959+0000 7ff5afade700 1 --2- 172.21.15.133:0/3632824110 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff58c060550 0x7ff58c062a00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.959+0000 7ff5afade700 1 --2- 172.21.15.133:0/3632824110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5a813fb40 0x7ff5a81550a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.959+0000 7ff5afade700 1 --2- 172.21.15.133:0/3632824110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5a80ac7a0 0x7ff5a80a6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.959+0000 7ff5afade700 1 --2- 172.21.15.133:0/3632824110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5a8070a60 0x7ff5a806bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:20.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.959+0000 7ff5afade700 1 -- 172.21.15.133:0/3632824110 >> 172.21.15.133:0/3632824110 conn(0x7ff5a8067a20 msgr2=0x7ff5a8142e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:20.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.959+0000 7ff5afade700 1 -- 172.21.15.133:0/3632824110 shutdown_connections 2023-10-08T16:04:20.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:20.959+0000 7ff5afade700 1 -- 172.21.15.133:0/3632824110 wait complete. 2023-10-08T16:04:20.964 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-10-08T16:04:20.977 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-08T16:04:20.838532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381124,"kb_used_data":2820,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593596,"statfs":{"total":773094113280,"available":770655842304,"internally_reserved":0,"allocated":2887680,"data_stored":1749669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.216332"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.632077+0000","last_change":"2023-10-08T16:04:17.626888+0000","last_active":"2023-10-08T16:04:17.632077+0000","last_peered":"2023-10-08T16:04:17.632077+0000","last_clean":"2023-10-08T16:04:17.632077+0000","last_became_active":"2023-10-08T16:04:17.626468+0000","last_became_peered":"2023-10-08T16:04:17.626468+0000","last_unstale":"2023-10-08T16:04:17.632077+0000","last_undegraded":"2023-10-08T16:04:17.632077+0000","last_fullsized":"2023-10-08T16:04:17.632077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:37.040973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.627185+0000","last_change":"2023-10-08T16:04:17.624301+0000","last_active":"2023-10-08T16:04:17.627185+0000","last_peered":"2023-10-08T16:04:17.627185+0000","last_clean":"2023-10-08T16:04:17.627185+0000","last_became_active":"2023-10-08T16:04:17.623968+0000","last_became_peered":"2023-10-08T16:04:17.623968+0000","last_unstale":"2023-10-08T16:04:17.627185+0000","last_undegraded":"2023-10-08T16:04:17.627185+0000","last_fullsized":"2023-10-08T16:04:17.627185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635485+0000","last_change":"2023-10-08T16:04:17.624529+0000","last_active":"2023-10-08T16:04:17.635485+0000","last_peered":"2023-10-08T16:04:17.635485+0000","last_clean":"2023-10-08T16:04:17.635485+0000","last_became_active":"2023-10-08T16:04:17.624219+0000","last_became_peered":"2023-10-08T16:04:17.624219+0000","last_unstale":"2023-10-08T16:04:17.635485+0000","last_undegraded":"2023-10-08T16:04:17.635485+0000","last_fullsized":"2023-10-08T16:04:17.635485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:07.785877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.636047+0000","last_change":"2023-10-08T16:04:17.628602+0000","last_active":"2023-10-08T16:04:17.636047+0000","last_peered":"2023-10-08T16:04:17.636047+0000","last_clean":"2023-10-08T16:04:17.636047+0000","last_became_active":"2023-10-08T16:04:17.628308+0000","last_became_peered":"2023-10-08T16:04:17.628308+0000","last_unstale":"2023-10-08T16:04:17.636047+0000","last_undegraded":"2023-10-08T16:04:17.636047+0000","last_fullsized":"2023-10-08T16:04:17.636047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:48.519448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.628109+0000","last_change":"2023-10-08T16:04:17.626035+0000","last_active":"2023-10-08T16:04:17.628109+0000","last_peered":"2023-10-08T16:04:17.628109+0000","last_clean":"2023-10-08T16:04:17.628109+0000","last_became_active":"2023-10-08T16:04:17.625650+0000","last_became_peered":"2023-10-08T16:04:17.625650+0000","last_unstale":"2023-10-08T16:04:17.628109+0000","last_undegraded":"2023-10-08T16:04:17.628109+0000","last_fullsized":"2023-10-08T16:04:17.628109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:42.972904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.632991+0000","last_change":"2023-10-08T16:04:17.619829+0000","last_active":"2023-10-08T16:04:17.632991+0000","last_peered":"2023-10-08T16:04:17.632991+0000","last_clean":"2023-10-08T16:04:17.632991+0000","last_became_active":"2023-10-08T16:04:17.619494+0000","last_became_peered":"2023-10-08T16:04:17.619494+0000","last_unstale":"2023-10-08T16:04:17.632991+0000","last_undegraded":"2023-10-08T16:04:17.632991+0000","last_fullsized":"2023-10-08T16:04:17.632991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:02:45.593266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635803+0000","last_change":"2023-10-08T16:04:17.632040+0000","last_active":"2023-10-08T16:04:17.635803+0000","last_peered":"2023-10-08T16:04:17.635803+0000","last_clean":"2023-10-08T16:04:17.635803+0000","last_became_active":"2023-10-08T16:04:17.631722+0000","last_became_peered":"2023-10-08T16:04:17.631722+0000","last_unstale":"2023-10-08T16:04:17.635803+0000","last_undegraded":"2023-10-08T16:04:17.635803+0000","last_fullsized":"2023-10-08T16:04:17.635803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:52.670934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.634619+0000","last_change":"2023-10-08T16:04:17.629400+0000","last_active":"2023-10-08T16:04:17.634619+0000","last_peered":"2023-10-08T16:04:17.634619+0000","last_clean":"2023-10-08T16:04:17.634619+0000","last_became_active":"2023-10-08T16:04:17.628987+0000","last_became_peered":"2023-10-08T16:04:17.628987+0000","last_unstale":"2023-10-08T16:04:17.634619+0000","last_undegraded":"2023-10-08T16:04:17.634619+0000","last_fullsized":"2023-10-08T16:04:17.634619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:26.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.638924+0000","last_change":"2023-10-08T16:04:17.636654+0000","last_active":"2023-10-08T16:04:17.638924+0000","last_peered":"2023-10-08T16:04:17.638924+0000","last_clean":"2023-10-08T16:04:17.638924+0000","last_became_active":"2023-10-08T16:04:17.636350+0000","last_became_peered":"2023-10-08T16:04:17.636350+0000","last_unstale":"2023-10-08T16:04:17.638924+0000","last_undegraded":"2023-10-08T16:04:17.638924+0000","last_fullsized":"2023-10-08T16:04:17.638924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:38:37.066127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633210+0000","last_change":"2023-10-08T16:04:17.627620+0000","last_active":"2023-10-08T16:04:17.633210+0000","last_peered":"2023-10-08T16:04:17.633210+0000","last_clean":"2023-10-08T16:04:17.633210+0000","last_became_active":"2023-10-08T16:04:17.627074+0000","last_became_peered":"2023-10-08T16:04:17.627074+0000","last_unstale":"2023-10-08T16:04:17.633210+0000","last_undegraded":"2023-10-08T16:04:17.633210+0000","last_fullsized":"2023-10-08T16:04:17.633210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:15.965581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633228+0000","last_change":"2023-10-08T16:04:17.628765+0000","last_active":"2023-10-08T16:04:17.633228+0000","last_peered":"2023-10-08T16:04:17.633228+0000","last_clean":"2023-10-08T16:04:17.633228+0000","last_became_active":"2023-10-08T16:04:17.627965+0000","last_became_peered":"2023-10-08T16:04:17.627965+0000","last_unstale":"2023-10-08T16:04:17.633228+0000","last_undegraded":"2023-10-08T16:04:17.633228+0000","last_fullsized":"2023-10-08T16:04:17.633228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.628520+0000","last_change":"2023-10-08T16:04:17.617433+0000","last_active":"2023-10-08T16:04:17.628520+0000","last_peered":"2023-10-08T16:04:17.628520+0000","last_clean":"2023-10-08T16:04:17.628520+0000","last_became_active":"2023-10-08T16:04:17.616988+0000","last_became_peered":"2023-10-08T16:04:17.616988+0000","last_unstale":"2023-10-08T16:04:17.628520+0000","last_undegraded":"2023-10-08T16:04:17.628520+0000","last_fullsized":"2023-10-08T16:04:17.628520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:49.607853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.630551+0000","last_change":"2023-10-08T16:04:17.625824+0000","last_active":"2023-10-08T16:04:17.630551+0000","last_peered":"2023-10-08T16:04:17.630551+0000","last_clean":"2023-10-08T16:04:17.630551+0000","last_became_active":"2023-10-08T16:04:17.625529+0000","last_became_peered":"2023-10-08T16:04:17.625529+0000","last_unstale":"2023-10-08T16:04:17.630551+0000","last_undegraded":"2023-10-08T16:04:17.630551+0000","last_fullsized":"2023-10-08T16:04:17.630551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:07.051965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635548+0000","last_change":"2023-10-08T16:04:17.624728+0000","last_active":"2023-10-08T16:04:17.635548+0000","last_peered":"2023-10-08T16:04:17.635548+0000","last_clean":"2023-10-08T16:04:17.635548+0000","last_became_active":"2023-10-08T16:04:17.624197+0000","last_became_peered":"2023-10-08T16:04:17.624197+0000","last_unstale":"2023-10-08T16:04:17.635548+0000","last_undegraded":"2023-10-08T16:04:17.635548+0000","last_fullsized":"2023-10-08T16:04:17.635548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:08.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.625903+0000","last_change":"2023-10-08T16:04:17.621076+0000","last_active":"2023-10-08T16:04:17.625903+0000","last_peered":"2023-10-08T16:04:17.625903+0000","last_clean":"2023-10-08T16:04:17.625903+0000","last_became_active":"2023-10-08T16:04:17.620391+0000","last_became_peered":"2023-10-08T16:04:17.620391+0000","last_unstale":"2023-10-08T16:04:17.625903+0000","last_undegraded":"2023-10-08T16:04:17.625903+0000","last_fullsized":"2023-10-08T16:04:17.625903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:08.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633034+0000","last_change":"2023-10-08T16:04:17.620158+0000","last_active":"2023-10-08T16:04:17.633034+0000","last_peered":"2023-10-08T16:04:17.633034+0000","last_clean":"2023-10-08T16:04:17.633034+0000","last_became_active":"2023-10-08T16:04:17.619843+0000","last_became_peered":"2023-10-08T16:04:17.619843+0000","last_unstale":"2023-10-08T16:04:17.633034+0000","last_undegraded":"2023-10-08T16:04:17.633034+0000","last_fullsized":"2023-10-08T16:04:17.633034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.599406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633425+0000","last_change":"2023-10-08T16:04:17.625859+0000","last_active":"2023-10-08T16:04:17.633425+0000","last_peered":"2023-10-08T16:04:17.633425+0000","last_clean":"2023-10-08T16:04:17.633425+0000","last_became_active":"2023-10-08T16:04:17.625580+0000","last_became_peered":"2023-10-08T16:04:17.625580+0000","last_unstale":"2023-10-08T16:04:17.633425+0000","last_undegraded":"2023-10-08T16:04:17.633425+0000","last_fullsized":"2023-10-08T16:04:17.633425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:46.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635366+0000","last_change":"2023-10-08T16:04:17.627483+0000","last_active":"2023-10-08T16:04:17.635366+0000","last_peered":"2023-10-08T16:04:17.635366+0000","last_clean":"2023-10-08T16:04:17.635366+0000","last_became_active":"2023-10-08T16:04:17.627197+0000","last_became_peered":"2023-10-08T16:04:17.627197+0000","last_unstale":"2023-10-08T16:04:17.635366+0000","last_undegraded":"2023-10-08T16:04:17.635366+0000","last_fullsized":"2023-10-08T16:04:17.635366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:09.387194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.628134+0000","last_change":"2023-10-08T16:04:17.625900+0000","last_active":"2023-10-08T16:04:17.628134+0000","last_peered":"2023-10-08T16:04:17.628134+0000","last_clean":"2023-10-08T16:04:17.628134+0000","last_became_active":"2023-10-08T16:04:17.625586+0000","last_became_peered":"2023-10-08T16:04:17.625586+0000","last_unstale":"2023-10-08T16:04:17.628134+0000","last_undegraded":"2023-10-08T16:04:17.628134+0000","last_fullsized":"2023-10-08T16:04:17.628134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.599406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.628567+0000","last_change":"2023-10-08T16:04:17.623493+0000","last_active":"2023-10-08T16:04:17.628567+0000","last_peered":"2023-10-08T16:04:17.628567+0000","last_clean":"2023-10-08T16:04:17.628567+0000","last_became_active":"2023-10-08T16:04:17.623200+0000","last_became_peered":"2023-10-08T16:04:17.623200+0000","last_unstale":"2023-10-08T16:04:17.628567+0000","last_undegraded":"2023-10-08T16:04:17.628567+0000","last_fullsized":"2023-10-08T16:04:17.628567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:36.869466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635670+0000","last_change":"2023-10-08T16:04:17.625908+0000","last_active":"2023-10-08T16:04:17.635670+0000","last_peered":"2023-10-08T16:04:17.635670+0000","last_clean":"2023-10-08T16:04:17.635670+0000","last_became_active":"2023-10-08T16:04:17.623945+0000","last_became_peered":"2023-10-08T16:04:17.623945+0000","last_unstale":"2023-10-08T16:04:17.635670+0000","last_undegraded":"2023-10-08T16:04:17.635670+0000","last_fullsized":"2023-10-08T16:04:17.635670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:15.965581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633364+0000","last_change":"2023-10-08T16:04:17.624219+0000","last_active":"2023-10-08T16:04:17.633364+0000","last_peered":"2023-10-08T16:04:17.633364+0000","last_clean":"2023-10-08T16:04:17.633364+0000","last_became_active":"2023-10-08T16:04:17.623904+0000","last_became_peered":"2023-10-08T16:04:17.623904+0000","last_unstale":"2023-10-08T16:04:17.633364+0000","last_undegraded":"2023-10-08T16:04:17.633364+0000","last_fullsized":"2023-10-08T16:04:17.633364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:52.670934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.629217+0000","last_change":"2023-10-08T16:04:17.618857+0000","last_active":"2023-10-08T16:04:17.629217+0000","last_peered":"2023-10-08T16:04:17.629217+0000","last_clean":"2023-10-08T16:04:17.629217+0000","last_became_active":"2023-10-08T16:04:17.618549+0000","last_became_peered":"2023-10-08T16:04:17.618549+0000","last_unstale":"2023-10-08T16:04:17.629217+0000","last_undegraded":"2023-10-08T16:04:17.629217+0000","last_fullsized":"2023-10-08T16:04:17.629217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635992+0000","last_change":"2023-10-08T16:04:17.627955+0000","last_active":"2023-10-08T16:04:17.635992+0000","last_peered":"2023-10-08T16:04:17.635992+0000","last_clean":"2023-10-08T16:04:17.635992+0000","last_became_active":"2023-10-08T16:04:17.627673+0000","last_became_peered":"2023-10-08T16:04:17.627673+0000","last_unstale":"2023-10-08T16:04:17.635992+0000","last_undegraded":"2023-10-08T16:04:17.635992+0000","last_fullsized":"2023-10-08T16:04:17.635992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:26.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.634578+0000","last_change":"2023-10-08T16:04:17.629101+0000","last_active":"2023-10-08T16:04:17.634578+0000","last_peered":"2023-10-08T16:04:17.634578+0000","last_clean":"2023-10-08T16:04:17.634578+0000","last_became_active":"2023-10-08T16:04:17.628793+0000","last_became_peered":"2023-10-08T16:04:17.628793+0000","last_unstale":"2023-10-08T16:04:17.634578+0000","last_undegraded":"2023-10-08T16:04:17.634578+0000","last_fullsized":"2023-10-08T16:04:17.634578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:15.965581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633189+0000","last_change":"2023-10-08T16:04:17.625790+0000","last_active":"2023-10-08T16:04:17.633189+0000","last_peered":"2023-10-08T16:04:17.633189+0000","last_clean":"2023-10-08T16:04:17.633189+0000","last_became_active":"2023-10-08T16:04:17.625220+0000","last_became_peered":"2023-10-08T16:04:17.625220+0000","last_unstale":"2023-10-08T16:04:17.633189+0000","last_undegraded":"2023-10-08T16:04:17.633189+0000","last_fullsized":"2023-10-08T16:04:17.633189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:08.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.634632+0000","last_change":"2023-10-08T16:04:17.629988+0000","last_active":"2023-10-08T16:04:17.634632+0000","last_peered":"2023-10-08T16:04:17.634632+0000","last_clean":"2023-10-08T16:04:17.634632+0000","last_became_active":"2023-10-08T16:04:17.629574+0000","last_became_peered":"2023-10-08T16:04:17.629574+0000","last_unstale":"2023-10-08T16:04:17.634632+0000","last_undegraded":"2023-10-08T16:04:17.634632+0000","last_fullsized":"2023-10-08T16:04:17.634632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:26.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.631112+0000","last_change":"2023-10-08T16:04:17.626698+0000","last_active":"2023-10-08T16:04:17.631112+0000","last_peered":"2023-10-08T16:04:17.631112+0000","last_clean":"2023-10-08T16:04:17.631112+0000","last_became_active":"2023-10-08T16:04:17.626420+0000","last_became_peered":"2023-10-08T16:04:17.626420+0000","last_unstale":"2023-10-08T16:04:17.631112+0000","last_undegraded":"2023-10-08T16:04:17.631112+0000","last_fullsized":"2023-10-08T16:04:17.631112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.625706+0000","last_change":"2023-10-08T16:04:17.618551+0000","last_active":"2023-10-08T16:04:17.625706+0000","last_peered":"2023-10-08T16:04:17.625706+0000","last_clean":"2023-10-08T16:04:17.625706+0000","last_became_active":"2023-10-08T16:04:17.618207+0000","last_became_peered":"2023-10-08T16:04:17.618207+0000","last_unstale":"2023-10-08T16:04:17.625706+0000","last_undegraded":"2023-10-08T16:04:17.625706+0000","last_fullsized":"2023-10-08T16:04:17.625706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:16:31.009207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.636007+0000","last_change":"2023-10-08T16:04:17.627381+0000","last_active":"2023-10-08T16:04:17.636007+0000","last_peered":"2023-10-08T16:04:17.636007+0000","last_clean":"2023-10-08T16:04:17.636007+0000","last_became_active":"2023-10-08T16:04:17.627093+0000","last_became_peered":"2023-10-08T16:04:17.627093+0000","last_unstale":"2023-10-08T16:04:17.636007+0000","last_undegraded":"2023-10-08T16:04:17.636007+0000","last_fullsized":"2023-10-08T16:04:17.636007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:45.664795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635627+0000","last_change":"2023-10-08T16:04:17.629351+0000","last_active":"2023-10-08T16:04:17.635627+0000","last_peered":"2023-10-08T16:04:17.635627+0000","last_clean":"2023-10-08T16:04:17.635627+0000","last_became_active":"2023-10-08T16:04:17.629049+0000","last_became_peered":"2023-10-08T16:04:17.629049+0000","last_unstale":"2023-10-08T16:04:17.635627+0000","last_undegraded":"2023-10-08T16:04:17.635627+0000","last_fullsized":"2023-10-08T16:04:17.635627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:07.785877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635822+0000","last_change":"2023-10-08T16:04:17.632342+0000","last_active":"2023-10-08T16:04:17.635822+0000","last_peered":"2023-10-08T16:04:17.635822+0000","last_clean":"2023-10-08T16:04:17.635822+0000","last_became_active":"2023-10-08T16:04:17.632012+0000","last_became_peered":"2023-10-08T16:04:17.632012+0000","last_unstale":"2023-10-08T16:04:17.635822+0000","last_undegraded":"2023-10-08T16:04:17.635822+0000","last_fullsized":"2023-10-08T16:04:17.635822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633065+0000","last_change":"2023-10-08T16:04:17.623570+0000","last_active":"2023-10-08T16:04:17.633065+0000","last_peered":"2023-10-08T16:04:17.633065+0000","last_clean":"2023-10-08T16:04:17.633065+0000","last_became_active":"2023-10-08T16:04:17.623220+0000","last_became_peered":"2023-10-08T16:04:17.623220+0000","last_unstale":"2023-10-08T16:04:17.633065+0000","last_undegraded":"2023-10-08T16:04:17.633065+0000","last_fullsized":"2023-10-08T16:04:17.633065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:07.785877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.654725+0000","last_change":"2023-10-08T16:04:16.660492+0000","last_active":"2023-10-08T16:04:17.654725+0000","last_peered":"2023-10-08T16:04:17.654725+0000","last_clean":"2023-10-08T16:04:17.654725+0000","last_became_active":"2023-10-08T16:04:16.660183+0000","last_became_peered":"2023-10-08T16:04:16.660183+0000","last_unstale":"2023-10-08T16:04:17.654725+0000","last_undegraded":"2023-10-08T16:04:17.654725+0000","last_fullsized":"2023-10-08T16:04:17.654725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:08.532886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.632702+0000","last_change":"2023-10-08T16:04:17.621094+0000","last_active":"2023-10-08T16:04:17.632702+0000","last_peered":"2023-10-08T16:04:17.632702+0000","last_clean":"2023-10-08T16:04:17.632702+0000","last_became_active":"2023-10-08T16:04:17.620532+0000","last_became_peered":"2023-10-08T16:04:17.620532+0000","last_unstale":"2023-10-08T16:04:17.632702+0000","last_undegraded":"2023-10-08T16:04:17.632702+0000","last_fullsized":"2023-10-08T16:04:17.632702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:48:25.093009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.652629+0000","last_change":"2023-10-08T16:04:16.654209+0000","last_active":"2023-10-08T16:04:17.652629+0000","last_peered":"2023-10-08T16:04:17.652629+0000","last_clean":"2023-10-08T16:04:17.652629+0000","last_became_active":"2023-10-08T16:04:16.653936+0000","last_became_peered":"2023-10-08T16:04:16.653936+0000","last_unstale":"2023-10-08T16:04:17.652629+0000","last_undegraded":"2023-10-08T16:04:17.652629+0000","last_fullsized":"2023-10-08T16:04:17.652629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:39:19.429906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.617151+0000","last_change":"2023-10-08T16:04:16.656953+0000","last_active":"2023-10-08T16:04:17.617151+0000","last_peered":"2023-10-08T16:04:17.617151+0000","last_clean":"2023-10-08T16:04:17.617151+0000","last_became_active":"2023-10-08T16:04:16.656642+0000","last_became_peered":"2023-10-08T16:04:16.656642+0000","last_unstale":"2023-10-08T16:04:17.617151+0000","last_undegraded":"2023-10-08T16:04:17.617151+0000","last_fullsized":"2023-10-08T16:04:17.617151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:04.157234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.631064+0000","last_change":"2023-10-08T16:04:17.625387+0000","last_active":"2023-10-08T16:04:17.631064+0000","last_peered":"2023-10-08T16:04:17.631064+0000","last_clean":"2023-10-08T16:04:17.631064+0000","last_became_active":"2023-10-08T16:04:17.625086+0000","last_became_peered":"2023-10-08T16:04:17.625086+0000","last_unstale":"2023-10-08T16:04:17.631064+0000","last_undegraded":"2023-10-08T16:04:17.631064+0000","last_fullsized":"2023-10-08T16:04:17.631064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:08.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.610846+0000","last_change":"2023-10-08T16:04:16.651645+0000","last_active":"2023-10-08T16:04:17.610846+0000","last_peered":"2023-10-08T16:04:17.610846+0000","last_clean":"2023-10-08T16:04:17.610846+0000","last_became_active":"2023-10-08T16:04:16.651258+0000","last_became_peered":"2023-10-08T16:04:16.651258+0000","last_unstale":"2023-10-08T16:04:17.610846+0000","last_undegraded":"2023-10-08T16:04:17.610846+0000","last_fullsized":"2023-10-08T16:04:17.610846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:48.596542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.634676+0000","last_change":"2023-10-08T16:04:17.630066+0000","last_active":"2023-10-08T16:04:17.634676+0000","last_peered":"2023-10-08T16:04:17.634676+0000","last_clean":"2023-10-08T16:04:17.634676+0000","last_became_active":"2023-10-08T16:04:17.629765+0000","last_became_peered":"2023-10-08T16:04:17.629765+0000","last_unstale":"2023-10-08T16:04:17.634676+0000","last_undegraded":"2023-10-08T16:04:17.634676+0000","last_fullsized":"2023-10-08T16:04:17.634676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.617478+0000","last_change":"2023-10-08T16:04:16.655712+0000","last_active":"2023-10-08T16:04:17.617478+0000","last_peered":"2023-10-08T16:04:17.617478+0000","last_clean":"2023-10-08T16:04:17.617478+0000","last_became_active":"2023-10-08T16:04:16.654002+0000","last_became_peered":"2023-10-08T16:04:16.654002+0000","last_unstale":"2023-10-08T16:04:17.617478+0000","last_undegraded":"2023-10-08T16:04:17.617478+0000","last_fullsized":"2023-10-08T16:04:17.617478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633381+0000","last_change":"2023-10-08T16:04:17.624387+0000","last_active":"2023-10-08T16:04:17.633381+0000","last_peered":"2023-10-08T16:04:17.633381+0000","last_clean":"2023-10-08T16:04:17.633381+0000","last_became_active":"2023-10-08T16:04:17.624071+0000","last_became_peered":"2023-10-08T16:04:17.624071+0000","last_unstale":"2023-10-08T16:04:17.633381+0000","last_undegraded":"2023-10-08T16:04:17.633381+0000","last_fullsized":"2023-10-08T16:04:17.633381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:42.972904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.612317+0000","last_change":"2023-10-08T16:04:16.657245+0000","last_active":"2023-10-08T16:04:17.612317+0000","last_peered":"2023-10-08T16:04:17.612317+0000","last_clean":"2023-10-08T16:04:17.612317+0000","last_became_active":"2023-10-08T16:04:16.656992+0000","last_became_peered":"2023-10-08T16:04:16.656992+0000","last_unstale":"2023-10-08T16:04:17.612317+0000","last_undegraded":"2023-10-08T16:04:17.612317+0000","last_fullsized":"2023-10-08T16:04:17.612317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.632890+0000","last_change":"2023-10-08T16:04:17.622197+0000","last_active":"2023-10-08T16:04:17.632890+0000","last_peered":"2023-10-08T16:04:17.632890+0000","last_clean":"2023-10-08T16:04:17.632890+0000","last_became_active":"2023-10-08T16:04:17.621862+0000","last_became_peered":"2023-10-08T16:04:17.621862+0000","last_unstale":"2023-10-08T16:04:17.632890+0000","last_undegraded":"2023-10-08T16:04:17.632890+0000","last_fullsized":"2023-10-08T16:04:17.632890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:36.869466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.662519+0000","last_change":"2023-10-08T16:04:16.656378+0000","last_active":"2023-10-08T16:04:17.662519+0000","last_peered":"2023-10-08T16:04:17.662519+0000","last_clean":"2023-10-08T16:04:17.662519+0000","last_became_active":"2023-10-08T16:04:16.656041+0000","last_became_peered":"2023-10-08T16:04:16.656041+0000","last_unstale":"2023-10-08T16:04:17.662519+0000","last_undegraded":"2023-10-08T16:04:17.662519+0000","last_fullsized":"2023-10-08T16:04:17.662519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:08.375883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.628540+0000","last_change":"2023-10-08T16:04:17.621021+0000","last_active":"2023-10-08T16:04:17.628540+0000","last_peered":"2023-10-08T16:04:17.628540+0000","last_clean":"2023-10-08T16:04:17.628540+0000","last_became_active":"2023-10-08T16:04:17.620654+0000","last_became_peered":"2023-10-08T16:04:17.620654+0000","last_unstale":"2023-10-08T16:04:17.628540+0000","last_undegraded":"2023-10-08T16:04:17.628540+0000","last_fullsized":"2023-10-08T16:04:17.628540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:09.387194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.661504+0000","last_change":"2023-10-08T16:04:16.653310+0000","last_active":"2023-10-08T16:04:17.661504+0000","last_peered":"2023-10-08T16:04:17.661504+0000","last_clean":"2023-10-08T16:04:17.661504+0000","last_became_active":"2023-10-08T16:04:16.653001+0000","last_became_peered":"2023-10-08T16:04:16.653001+0000","last_unstale":"2023-10-08T16:04:17.661504+0000","last_undegraded":"2023-10-08T16:04:17.661504+0000","last_fullsized":"2023-10-08T16:04:17.661504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:48.596542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633485+0000","last_change":"2023-10-08T16:04:17.631423+0000","last_active":"2023-10-08T16:04:17.633485+0000","last_peered":"2023-10-08T16:04:17.633485+0000","last_clean":"2023-10-08T16:04:17.633485+0000","last_became_active":"2023-10-08T16:04:17.631130+0000","last_became_peered":"2023-10-08T16:04:17.631130+0000","last_unstale":"2023-10-08T16:04:17.633485+0000","last_undegraded":"2023-10-08T16:04:17.633485+0000","last_fullsized":"2023-10-08T16:04:17.633485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:35.211718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.657652+0000","last_change":"2023-10-08T16:04:16.661085+0000","last_active":"2023-10-08T16:04:17.657652+0000","last_peered":"2023-10-08T16:04:17.657652+0000","last_clean":"2023-10-08T16:04:17.657652+0000","last_became_active":"2023-10-08T16:04:16.660830+0000","last_became_peered":"2023-10-08T16:04:16.660830+0000","last_unstale":"2023-10-08T16:04:17.657652+0000","last_undegraded":"2023-10-08T16:04:17.657652+0000","last_fullsized":"2023-10-08T16:04:17.657652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:18.465207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635520+0000","last_change":"2023-10-08T16:04:17.623375+0000","last_active":"2023-10-08T16:04:17.635520+0000","last_peered":"2023-10-08T16:04:17.635520+0000","last_clean":"2023-10-08T16:04:17.635520+0000","last_became_active":"2023-10-08T16:04:17.623038+0000","last_became_peered":"2023-10-08T16:04:17.623038+0000","last_unstale":"2023-10-08T16:04:17.635520+0000","last_undegraded":"2023-10-08T16:04:17.635520+0000","last_fullsized":"2023-10-08T16:04:17.635520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.610515+0000","last_change":"2023-10-08T16:04:16.650083+0000","last_active":"2023-10-08T16:04:17.610515+0000","last_peered":"2023-10-08T16:04:17.610515+0000","last_clean":"2023-10-08T16:04:17.610515+0000","last_became_active":"2023-10-08T16:04:16.649675+0000","last_became_peered":"2023-10-08T16:04:16.649675+0000","last_unstale":"2023-10-08T16:04:17.610515+0000","last_undegraded":"2023-10-08T16:04:17.610515+0000","last_fullsized":"2023-10-08T16:04:17.610515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:04.030037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633354+0000","last_change":"2023-10-08T16:04:17.630525+0000","last_active":"2023-10-08T16:04:17.633354+0000","last_peered":"2023-10-08T16:04:17.633354+0000","last_clean":"2023-10-08T16:04:17.633354+0000","last_became_active":"2023-10-08T16:04:17.628865+0000","last_became_peered":"2023-10-08T16:04:17.628865+0000","last_unstale":"2023-10-08T16:04:17.633354+0000","last_undegraded":"2023-10-08T16:04:17.633354+0000","last_fullsized":"2023-10-08T16:04:17.633354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:46.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.615069+0000","last_change":"2023-10-08T16:04:16.655486+0000","last_active":"2023-10-08T16:04:17.615069+0000","last_peered":"2023-10-08T16:04:17.615069+0000","last_clean":"2023-10-08T16:04:17.615069+0000","last_became_active":"2023-10-08T16:04:16.653342+0000","last_became_peered":"2023-10-08T16:04:16.653342+0000","last_unstale":"2023-10-08T16:04:17.615069+0000","last_undegraded":"2023-10-08T16:04:17.615069+0000","last_fullsized":"2023-10-08T16:04:17.615069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:04.157234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.628618+0000","last_change":"2023-10-08T16:04:17.624815+0000","last_active":"2023-10-08T16:04:17.628618+0000","last_peered":"2023-10-08T16:04:17.628618+0000","last_clean":"2023-10-08T16:04:17.628618+0000","last_became_active":"2023-10-08T16:04:17.624454+0000","last_became_peered":"2023-10-08T16:04:17.624454+0000","last_unstale":"2023-10-08T16:04:17.628618+0000","last_undegraded":"2023-10-08T16:04:17.628618+0000","last_fullsized":"2023-10-08T16:04:17.628618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.662991+0000","last_change":"2023-10-08T16:04:16.659433+0000","last_active":"2023-10-08T16:04:17.662991+0000","last_peered":"2023-10-08T16:04:17.662991+0000","last_clean":"2023-10-08T16:04:17.662991+0000","last_became_active":"2023-10-08T16:04:16.658886+0000","last_became_peered":"2023-10-08T16:04:16.658886+0000","last_unstale":"2023-10-08T16:04:17.662991+0000","last_undegraded":"2023-10-08T16:04:17.662991+0000","last_fullsized":"2023-10-08T16:04:17.662991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:08.532886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633401+0000","last_change":"2023-10-08T16:04:17.628917+0000","last_active":"2023-10-08T16:04:17.633401+0000","last_peered":"2023-10-08T16:04:17.633401+0000","last_clean":"2023-10-08T16:04:17.633401+0000","last_became_active":"2023-10-08T16:04:17.628605+0000","last_became_peered":"2023-10-08T16:04:17.628605+0000","last_unstale":"2023-10-08T16:04:17.633401+0000","last_undegraded":"2023-10-08T16:04:17.633401+0000","last_fullsized":"2023-10-08T16:04:17.633401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:02:45.593266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.655682+0000","last_change":"2023-10-08T16:04:16.660881+0000","last_active":"2023-10-08T16:04:17.655682+0000","last_peered":"2023-10-08T16:04:17.655682+0000","last_clean":"2023-10-08T16:04:17.655682+0000","last_became_active":"2023-10-08T16:04:16.660651+0000","last_became_peered":"2023-10-08T16:04:16.660651+0000","last_unstale":"2023-10-08T16:04:17.655682+0000","last_undegraded":"2023-10-08T16:04:17.655682+0000","last_fullsized":"2023-10-08T16:04:17.655682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:54.682083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633460+0000","last_change":"2023-10-08T16:04:17.629002+0000","last_active":"2023-10-08T16:04:17.633460+0000","last_peered":"2023-10-08T16:04:17.633460+0000","last_clean":"2023-10-08T16:04:17.633460+0000","last_became_active":"2023-10-08T16:04:17.628701+0000","last_became_peered":"2023-10-08T16:04:17.628701+0000","last_unstale":"2023-10-08T16:04:17.633460+0000","last_undegraded":"2023-10-08T16:04:17.633460+0000","last_fullsized":"2023-10-08T16:04:17.633460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:45.664795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.659999+0000","last_change":"2023-10-08T16:04:16.652447+0000","last_active":"2023-10-08T16:04:17.659999+0000","last_peered":"2023-10-08T16:04:17.659999+0000","last_clean":"2023-10-08T16:04:17.659999+0000","last_became_active":"2023-10-08T16:04:16.651709+0000","last_became_peered":"2023-10-08T16:04:16.651709+0000","last_unstale":"2023-10-08T16:04:17.659999+0000","last_undegraded":"2023-10-08T16:04:17.659999+0000","last_fullsized":"2023-10-08T16:04:17.659999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:04.157234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633417+0000","last_change":"2023-10-08T16:04:17.631176+0000","last_active":"2023-10-08T16:04:17.633417+0000","last_peered":"2023-10-08T16:04:17.633417+0000","last_clean":"2023-10-08T16:04:17.633417+0000","last_became_active":"2023-10-08T16:04:17.630908+0000","last_became_peered":"2023-10-08T16:04:17.630908+0000","last_unstale":"2023-10-08T16:04:17.633417+0000","last_undegraded":"2023-10-08T16:04:17.633417+0000","last_fullsized":"2023-10-08T16:04:17.633417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:48.519448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.662439+0000","last_change":"2023-10-08T16:04:16.655771+0000","last_active":"2023-10-08T16:04:17.662439+0000","last_peered":"2023-10-08T16:04:17.662439+0000","last_clean":"2023-10-08T16:04:17.662439+0000","last_became_active":"2023-10-08T16:04:16.655245+0000","last_became_peered":"2023-10-08T16:04:16.655245+0000","last_unstale":"2023-10-08T16:04:17.662439+0000","last_undegraded":"2023-10-08T16:04:17.662439+0000","last_fullsized":"2023-10-08T16:04:17.662439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:48.596542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635952+0000","last_change":"2023-10-08T16:04:17.627726+0000","last_active":"2023-10-08T16:04:17.635952+0000","last_peered":"2023-10-08T16:04:17.635952+0000","last_clean":"2023-10-08T16:04:17.635952+0000","last_became_active":"2023-10-08T16:04:17.627369+0000","last_became_peered":"2023-10-08T16:04:17.627369+0000","last_unstale":"2023-10-08T16:04:17.635952+0000","last_undegraded":"2023-10-08T16:04:17.635952+0000","last_fullsized":"2023-10-08T16:04:17.635952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.619290+0000","last_change":"2023-10-08T16:04:16.654597+0000","last_active":"2023-10-08T16:04:17.619290+0000","last_peered":"2023-10-08T16:04:17.619290+0000","last_clean":"2023-10-08T16:04:17.619290+0000","last_became_active":"2023-10-08T16:04:16.654124+0000","last_became_peered":"2023-10-08T16:04:16.654124+0000","last_unstale":"2023-10-08T16:04:17.619290+0000","last_undegraded":"2023-10-08T16:04:17.619290+0000","last_fullsized":"2023-10-08T16:04:17.619290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.638582+0000","last_change":"2023-10-08T16:04:17.634090+0000","last_active":"2023-10-08T16:04:17.638582+0000","last_peered":"2023-10-08T16:04:17.638582+0000","last_clean":"2023-10-08T16:04:17.638582+0000","last_became_active":"2023-10-08T16:04:17.633811+0000","last_became_peered":"2023-10-08T16:04:17.633811+0000","last_unstale":"2023-10-08T16:04:17.638582+0000","last_undegraded":"2023-10-08T16:04:17.638582+0000","last_fullsized":"2023-10-08T16:04:17.638582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:08.121055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.613242+0000","last_change":"2023-10-08T16:04:06.370834+0000","last_active":"2023-10-08T16:04:17.613242+0000","last_peered":"2023-10-08T16:04:17.613242+0000","last_clean":"2023-10-08T16:04:17.613242+0000","last_became_active":"2023-10-08T16:04:06.368022+0000","last_became_peered":"2023-10-08T16:04:06.368022+0000","last_unstale":"2023-10-08T16:04:17.613242+0000","last_undegraded":"2023-10-08T16:04:17.613242+0000","last_fullsized":"2023-10-08T16:04:17.613242+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:05.034115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:05.034115+0000","last_clean_scrub_stamp":"2023-10-08T16:04:05.034115+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:37.338076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.610284+0000","last_change":"2023-10-08T16:04:16.646681+0000","last_active":"2023-10-08T16:04:17.610284+0000","last_peered":"2023-10-08T16:04:17.610284+0000","last_clean":"2023-10-08T16:04:17.610284+0000","last_became_active":"2023-10-08T16:04:16.646086+0000","last_became_peered":"2023-10-08T16:04:16.646086+0000","last_unstale":"2023-10-08T16:04:17.610284+0000","last_undegraded":"2023-10-08T16:04:17.610284+0000","last_fullsized":"2023-10-08T16:04:17.610284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:24.778540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.634986+0000","last_change":"2023-10-08T16:04:17.629806+0000","last_active":"2023-10-08T16:04:17.634986+0000","last_peered":"2023-10-08T16:04:17.634986+0000","last_clean":"2023-10-08T16:04:17.634986+0000","last_became_active":"2023-10-08T16:04:17.629127+0000","last_became_peered":"2023-10-08T16:04:17.629127+0000","last_unstale":"2023-10-08T16:04:17.634986+0000","last_undegraded":"2023-10-08T16:04:17.634986+0000","last_fullsized":"2023-10-08T16:04:17.634986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:33.720945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.613218+0000","last_change":"2023-10-08T16:04:16.661382+0000","last_active":"2023-10-08T16:04:17.613218+0000","last_peered":"2023-10-08T16:04:17.613218+0000","last_clean":"2023-10-08T16:04:17.613218+0000","last_became_active":"2023-10-08T16:04:16.661186+0000","last_became_peered":"2023-10-08T16:04:16.661186+0000","last_unstale":"2023-10-08T16:04:17.613218+0000","last_undegraded":"2023-10-08T16:04:17.613218+0000","last_fullsized":"2023-10-08T16:04:17.613218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:06.774566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.621479+0000","last_change":"2023-10-08T16:04:17.616018+0000","last_active":"2023-10-08T16:04:17.621479+0000","last_peered":"2023-10-08T16:04:17.621479+0000","last_clean":"2023-10-08T16:04:17.621479+0000","last_became_active":"2023-10-08T16:04:17.615671+0000","last_became_peered":"2023-10-08T16:04:17.615671+0000","last_unstale":"2023-10-08T16:04:17.621479+0000","last_undegraded":"2023-10-08T16:04:17.621479+0000","last_fullsized":"2023-10-08T16:04:17.621479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:05.041349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.619582+0000","last_change":"2023-10-08T16:04:16.654721+0000","last_active":"2023-10-08T16:04:17.619582+0000","last_peered":"2023-10-08T16:04:17.619582+0000","last_clean":"2023-10-08T16:04:17.619582+0000","last_became_active":"2023-10-08T16:04:16.654359+0000","last_became_peered":"2023-10-08T16:04:16.654359+0000","last_unstale":"2023-10-08T16:04:17.619582+0000","last_undegraded":"2023-10-08T16:04:17.619582+0000","last_fullsized":"2023-10-08T16:04:17.619582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:04.030037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.627610+0000","last_change":"2023-10-08T16:04:17.626207+0000","last_active":"2023-10-08T16:04:17.627610+0000","last_peered":"2023-10-08T16:04:17.627610+0000","last_clean":"2023-10-08T16:04:17.627610+0000","last_became_active":"2023-10-08T16:04:17.624876+0000","last_became_peered":"2023-10-08T16:04:17.624876+0000","last_unstale":"2023-10-08T16:04:17.627610+0000","last_undegraded":"2023-10-08T16:04:17.627610+0000","last_fullsized":"2023-10-08T16:04:17.627610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:15.965581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.610643+0000","last_change":"2023-10-08T16:04:16.654812+0000","last_active":"2023-10-08T16:04:17.610643+0000","last_peered":"2023-10-08T16:04:17.610643+0000","last_clean":"2023-10-08T16:04:17.610643+0000","last_became_active":"2023-10-08T16:04:16.654454+0000","last_became_peered":"2023-10-08T16:04:16.654454+0000","last_unstale":"2023-10-08T16:04:17.610643+0000","last_undegraded":"2023-10-08T16:04:17.610643+0000","last_fullsized":"2023-10-08T16:04:17.610643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.627862+0000","last_change":"2023-10-08T16:04:17.619617+0000","last_active":"2023-10-08T16:04:17.627862+0000","last_peered":"2023-10-08T16:04:17.627862+0000","last_clean":"2023-10-08T16:04:17.627862+0000","last_became_active":"2023-10-08T16:04:17.619294+0000","last_became_peered":"2023-10-08T16:04:17.619294+0000","last_unstale":"2023-10-08T16:04:17.627862+0000","last_undegraded":"2023-10-08T16:04:17.627862+0000","last_fullsized":"2023-10-08T16:04:17.627862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:25.789851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.612619+0000","last_change":"2023-10-08T16:04:16.662004+0000","last_active":"2023-10-08T16:04:17.612619+0000","last_peered":"2023-10-08T16:04:17.612619+0000","last_clean":"2023-10-08T16:04:17.612619+0000","last_became_active":"2023-10-08T16:04:16.661756+0000","last_became_peered":"2023-10-08T16:04:16.661756+0000","last_unstale":"2023-10-08T16:04:17.612619+0000","last_undegraded":"2023-10-08T16:04:17.612619+0000","last_fullsized":"2023-10-08T16:04:17.612619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:06.774566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.626656+0000","last_change":"2023-10-08T16:04:17.616691+0000","last_active":"2023-10-08T16:04:17.626656+0000","last_peered":"2023-10-08T16:04:17.626656+0000","last_clean":"2023-10-08T16:04:17.626656+0000","last_became_active":"2023-10-08T16:04:17.616348+0000","last_became_peered":"2023-10-08T16:04:17.616348+0000","last_unstale":"2023-10-08T16:04:17.626656+0000","last_undegraded":"2023-10-08T16:04:17.626656+0000","last_fullsized":"2023-10-08T16:04:17.626656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:08.121055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.614807+0000","last_change":"2023-10-08T16:04:16.662731+0000","last_active":"2023-10-08T16:04:17.614807+0000","last_peered":"2023-10-08T16:04:17.614807+0000","last_clean":"2023-10-08T16:04:17.614807+0000","last_became_active":"2023-10-08T16:04:16.662446+0000","last_became_peered":"2023-10-08T16:04:16.662446+0000","last_unstale":"2023-10-08T16:04:17.614807+0000","last_undegraded":"2023-10-08T16:04:17.614807+0000","last_fullsized":"2023-10-08T16:04:17.614807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:59.297962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.628102+0000","last_change":"2023-10-08T16:04:17.624687+0000","last_active":"2023-10-08T16:04:17.628102+0000","last_peered":"2023-10-08T16:04:17.628102+0000","last_clean":"2023-10-08T16:04:17.628102+0000","last_became_active":"2023-10-08T16:04:17.624319+0000","last_became_peered":"2023-10-08T16:04:17.624319+0000","last_unstale":"2023-10-08T16:04:17.628102+0000","last_undegraded":"2023-10-08T16:04:17.628102+0000","last_fullsized":"2023-10-08T16:04:17.628102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.618103+0000","last_change":"2023-10-08T16:04:16.661076+0000","last_active":"2023-10-08T16:04:17.618103+0000","last_peered":"2023-10-08T16:04:17.618103+0000","last_clean":"2023-10-08T16:04:17.618103+0000","last_became_active":"2023-10-08T16:04:16.660704+0000","last_became_peered":"2023-10-08T16:04:16.660704+0000","last_unstale":"2023-10-08T16:04:17.618103+0000","last_undegraded":"2023-10-08T16:04:17.618103+0000","last_fullsized":"2023-10-08T16:04:17.618103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.637441+0000","last_change":"2023-10-08T16:04:17.631960+0000","last_active":"2023-10-08T16:04:17.637441+0000","last_peered":"2023-10-08T16:04:17.637441+0000","last_clean":"2023-10-08T16:04:17.637441+0000","last_became_active":"2023-10-08T16:04:17.631615+0000","last_became_peered":"2023-10-08T16:04:17.631615+0000","last_unstale":"2023-10-08T16:04:17.637441+0000","last_undegraded":"2023-10-08T16:04:17.637441+0000","last_fullsized":"2023-10-08T16:04:17.637441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.599406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.654680+0000","last_change":"2023-10-08T16:04:16.659489+0000","last_active":"2023-10-08T16:04:17.654680+0000","last_peered":"2023-10-08T16:04:17.654680+0000","last_clean":"2023-10-08T16:04:17.654680+0000","last_became_active":"2023-10-08T16:04:16.659148+0000","last_became_peered":"2023-10-08T16:04:16.659148+0000","last_unstale":"2023-10-08T16:04:17.654680+0000","last_undegraded":"2023-10-08T16:04:17.654680+0000","last_fullsized":"2023-10-08T16:04:17.654680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635587+0000","last_change":"2023-10-08T16:04:17.624766+0000","last_active":"2023-10-08T16:04:17.635587+0000","last_peered":"2023-10-08T16:04:17.635587+0000","last_clean":"2023-10-08T16:04:17.635587+0000","last_became_active":"2023-10-08T16:04:17.624385+0000","last_became_peered":"2023-10-08T16:04:17.624385+0000","last_unstale":"2023-10-08T16:04:17.635587+0000","last_undegraded":"2023-10-08T16:04:17.635587+0000","last_fullsized":"2023-10-08T16:04:17.635587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.613137+0000","last_change":"2023-10-08T16:04:16.662618+0000","last_active":"2023-10-08T16:04:17.613137+0000","last_peered":"2023-10-08T16:04:17.613137+0000","last_clean":"2023-10-08T16:04:17.613137+0000","last_became_active":"2023-10-08T16:04:16.662327+0000","last_became_peered":"2023-10-08T16:04:16.662327+0000","last_unstale":"2023-10-08T16:04:17.613137+0000","last_undegraded":"2023-10-08T16:04:17.613137+0000","last_fullsized":"2023-10-08T16:04:17.613137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:06:41.062441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.632994+0000","last_change":"2023-10-08T16:04:17.623221+0000","last_active":"2023-10-08T16:04:17.632994+0000","last_peered":"2023-10-08T16:04:17.632994+0000","last_clean":"2023-10-08T16:04:17.632994+0000","last_became_active":"2023-10-08T16:04:17.622898+0000","last_became_peered":"2023-10-08T16:04:17.622898+0000","last_unstale":"2023-10-08T16:04:17.632994+0000","last_undegraded":"2023-10-08T16:04:17.632994+0000","last_fullsized":"2023-10-08T16:04:17.632994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:47.130200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.612371+0000","last_change":"2023-10-08T16:04:16.661483+0000","last_active":"2023-10-08T16:04:17.612371+0000","last_peered":"2023-10-08T16:04:17.612371+0000","last_clean":"2023-10-08T16:04:17.612371+0000","last_became_active":"2023-10-08T16:04:16.661055+0000","last_became_peered":"2023-10-08T16:04:16.661055+0000","last_unstale":"2023-10-08T16:04:17.612371+0000","last_undegraded":"2023-10-08T16:04:17.612371+0000","last_fullsized":"2023-10-08T16:04:17.612371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.631082+0000","last_change":"2023-10-08T16:04:17.627259+0000","last_active":"2023-10-08T16:04:17.631082+0000","last_peered":"2023-10-08T16:04:17.631082+0000","last_clean":"2023-10-08T16:04:17.631082+0000","last_became_active":"2023-10-08T16:04:17.626991+0000","last_became_peered":"2023-10-08T16:04:17.626991+0000","last_unstale":"2023-10-08T16:04:17.631082+0000","last_undegraded":"2023-10-08T16:04:17.631082+0000","last_fullsized":"2023-10-08T16:04:17.631082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:56.205550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.616711+0000","last_change":"2023-10-08T16:04:16.657613+0000","last_active":"2023-10-08T16:04:17.616711+0000","last_peered":"2023-10-08T16:04:17.616711+0000","last_clean":"2023-10-08T16:04:17.616711+0000","last_became_active":"2023-10-08T16:04:16.657299+0000","last_became_peered":"2023-10-08T16:04:16.657299+0000","last_unstale":"2023-10-08T16:04:17.616711+0000","last_undegraded":"2023-10-08T16:04:17.616711+0000","last_fullsized":"2023-10-08T16:04:17.616711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:24.778540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.630041+0000","last_change":"2023-10-08T16:04:17.621069+0000","last_active":"2023-10-08T16:04:17.630041+0000","last_peered":"2023-10-08T16:04:17.630041+0000","last_clean":"2023-10-08T16:04:17.630041+0000","last_became_active":"2023-10-08T16:04:17.620693+0000","last_became_peered":"2023-10-08T16:04:17.620693+0000","last_unstale":"2023-10-08T16:04:17.630041+0000","last_undegraded":"2023-10-08T16:04:17.630041+0000","last_fullsized":"2023-10-08T16:04:17.630041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.655542+0000","last_change":"2023-10-08T16:04:16.663488+0000","last_active":"2023-10-08T16:04:17.655542+0000","last_peered":"2023-10-08T16:04:17.655542+0000","last_clean":"2023-10-08T16:04:17.655542+0000","last_became_active":"2023-10-08T16:04:16.663184+0000","last_became_peered":"2023-10-08T16:04:16.663184+0000","last_unstale":"2023-10-08T16:04:17.655542+0000","last_undegraded":"2023-10-08T16:04:17.655542+0000","last_fullsized":"2023-10-08T16:04:17.655542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:26.863386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.628021+0000","last_change":"2023-10-08T16:04:17.623763+0000","last_active":"2023-10-08T16:04:17.628021+0000","last_peered":"2023-10-08T16:04:17.628021+0000","last_clean":"2023-10-08T16:04:17.628021+0000","last_became_active":"2023-10-08T16:04:17.622898+0000","last_became_peered":"2023-10-08T16:04:17.622898+0000","last_unstale":"2023-10-08T16:04:17.628021+0000","last_undegraded":"2023-10-08T16:04:17.628021+0000","last_fullsized":"2023-10-08T16:04:17.628021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:33.720945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.626676+0000","last_change":"2023-10-08T16:04:17.617498+0000","last_active":"2023-10-08T16:04:17.626676+0000","last_peered":"2023-10-08T16:04:17.626676+0000","last_clean":"2023-10-08T16:04:17.626676+0000","last_became_active":"2023-10-08T16:04:17.617179+0000","last_became_peered":"2023-10-08T16:04:17.617179+0000","last_unstale":"2023-10-08T16:04:17.626676+0000","last_undegraded":"2023-10-08T16:04:17.626676+0000","last_fullsized":"2023-10-08T16:04:17.626676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:56.205550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.654787+0000","last_change":"2023-10-08T16:04:16.661467+0000","last_active":"2023-10-08T16:04:17.654787+0000","last_peered":"2023-10-08T16:04:17.654787+0000","last_clean":"2023-10-08T16:04:17.654787+0000","last_became_active":"2023-10-08T16:04:16.661215+0000","last_became_peered":"2023-10-08T16:04:16.661215+0000","last_unstale":"2023-10-08T16:04:17.654787+0000","last_undegraded":"2023-10-08T16:04:17.654787+0000","last_fullsized":"2023-10-08T16:04:17.654787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.626550+0000","last_change":"2023-10-08T16:04:17.618169+0000","last_active":"2023-10-08T16:04:17.626550+0000","last_peered":"2023-10-08T16:04:17.626550+0000","last_clean":"2023-10-08T16:04:17.626550+0000","last_became_active":"2023-10-08T16:04:17.617216+0000","last_became_peered":"2023-10-08T16:04:17.617216+0000","last_unstale":"2023-10-08T16:04:17.626550+0000","last_undegraded":"2023-10-08T16:04:17.626550+0000","last_fullsized":"2023-10-08T16:04:17.626550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:07.051965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.655102+0000","last_change":"2023-10-08T16:04:16.661825+0000","last_active":"2023-10-08T16:04:17.655102+0000","last_peered":"2023-10-08T16:04:17.655102+0000","last_clean":"2023-10-08T16:04:17.655102+0000","last_became_active":"2023-10-08T16:04:16.661224+0000","last_became_peered":"2023-10-08T16:04:16.661224+0000","last_unstale":"2023-10-08T16:04:17.655102+0000","last_undegraded":"2023-10-08T16:04:17.655102+0000","last_fullsized":"2023-10-08T16:04:17.655102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:08.375883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.632594+0000","last_change":"2023-10-08T16:04:17.621807+0000","last_active":"2023-10-08T16:04:17.632594+0000","last_peered":"2023-10-08T16:04:17.632594+0000","last_clean":"2023-10-08T16:04:17.632594+0000","last_became_active":"2023-10-08T16:04:17.621550+0000","last_became_peered":"2023-10-08T16:04:17.621550+0000","last_unstale":"2023-10-08T16:04:17.632594+0000","last_undegraded":"2023-10-08T16:04:17.632594+0000","last_fullsized":"2023-10-08T16:04:17.632594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:33.720945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.656319+0000","last_change":"2023-10-08T16:04:16.662223+0000","last_active":"2023-10-08T16:04:17.656319+0000","last_peered":"2023-10-08T16:04:17.656319+0000","last_clean":"2023-10-08T16:04:17.656319+0000","last_became_active":"2023-10-08T16:04:16.661907+0000","last_became_peered":"2023-10-08T16:04:16.661907+0000","last_unstale":"2023-10-08T16:04:17.656319+0000","last_undegraded":"2023-10-08T16:04:17.656319+0000","last_fullsized":"2023-10-08T16:04:17.656319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:04.030037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.634527+0000","last_change":"2023-10-08T16:04:17.627855+0000","last_active":"2023-10-08T16:04:17.634527+0000","last_peered":"2023-10-08T16:04:17.634527+0000","last_clean":"2023-10-08T16:04:17.634527+0000","last_became_active":"2023-10-08T16:04:17.627562+0000","last_became_peered":"2023-10-08T16:04:17.627562+0000","last_unstale":"2023-10-08T16:04:17.634527+0000","last_undegraded":"2023-10-08T16:04:17.634527+0000","last_fullsized":"2023-10-08T16:04:17.634527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:08.121055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.659812+0000","last_change":"2023-10-08T16:04:16.663088+0000","last_active":"2023-10-08T16:04:17.659812+0000","last_peered":"2023-10-08T16:04:17.659812+0000","last_clean":"2023-10-08T16:04:17.659812+0000","last_became_active":"2023-10-08T16:04:16.662714+0000","last_became_peered":"2023-10-08T16:04:16.662714+0000","last_unstale":"2023-10-08T16:04:17.659812+0000","last_undegraded":"2023-10-08T16:04:17.659812+0000","last_fullsized":"2023-10-08T16:04:17.659812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:54.682083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":661576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.403}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4690000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":70654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5049999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298076,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073764,"statfs":{"total":96636764160,"available":96331534336,"internally_reserved":0,"allocated":806912,"data_stored":660721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:04:20.983 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T16:04:20.984 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-08T16:04:20.984 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-08T16:04:20.984 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-08T16:04:20.984 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-08T16:04:21.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.079+0000 7f7df7fff700 1 Processor -- start 2023-10-08T16:04:21.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.079+0000 7f7df7fff700 1 -- start start 2023-10-08T16:04:21.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.079+0000 7f7df7fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7df80b59f0 0x7f7df80b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:21.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.079+0000 7f7df7fff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7df81423c0 0x7f7df81428d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:21.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df7fff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7df8142e10 0x7f7df81459c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:21.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df7fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df80b1070 con 0x7f7df80b59f0 2023-10-08T16:04:21.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df7fff700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df80b2150 con 0x7f7df81423c0 2023-10-08T16:04:21.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df7fff700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df80b26f0 con 0x7f7df8142e10 2023-10-08T16:04:21.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df6ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7df80b59f0 0x7f7df80b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:21.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df6ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7df80b59f0 0x7f7df80b2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42654/0 (socket says 172.21.15.133:42654) 2023-10-08T16:04:21.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df6ffd700 1 -- 172.21.15.133:0/1675527542 learned_addr learned my addr 172.21.15.133:0/1675527542 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:21.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df67fc700 1 --2- 172.21.15.133:0/1675527542 >> v2:172.21.15.190:3300/0 conn(0x7f7df81423c0 0x7f7df81428d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:21.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df77fe700 1 --2- 172.21.15.133:0/1675527542 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7df8142e10 0x7f7df81459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:21.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df6ffd700 1 -- 172.21.15.133:0/1675527542 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7df8142e10 msgr2=0x7f7df81459c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:21.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df6ffd700 1 --2- 172.21.15.133:0/1675527542 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7df8142e10 0x7f7df81459c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df6ffd700 1 -- 172.21.15.133:0/1675527542 >> v2:172.21.15.190:3300/0 conn(0x7f7df81423c0 msgr2=0x7f7df81428d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:21.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df6ffd700 1 --2- 172.21.15.133:0/1675527542 >> v2:172.21.15.190:3300/0 conn(0x7f7df81423c0 0x7f7df81428d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df6ffd700 1 -- 172.21.15.133:0/1675527542 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df80b1cc0 con 0x7f7df80b59f0 2023-10-08T16:04:21.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df6ffd700 1 --2- 172.21.15.133:0/1675527542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7df80b59f0 0x7f7df80b2b80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7df80b1e50 tx=0x7f7de8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb447a6a2c83de1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:21.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df5ffb700 1 -- 172.21.15.133:0/1675527542 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de8011630 con 0x7f7df80b59f0 2023-10-08T16:04:21.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df5ffb700 1 -- 172.21.15.133:0/1675527542 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de8011790 con 0x7f7df80b59f0 2023-10-08T16:04:21.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df5ffb700 1 -- 172.21.15.133:0/1675527542 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de8011b50 con 0x7f7df80b59f0 2023-10-08T16:04:21.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df7fff700 1 -- 172.21.15.133:0/1675527542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7df80b59f0 msgr2=0x7f7df80b2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:21.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df7fff700 1 --2- 172.21.15.133:0/1675527542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7df80b59f0 0x7f7df80b2b80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7df80b1e50 tx=0x7f7de8009250 comp rx=0 tx=0).stop 2023-10-08T16:04:21.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df7fff700 1 -- 172.21.15.133:0/1675527542 shutdown_connections 2023-10-08T16:04:21.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df7fff700 1 --2- 172.21.15.133:0/1675527542 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7df8142e10 0x7f7df81459c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df7fff700 1 --2- 172.21.15.133:0/1675527542 >> v2:172.21.15.190:3300/0 conn(0x7f7df81423c0 0x7f7df81428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df7fff700 1 --2- 172.21.15.133:0/1675527542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7df80b59f0 0x7f7df80b2b80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df7fff700 1 -- 172.21.15.133:0/1675527542 >> 172.21.15.133:0/1675527542 conn(0x7f7df8062ba0 msgr2=0x7f7df8062fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:21.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df7fff700 1 -- 172.21.15.133:0/1675527542 shutdown_connections 2023-10-08T16:04:21.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.083+0000 7f7df7fff700 1 -- 172.21.15.133:0/1675527542 wait complete. 2023-10-08T16:04:21.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.087+0000 7f7df7fff700 1 Processor -- start 2023-10-08T16:04:21.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.087+0000 7f7df7fff700 1 -- start start 2023-10-08T16:04:21.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.087+0000 7f7df7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7df80b59f0 0x7f7df8146120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:21.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.087+0000 7f7df7fff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7df81423c0 0x7f7df8143590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:21.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.087+0000 7f7df7fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7df8142e10 0x7f7df80ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:21.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.087+0000 7f7df7fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df8143ad0 con 0x7f7df80b59f0 2023-10-08T16:04:21.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.087+0000 7f7df7fff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df8144a90 con 0x7f7df8142e10 2023-10-08T16:04:21.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.087+0000 7f7df7fff700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df80a6300 con 0x7f7df81423c0 2023-10-08T16:04:21.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.087+0000 7f7df6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7df80b59f0 0x7f7df8146120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:21.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.087+0000 7f7df6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7df80b59f0 0x7f7df8146120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42668/0 (socket says 172.21.15.133:42668) 2023-10-08T16:04:21.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.087+0000 7f7df6ffd700 1 -- 172.21.15.133:0/4097191628 learned_addr learned my addr 172.21.15.133:0/4097191628 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:21.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.087+0000 7f7df67fc700 1 --2- 172.21.15.133:0/4097191628 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7df81423c0 0x7f7df8143590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:21.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.087+0000 7f7df77fe700 1 --2- 172.21.15.133:0/4097191628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7df8142e10 0x7f7df80ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:21.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.087+0000 7f7df6ffd700 1 -- 172.21.15.133:0/4097191628 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7df81423c0 msgr2=0x7f7df8143590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:21.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.087+0000 7f7df6ffd700 1 --2- 172.21.15.133:0/4097191628 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7df81423c0 0x7f7df8143590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.087+0000 7f7df6ffd700 1 -- 172.21.15.133:0/4097191628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7df8142e10 msgr2=0x7f7df80ae180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:21.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.087+0000 7f7df6ffd700 1 --2- 172.21.15.133:0/4097191628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7df8142e10 0x7f7df80ae180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.087+0000 7f7df6ffd700 1 -- 172.21.15.133:0/4097191628 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de8009490 con 0x7f7df80b59f0 2023-10-08T16:04:21.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.087+0000 7f7df77fe700 1 --2- 172.21.15.133:0/4097191628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7df8142e10 0x7f7df80ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:04:21.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.087+0000 7f7df6ffd700 1 --2- 172.21.15.133:0/4097191628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7df80b59f0 0x7f7df8146120 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7de8009290 tx=0x7f7de8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:21.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.087+0000 7f7deeffd700 1 -- 172.21.15.133:0/4097191628 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de801bea0 con 0x7f7df80b59f0 2023-10-08T16:04:21.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.087+0000 7f7deeffd700 1 -- 172.21.15.133:0/4097191628 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de801c450 con 0x7f7df80b59f0 2023-10-08T16:04:21.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.087+0000 7f7df7fff700 1 -- 172.21.15.133:0/4097191628 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df8144d30 con 0x7f7df80b59f0 2023-10-08T16:04:21.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.087+0000 7f7deeffd700 1 -- 172.21.15.133:0/4097191628 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de801c810 con 0x7f7df80b59f0 2023-10-08T16:04:21.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.087+0000 7f7df7fff700 1 -- 172.21.15.133:0/4097191628 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df80ae6c0 con 0x7f7df80b59f0 2023-10-08T16:04:21.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.087+0000 7f7df7fff700 1 -- 172.21.15.133:0/4097191628 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7df804be40 con 0x7f7df80b59f0 2023-10-08T16:04:21.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.091+0000 7f7deeffd700 1 -- 172.21.15.133:0/4097191628 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7de801cb80 con 0x7f7df80b59f0 2023-10-08T16:04:21.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.091+0000 7f7deeffd700 1 --2- 172.21.15.133:0/4097191628 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f7dd8060580 0x7f7dd8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:21.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.091+0000 7f7deeffd700 1 -- 172.21.15.133:0/4097191628 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7de807df50 con 0x7f7df80b59f0 2023-10-08T16:04:21.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.091+0000 7f7df67fc700 1 --2- 172.21.15.133:0/4097191628 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f7dd8060580 0x7f7dd8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:21.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.091+0000 7f7df67fc700 1 --2- 172.21.15.133:0/4097191628 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f7dd8060580 0x7f7dd8062a30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7df80b0f00 tx=0x7f7de0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:21.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.099+0000 7f7deeffd700 1 -- 172.21.15.133:0/4097191628 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7de804e540 con 0x7f7df80b59f0 2023-10-08T16:04:21.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.295+0000 7f7df7fff700 1 -- 172.21.15.133:0/4097191628 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f7df8141830 con 0x7f7df80b59f0 2023-10-08T16:04:21.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.299+0000 7f7deeffd700 1 -- 172.21.15.133:0/4097191628 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+154137 (secure 0 0 0) 0x7f7de802b090 con 0x7f7df80b59f0 2023-10-08T16:04:21.305 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:04:21.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.303+0000 7f7df7fff700 1 -- 172.21.15.133:0/4097191628 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f7dd8060580 msgr2=0x7f7dd8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:21.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.303+0000 7f7df7fff700 1 --2- 172.21.15.133:0/4097191628 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f7dd8060580 0x7f7dd8062a30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7df80b0f00 tx=0x7f7de0008040 comp rx=0 tx=0).stop 2023-10-08T16:04:21.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.303+0000 7f7df7fff700 1 -- 172.21.15.133:0/4097191628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7df80b59f0 msgr2=0x7f7df8146120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:21.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.303+0000 7f7df7fff700 1 --2- 172.21.15.133:0/4097191628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7df80b59f0 0x7f7df8146120 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7de8009290 tx=0x7f7de8016000 comp rx=0 tx=0).stop 2023-10-08T16:04:21.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.303+0000 7f7df7fff700 1 -- 172.21.15.133:0/4097191628 shutdown_connections 2023-10-08T16:04:21.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.303+0000 7f7df7fff700 1 --2- 172.21.15.133:0/4097191628 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f7dd8060580 0x7f7dd8062a30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.303+0000 7f7df7fff700 1 --2- 172.21.15.133:0/4097191628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7df8142e10 0x7f7df80ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.303+0000 7f7df7fff700 1 --2- 172.21.15.133:0/4097191628 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7df81423c0 0x7f7df8143590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.303+0000 7f7df7fff700 1 --2- 172.21.15.133:0/4097191628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7df80b59f0 0x7f7df8146120 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.303+0000 7f7df7fff700 1 -- 172.21.15.133:0/4097191628 >> 172.21.15.133:0/4097191628 conn(0x7f7df8062ba0 msgr2=0x7f7df8062f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:21.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.303+0000 7f7df7fff700 1 -- 172.21.15.133:0/4097191628 shutdown_connections 2023-10-08T16:04:21.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.303+0000 7f7df7fff700 1 -- 172.21.15.133:0/4097191628 wait complete. 2023-10-08T16:04:21.322 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":33362},{"type":"v1","addr":"172.21.15.133:6833","nonce":33362}]},"active_addr":"172.21.15.133:6833/33362","active_change":"2023-10-08T16:03:56.819019+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4102,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":672361375}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":2824593171}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":2460270600}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":1411957691}]}]} 2023-10-08T16:04:21.325 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-08T16:04:21.326 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-08T16:04:21.326 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:04:21.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.431+0000 7f59dcd79700 1 Processor -- start 2023-10-08T16:04:21.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.431+0000 7f59dcd79700 1 -- start start 2023-10-08T16:04:21.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.431+0000 7f59dcd79700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59d8070830 0x7f59d80aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:21.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.431+0000 7f59dcd79700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f59d80b2140 0x7f59d8149540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:21.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.431+0000 7f59dcd79700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d80a8d60 con 0x7f59d8070c00 2023-10-08T16:04:21.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.431+0000 7f59dcd79700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d80ae0a0 con 0x7f59d80b2140 2023-10-08T16:04:21.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.431+0000 7f59dcd79700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d80acee0 con 0x7f59d8070830 2023-10-08T16:04:21.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.431+0000 7f59d7fff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f59d80b2140 0x7f59d8149540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:21.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.431+0000 7f59d77fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59d8070830 0x7f59d80aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:21.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.431+0000 7f59d77fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59d8070830 0x7f59d80aeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.133:45528/0 (socket says 172.21.15.133:45528) 2023-10-08T16:04:21.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.431+0000 7f59d77fe700 1 -- 172.21.15.133:0/375312057 learned_addr learned my addr 172.21.15.133:0/375312057 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:21.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.431+0000 7f59d77fe700 1 -- 172.21.15.133:0/375312057 >> v2:172.21.15.190:3300/0 conn(0x7f59d80b2140 msgr2=0x7f59d8149540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:21.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.431+0000 7f59d77fe700 1 --2- 172.21.15.133:0/375312057 >> v2:172.21.15.190:3300/0 conn(0x7f59d80b2140 0x7f59d8149540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.431+0000 7f59d77fe700 1 -- 172.21.15.133:0/375312057 >> v1:172.21.15.190:6789/0 conn(0x7f59d8070c00 legacy=0x7f59d80b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:21.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.431+0000 7f59d77fe700 1 -- 172.21.15.133:0/375312057 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d80b0cc0 con 0x7f59d8070830 2023-10-08T16:04:21.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.431+0000 7f59d77fe700 1 --2- 172.21.15.133:0/375312057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59d8070830 0x7f59d80aeda0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f59c00099b0 tx=0x7f59c0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d44d33abdfc55dfa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:21.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.431+0000 7f59d67fc700 1 -- 172.21.15.133:0/375312057 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c0009ea0 con 0x7f59d8070830 2023-10-08T16:04:21.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.431+0000 7f59d67fc700 1 -- 172.21.15.133:0/375312057 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c000b860 con 0x7f59d8070830 2023-10-08T16:04:21.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.431+0000 7f59d67fc700 1 -- 172.21.15.133:0/375312057 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c000bc00 con 0x7f59d8070830 2023-10-08T16:04:21.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59dcd79700 1 -- 172.21.15.133:0/375312057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59d8070830 msgr2=0x7f59d80aeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:21.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59dcd79700 1 --2- 172.21.15.133:0/375312057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59d8070830 0x7f59d80aeda0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f59c00099b0 tx=0x7f59c0009250 comp rx=0 tx=0).stop 2023-10-08T16:04:21.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59dcd79700 1 -- 172.21.15.133:0/375312057 shutdown_connections 2023-10-08T16:04:21.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59dcd79700 1 --2- 172.21.15.133:0/375312057 >> v2:172.21.15.190:3300/0 conn(0x7f59d80b2140 0x7f59d8149540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59dcd79700 1 --2- 172.21.15.133:0/375312057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59d8070830 0x7f59d80aeda0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59dcd79700 1 -- 172.21.15.133:0/375312057 >> 172.21.15.133:0/375312057 conn(0x7f59d8066f90 msgr2=0x7f59d8067390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:21.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59dcd79700 1 -- 172.21.15.133:0/375312057 shutdown_connections 2023-10-08T16:04:21.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59dcd79700 1 -- 172.21.15.133:0/375312057 wait complete. 2023-10-08T16:04:21.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59dcd79700 1 Processor -- start 2023-10-08T16:04:21.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59dcd79700 1 -- start start 2023-10-08T16:04:21.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59dcd79700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59d8070830 0x7f59d806bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:21.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59dcd79700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59d8070c00 0x7f59d806c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:21.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59dcd79700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d80b2140 0x7f59d80a7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:21.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59dcd79700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d806e700 con 0x7f59d80b2140 2023-10-08T16:04:21.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59dcd79700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d806d300 con 0x7f59d8070c00 2023-10-08T16:04:21.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59dcd79700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d80b14a0 con 0x7f59d8070830 2023-10-08T16:04:21.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59d7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d80b2140 0x7f59d80a7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:21.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59d77fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59d8070830 0x7f59d806bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:21.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59d7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d80b2140 0x7f59d80a7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42678/0 (socket says 172.21.15.133:42678) 2023-10-08T16:04:21.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59d7fff700 1 -- 172.21.15.133:0/2522630078 learned_addr learned my addr 172.21.15.133:0/2522630078 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:21.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59d6ffd700 1 --2- 172.21.15.133:0/2522630078 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59d8070c00 0x7f59d806c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:21.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59d77fe700 1 -- 172.21.15.133:0/2522630078 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59d8070c00 msgr2=0x7f59d806c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:21.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59d77fe700 1 --2- 172.21.15.133:0/2522630078 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59d8070c00 0x7f59d806c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59d77fe700 1 -- 172.21.15.133:0/2522630078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d80b2140 msgr2=0x7f59d80a7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:21.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59d77fe700 1 --2- 172.21.15.133:0/2522630078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d80b2140 0x7f59d80a7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59d77fe700 1 -- 172.21.15.133:0/2522630078 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c00094f0 con 0x7f59d8070830 2023-10-08T16:04:21.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59d77fe700 1 --2- 172.21.15.133:0/2522630078 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59d8070830 0x7f59d806bbe0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f59d8069c10 tx=0x7f59c0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:21.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59cf7fe700 1 -- 172.21.15.133:0/2522630078 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c000bbe0 con 0x7f59d8070830 2023-10-08T16:04:21.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59cf7fe700 1 -- 172.21.15.133:0/2522630078 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c001be00 con 0x7f59d8070830 2023-10-08T16:04:21.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59dcd79700 1 -- 172.21.15.133:0/2522630078 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d8141eb0 con 0x7f59d8070830 2023-10-08T16:04:21.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59cf7fe700 1 -- 172.21.15.133:0/2522630078 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c0011650 con 0x7f59d8070830 2023-10-08T16:04:21.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.435+0000 7f59dcd79700 1 -- 172.21.15.133:0/2522630078 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d806e390 con 0x7f59d8070830 2023-10-08T16:04:21.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.439+0000 7f59dcd79700 1 -- 172.21.15.133:0/2522630078 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d804be40 con 0x7f59d8070830 2023-10-08T16:04:21.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.439+0000 7f59cf7fe700 1 -- 172.21.15.133:0/2522630078 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f59c0011a40 con 0x7f59d8070830 2023-10-08T16:04:21.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.439+0000 7f59cf7fe700 1 --2- 172.21.15.133:0/2522630078 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f59b8060580 0x7f59b8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:21.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.439+0000 7f59cf7fe700 1 -- 172.21.15.133:0/2522630078 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f59c007e030 con 0x7f59d8070830 2023-10-08T16:04:21.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.439+0000 7f59d6ffd700 1 --2- 172.21.15.133:0/2522630078 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f59b8060580 0x7f59b8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:21.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.443+0000 7f59d6ffd700 1 --2- 172.21.15.133:0/2522630078 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f59b8060580 0x7f59b8062a30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f59d81410a0 tx=0x7f59d0000f40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:21.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.447+0000 7f59cf7fe700 1 -- 172.21.15.133:0/2522630078 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f59c004e620 con 0x7f59d8070830 2023-10-08T16:04:21.465 INFO:tasks.ceph.mds.a.smithi133.stderr:2023-10-08T16:04:21.463+0000 7ff1d5d7d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:04:21.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.611+0000 7f59dcd79700 1 -- 172.21.15.133:0/2522630078 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59d80ae380 con 0x7f59d8070830 2023-10-08T16:04:21.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.611+0000 7f59cf7fe700 1 -- 172.21.15.133:0/2522630078 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f59c0015090 con 0x7f59d8070830 2023-10-08T16:04:21.615 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:04:21.615 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"f2546191-d59e-4805-8e1b-3d8d3d1dad86","created":"2023-10-08T16:03:52.631855+0000","modified":"2023-10-08T16:04:18.600728+0000","last_up_change":"2023-10-08T16:04:04.030581+0000","last_in_change":"2023-10-08T16:03:54.835293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:04.898316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:14.869859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:15.983795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8c5deadf-a203-4d30-aa7f-6e2e492b6ffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6809","nonce":33493},{"type":"v1","addr":"172.21.15.133:6811","nonce":33493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":33493},{"type":"v1","addr":"172.21.15.133:6815","nonce":33493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":33493},{"type":"v1","addr":"172.21.15.133:6822","nonce":33493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":33493},{"type":"v1","addr":"172.21.15.133:6818","nonce":33493}]},"public_addr":"172.21.15.133:6811/33493","cluster_addr":"172.21.15.133:6815/33493","heartbeat_back_addr":"172.21.15.133:6822/33493","heartbeat_front_addr":"172.21.15.133:6818/33493","state":["exists","up"]},{"osd":1,"uuid":"9b081c42-c915-48c3-a1ad-410f09a78576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":33490},{"type":"v1","addr":"172.21.15.133:6801","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":33490},{"type":"v1","addr":"172.21.15.133:6803","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":33490},{"type":"v1","addr":"172.21.15.133:6807","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":33490},{"type":"v1","addr":"172.21.15.133:6805","nonce":33490}]},"public_addr":"172.21.15.133:6801/33490","cluster_addr":"172.21.15.133:6803/33490","heartbeat_back_addr":"172.21.15.133:6807/33490","heartbeat_front_addr":"172.21.15.133:6805/33490","state":["exists","up"]},{"osd":2,"uuid":"88ecda43-01cd-4644-ab0c-92c91fd38966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":33492},{"type":"v1","addr":"172.21.15.133:6825","nonce":33492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":33492},{"type":"v1","addr":"172.21.15.133:6827","nonce":33492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":33492},{"type":"v1","addr":"172.21.15.133:6831","nonce":33492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":33492},{"type":"v1","addr":"172.21.15.133:6829","nonce":33492}]},"public_addr":"172.21.15.133:6825/33492","cluster_addr":"172.21.15.133:6827/33492","heartbeat_back_addr":"172.21.15.133:6831/33492","heartbeat_front_addr":"172.21.15.133:6829/33492","state":["exists","up"]},{"osd":3,"uuid":"39faf38d-b8e2-4e11-9b3b-84dc834c977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":33491},{"type":"v1","addr":"172.21.15.133:6810","nonce":33491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":33491},{"type":"v1","addr":"172.21.15.133:6814","nonce":33491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":33491},{"type":"v1","addr":"172.21.15.133:6823","nonce":33491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":33491},{"type":"v1","addr":"172.21.15.133:6819","nonce":33491}]},"public_addr":"172.21.15.133:6810/33491","cluster_addr":"172.21.15.133:6814/33491","heartbeat_back_addr":"172.21.15.133:6823/33491","heartbeat_front_addr":"172.21.15.133:6819/33491","state":["exists","up"]},{"osd":4,"uuid":"4c097e61-1cad-4b61-9183-4e7bc486bd32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":33678},{"type":"v1","addr":"172.21.15.190:6810","nonce":33678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":33678},{"type":"v1","addr":"172.21.15.190:6814","nonce":33678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":33678},{"type":"v1","addr":"172.21.15.190:6822","nonce":33678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":33678},{"type":"v1","addr":"172.21.15.190:6818","nonce":33678}]},"public_addr":"172.21.15.190:6810/33678","cluster_addr":"172.21.15.190:6814/33678","heartbeat_back_addr":"172.21.15.190:6822/33678","heartbeat_front_addr":"172.21.15.190:6818/33678","state":["exists","up"]},{"osd":5,"uuid":"05f072e0-7bc0-40f0-8cb6-8e322c82d6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":33676},{"type":"v1","addr":"172.21.15.190:6811","nonce":33676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":33676},{"type":"v1","addr":"172.21.15.190:6815","nonce":33676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":33676},{"type":"v1","addr":"172.21.15.190:6823","nonce":33676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":33676},{"type":"v1","addr":"172.21.15.190:6819","nonce":33676}]},"public_addr":"172.21.15.190:6811/33676","cluster_addr":"172.21.15.190:6815/33676","heartbeat_back_addr":"172.21.15.190:6823/33676","heartbeat_front_addr":"172.21.15.190:6819/33676","state":["exists","up"]},{"osd":6,"uuid":"1bcce8d7-14f3-442d-b135-68c7d66cdedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":33677},{"type":"v1","addr":"172.21.15.190:6801","nonce":33677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":33677},{"type":"v1","addr":"172.21.15.190:6803","nonce":33677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":33677},{"type":"v1","addr":"172.21.15.190:6807","nonce":33677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":33677},{"type":"v1","addr":"172.21.15.190:6805","nonce":33677}]},"public_addr":"172.21.15.190:6801/33677","cluster_addr":"172.21.15.190:6803/33677","heartbeat_back_addr":"172.21.15.190:6807/33677","heartbeat_front_addr":"172.21.15.190:6805/33677","state":["exists","up"]},{"osd":7,"uuid":"9157dbf7-2bf9-43d7-a89a-a8e3dae7514c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":33686},{"type":"v1","addr":"172.21.15.190:6825","nonce":33686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":33686},{"type":"v1","addr":"172.21.15.190:6827","nonce":33686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":33686},{"type":"v1","addr":"172.21.15.190:6831","nonce":33686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":33686},{"type":"v1","addr":"172.21.15.190:6829","nonce":33686}]},"public_addr":"172.21.15.190:6825/33686","cluster_addr":"172.21.15.190:6827/33686","heartbeat_back_addr":"172.21.15.190:6831/33686","heartbeat_front_addr":"172.21.15.190:6829/33686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.886742+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.199618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.871695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.115926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.069650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.841448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.132320+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.315132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:04:21.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.615+0000 7f59dcd79700 1 -- 172.21.15.133:0/2522630078 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f59b8060580 msgr2=0x7f59b8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:21.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.615+0000 7f59dcd79700 1 --2- 172.21.15.133:0/2522630078 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f59b8060580 0x7f59b8062a30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f59d81410a0 tx=0x7f59d0000f40 comp rx=0 tx=0).stop 2023-10-08T16:04:21.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.615+0000 7f59dcd79700 1 -- 172.21.15.133:0/2522630078 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59d8070830 msgr2=0x7f59d806bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:21.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.615+0000 7f59dcd79700 1 --2- 172.21.15.133:0/2522630078 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59d8070830 0x7f59d806bbe0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f59d8069c10 tx=0x7f59c0017000 comp rx=0 tx=0).stop 2023-10-08T16:04:21.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.615+0000 7f59dcd79700 1 -- 172.21.15.133:0/2522630078 shutdown_connections 2023-10-08T16:04:21.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.615+0000 7f59dcd79700 1 --2- 172.21.15.133:0/2522630078 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f59b8060580 0x7f59b8062a30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.615+0000 7f59dcd79700 1 --2- 172.21.15.133:0/2522630078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d80b2140 0x7f59d80a7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.615+0000 7f59dcd79700 1 --2- 172.21.15.133:0/2522630078 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59d8070c00 0x7f59d806c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.615+0000 7f59dcd79700 1 --2- 172.21.15.133:0/2522630078 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59d8070830 0x7f59d806bbe0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.615+0000 7f59dcd79700 1 -- 172.21.15.133:0/2522630078 >> 172.21.15.133:0/2522630078 conn(0x7f59d8066f90 msgr2=0x7f59d80b1700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:21.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.615+0000 7f59dcd79700 1 -- 172.21.15.133:0/2522630078 shutdown_connections 2023-10-08T16:04:21.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.615+0000 7f59dcd79700 1 -- 172.21.15.133:0/2522630078 wait complete. 2023-10-08T16:04:21.634 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-08T16:04:21.635 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:04:21.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.739+0000 7f1b3f38f700 1 Processor -- start 2023-10-08T16:04:21.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3f38f700 1 -- start start 2023-10-08T16:04:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3f38f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b380687a0 0x7f1b380ab730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3f38f700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1b380ae5b0 0x7f1b380ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3f38f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1b38067ce0 0x7f1b38142100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3f38f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b380ac7b0 con 0x7f1b38067ce0 2023-10-08T16:04:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3f38f700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b380aca90 con 0x7f1b380ae5b0 2023-10-08T16:04:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3f38f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b380ade40 con 0x7f1b380687a0 2023-10-08T16:04:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3d92c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1b38067ce0 0x7f1b38142100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3d92c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1b38067ce0 0x7f1b38142100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42684/0 (socket says 172.21.15.133:42684) 2023-10-08T16:04:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3d92c700 1 -- 172.21.15.133:0/272279737 learned_addr learned my addr 172.21.15.133:0/272279737 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3c92a700 1 --2- 172.21.15.133:0/272279737 >> v2:172.21.15.190:3300/0 conn(0x7f1b380ae5b0 0x7f1b380ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3d92c700 1 -- 172.21.15.133:0/272279737 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b380687a0 msgr2=0x7f1b380ab730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3d92c700 1 --2- 172.21.15.133:0/272279737 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b380687a0 0x7f1b380ab730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3d92c700 1 -- 172.21.15.133:0/272279737 >> v2:172.21.15.190:3300/0 conn(0x7f1b380ae5b0 msgr2=0x7f1b380ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3d92c700 1 --2- 172.21.15.133:0/272279737 >> v2:172.21.15.190:3300/0 conn(0x7f1b380ae5b0 0x7f1b380ae9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3d92c700 1 -- 172.21.15.133:0/272279737 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b380b0c60 con 0x7f1b38067ce0 2023-10-08T16:04:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3c92a700 1 --2- 172.21.15.133:0/272279737 >> v2:172.21.15.190:3300/0 conn(0x7f1b380ae5b0 0x7f1b380ae9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:04:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3d92c700 1 --2- 172.21.15.133:0/272279737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b38067ce0 0x7f1b38142100 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b380b5880 tx=0x7f1b3000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba059c5824a34716 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b2ffff700 1 -- 172.21.15.133:0/272279737 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30010070 con 0x7f1b38067ce0 2023-10-08T16:04:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b2ffff700 1 -- 172.21.15.133:0/272279737 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3000de90 con 0x7f1b38067ce0 2023-10-08T16:04:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b2ffff700 1 -- 172.21.15.133:0/272279737 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3000b320 con 0x7f1b38067ce0 2023-10-08T16:04:21.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3f38f700 1 -- 172.21.15.133:0/272279737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b38067ce0 msgr2=0x7f1b38142100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:21.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3f38f700 1 --2- 172.21.15.133:0/272279737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b38067ce0 0x7f1b38142100 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b380b5880 tx=0x7f1b3000ba50 comp rx=0 tx=0).stop 2023-10-08T16:04:21.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3f38f700 1 -- 172.21.15.133:0/272279737 shutdown_connections 2023-10-08T16:04:21.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3f38f700 1 --2- 172.21.15.133:0/272279737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b38067ce0 0x7f1b38142100 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3f38f700 1 --2- 172.21.15.133:0/272279737 >> v2:172.21.15.190:3300/0 conn(0x7f1b380ae5b0 0x7f1b380ae9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3f38f700 1 --2- 172.21.15.133:0/272279737 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b380687a0 0x7f1b380ab730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3f38f700 1 -- 172.21.15.133:0/272279737 >> 172.21.15.133:0/272279737 conn(0x7f1b380b4ba0 msgr2=0x7f1b380b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:21.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3f38f700 1 -- 172.21.15.133:0/272279737 shutdown_connections 2023-10-08T16:04:21.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.743+0000 7f1b3f38f700 1 -- 172.21.15.133:0/272279737 wait complete. 2023-10-08T16:04:21.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.747+0000 7f1b3f38f700 1 Processor -- start 2023-10-08T16:04:21.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.747+0000 7f1b3f38f700 1 -- start start 2023-10-08T16:04:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.747+0000 7f1b3f38f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b38067ce0 0x7f1b38155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.747+0000 7f1b3f38f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b380687a0 0x7f1b3811cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.747+0000 7f1b3f38f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b380ae5b0 0x7f1b38152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.747+0000 7f1b3f38f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b38151fc0 con 0x7f1b380687a0 2023-10-08T16:04:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.747+0000 7f1b3f38f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b38155fc0 con 0x7f1b380ae5b0 2023-10-08T16:04:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.747+0000 7f1b3f38f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b381562a0 con 0x7f1b38067ce0 2023-10-08T16:04:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.747+0000 7f1b3c92a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b380687a0 0x7f1b3811cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.747+0000 7f1b3c92a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b380687a0 0x7f1b3811cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42686/0 (socket says 172.21.15.133:42686) 2023-10-08T16:04:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.747+0000 7f1b3c92a700 1 -- 172.21.15.133:0/1294108034 learned_addr learned my addr 172.21.15.133:0/1294108034 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.747+0000 7f1b3d92c700 1 --2- 172.21.15.133:0/1294108034 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b380ae5b0 0x7f1b38152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.747+0000 7f1b3d12b700 1 --2- 172.21.15.133:0/1294108034 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b38067ce0 0x7f1b38155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.747+0000 7f1b3c92a700 1 -- 172.21.15.133:0/1294108034 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b38067ce0 msgr2=0x7f1b38155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.747+0000 7f1b3c92a700 1 --2- 172.21.15.133:0/1294108034 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b38067ce0 0x7f1b38155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.747+0000 7f1b3c92a700 1 -- 172.21.15.133:0/1294108034 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b380ae5b0 msgr2=0x7f1b38152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.747+0000 7f1b3c92a700 1 --2- 172.21.15.133:0/1294108034 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b380ae5b0 0x7f1b38152450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.747+0000 7f1b3c92a700 1 -- 172.21.15.133:0/1294108034 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3000bcf0 con 0x7f1b380687a0 2023-10-08T16:04:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.747+0000 7f1b3d12b700 1 --2- 172.21.15.133:0/1294108034 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b38067ce0 0x7f1b38155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:04:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.747+0000 7f1b3c92a700 1 --2- 172.21.15.133:0/1294108034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b380687a0 0x7f1b3811cf10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800c850 tx=0x7f1b28008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.747+0000 7f1b2d7fa700 1 -- 172.21.15.133:0/1294108034 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28011600 con 0x7f1b380687a0 2023-10-08T16:04:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.747+0000 7f1b2d7fa700 1 -- 172.21.15.133:0/1294108034 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b28011760 con 0x7f1b380687a0 2023-10-08T16:04:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.747+0000 7f1b3f38f700 1 -- 172.21.15.133:0/1294108034 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3811c7f0 con 0x7f1b380687a0 2023-10-08T16:04:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.747+0000 7f1b2d7fa700 1 -- 172.21.15.133:0/1294108034 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28011b00 con 0x7f1b380687a0 2023-10-08T16:04:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.747+0000 7f1b3f38f700 1 -- 172.21.15.133:0/1294108034 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b38152990 con 0x7f1b380687a0 2023-10-08T16:04:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.751+0000 7f1b3f38f700 1 -- 172.21.15.133:0/1294108034 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b38152130 con 0x7f1b380687a0 2023-10-08T16:04:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.751+0000 7f1b2d7fa700 1 -- 172.21.15.133:0/1294108034 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1b28023480 con 0x7f1b380687a0 2023-10-08T16:04:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.751+0000 7f1b2d7fa700 1 --2- 172.21.15.133:0/1294108034 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f1b1c060550 0x7f1b1c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.751+0000 7f1b2d7fa700 1 -- 172.21.15.133:0/1294108034 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1b2807cb80 con 0x7f1b380687a0 2023-10-08T16:04:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.751+0000 7f1b3d12b700 1 --2- 172.21.15.133:0/1294108034 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f1b1c060550 0x7f1b1c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.751+0000 7f1b3d12b700 1 --2- 172.21.15.133:0/1294108034 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f1b1c060550 0x7f1b1c062a00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1b34006fd0 tx=0x7f1b34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.759+0000 7f1b2d7fa700 1 -- 172.21.15.133:0/1294108034 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1b2804d1f0 con 0x7f1b380687a0 2023-10-08T16:04:21.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.919+0000 7f1b3f38f700 1 -- 172.21.15.133:0/1294108034 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b38064810 con 0x7f1b380687a0 2023-10-08T16:04:21.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.923+0000 7f1b2d7fa700 1 -- 172.21.15.133:0/1294108034 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f1b28050810 con 0x7f1b380687a0 2023-10-08T16:04:21.925 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:04:21.925 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"f2546191-d59e-4805-8e1b-3d8d3d1dad86","created":"2023-10-08T16:03:52.631855+0000","modified":"2023-10-08T16:04:18.600728+0000","last_up_change":"2023-10-08T16:04:04.030581+0000","last_in_change":"2023-10-08T16:03:54.835293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:04.898316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:14.869859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:15.983795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8c5deadf-a203-4d30-aa7f-6e2e492b6ffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6809","nonce":33493},{"type":"v1","addr":"172.21.15.133:6811","nonce":33493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":33493},{"type":"v1","addr":"172.21.15.133:6815","nonce":33493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":33493},{"type":"v1","addr":"172.21.15.133:6822","nonce":33493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":33493},{"type":"v1","addr":"172.21.15.133:6818","nonce":33493}]},"public_addr":"172.21.15.133:6811/33493","cluster_addr":"172.21.15.133:6815/33493","heartbeat_back_addr":"172.21.15.133:6822/33493","heartbeat_front_addr":"172.21.15.133:6818/33493","state":["exists","up"]},{"osd":1,"uuid":"9b081c42-c915-48c3-a1ad-410f09a78576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":33490},{"type":"v1","addr":"172.21.15.133:6801","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":33490},{"type":"v1","addr":"172.21.15.133:6803","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":33490},{"type":"v1","addr":"172.21.15.133:6807","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":33490},{"type":"v1","addr":"172.21.15.133:6805","nonce":33490}]},"public_addr":"172.21.15.133:6801/33490","cluster_addr":"172.21.15.133:6803/33490","heartbeat_back_addr":"172.21.15.133:6807/33490","heartbeat_front_addr":"172.21.15.133:6805/33490","state":["exists","up"]},{"osd":2,"uuid":"88ecda43-01cd-4644-ab0c-92c91fd38966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":33492},{"type":"v1","addr":"172.21.15.133:6825","nonce":33492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":33492},{"type":"v1","addr":"172.21.15.133:6827","nonce":33492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":33492},{"type":"v1","addr":"172.21.15.133:6831","nonce":33492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":33492},{"type":"v1","addr":"172.21.15.133:6829","nonce":33492}]},"public_addr":"172.21.15.133:6825/33492","cluster_addr":"172.21.15.133:6827/33492","heartbeat_back_addr":"172.21.15.133:6831/33492","heartbeat_front_addr":"172.21.15.133:6829/33492","state":["exists","up"]},{"osd":3,"uuid":"39faf38d-b8e2-4e11-9b3b-84dc834c977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":33491},{"type":"v1","addr":"172.21.15.133:6810","nonce":33491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":33491},{"type":"v1","addr":"172.21.15.133:6814","nonce":33491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":33491},{"type":"v1","addr":"172.21.15.133:6823","nonce":33491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":33491},{"type":"v1","addr":"172.21.15.133:6819","nonce":33491}]},"public_addr":"172.21.15.133:6810/33491","cluster_addr":"172.21.15.133:6814/33491","heartbeat_back_addr":"172.21.15.133:6823/33491","heartbeat_front_addr":"172.21.15.133:6819/33491","state":["exists","up"]},{"osd":4,"uuid":"4c097e61-1cad-4b61-9183-4e7bc486bd32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":33678},{"type":"v1","addr":"172.21.15.190:6810","nonce":33678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":33678},{"type":"v1","addr":"172.21.15.190:6814","nonce":33678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":33678},{"type":"v1","addr":"172.21.15.190:6822","nonce":33678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":33678},{"type":"v1","addr":"172.21.15.190:6818","nonce":33678}]},"public_addr":"172.21.15.190:6810/33678","cluster_addr":"172.21.15.190:6814/33678","heartbeat_back_addr":"172.21.15.190:6822/33678","heartbeat_front_addr":"172.21.15.190:6818/33678","state":["exists","up"]},{"osd":5,"uuid":"05f072e0-7bc0-40f0-8cb6-8e322c82d6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":33676},{"type":"v1","addr":"172.21.15.190:6811","nonce":33676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":33676},{"type":"v1","addr":"172.21.15.190:6815","nonce":33676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":33676},{"type":"v1","addr":"172.21.15.190:6823","nonce":33676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":33676},{"type":"v1","addr":"172.21.15.190:6819","nonce":33676}]},"public_addr":"172.21.15.190:6811/33676","cluster_addr":"172.21.15.190:6815/33676","heartbeat_back_addr":"172.21.15.190:6823/33676","heartbeat_front_addr":"172.21.15.190:6819/33676","state":["exists","up"]},{"osd":6,"uuid":"1bcce8d7-14f3-442d-b135-68c7d66cdedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":33677},{"type":"v1","addr":"172.21.15.190:6801","nonce":33677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":33677},{"type":"v1","addr":"172.21.15.190:6803","nonce":33677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":33677},{"type":"v1","addr":"172.21.15.190:6807","nonce":33677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":33677},{"type":"v1","addr":"172.21.15.190:6805","nonce":33677}]},"public_addr":"172.21.15.190:6801/33677","cluster_addr":"172.21.15.190:6803/33677","heartbeat_back_addr":"172.21.15.190:6807/33677","heartbeat_front_addr":"172.21.15.190:6805/33677","state":["exists","up"]},{"osd":7,"uuid":"9157dbf7-2bf9-43d7-a89a-a8e3dae7514c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":33686},{"type":"v1","addr":"172.21.15.190:6825","nonce":33686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":33686},{"type":"v1","addr":"172.21.15.190:6827","nonce":33686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":33686},{"type":"v1","addr":"172.21.15.190:6831","nonce":33686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":33686},{"type":"v1","addr":"172.21.15.190:6829","nonce":33686}]},"public_addr":"172.21.15.190:6825/33686","cluster_addr":"172.21.15.190:6827/33686","heartbeat_back_addr":"172.21.15.190:6831/33686","heartbeat_front_addr":"172.21.15.190:6829/33686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.886742+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.199618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.871695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.115926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.069650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.841448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.132320+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.315132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:04:21.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.923+0000 7f1b3f38f700 1 -- 172.21.15.133:0/1294108034 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f1b1c060550 msgr2=0x7f1b1c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:21.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.923+0000 7f1b3f38f700 1 --2- 172.21.15.133:0/1294108034 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f1b1c060550 0x7f1b1c062a00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1b34006fd0 tx=0x7f1b34008040 comp rx=0 tx=0).stop 2023-10-08T16:04:21.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.923+0000 7f1b3f38f700 1 -- 172.21.15.133:0/1294108034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b380687a0 msgr2=0x7f1b3811cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:21.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.923+0000 7f1b3f38f700 1 --2- 172.21.15.133:0/1294108034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b380687a0 0x7f1b3811cf10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800c850 tx=0x7f1b28008040 comp rx=0 tx=0).stop 2023-10-08T16:04:21.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.923+0000 7f1b3f38f700 1 -- 172.21.15.133:0/1294108034 shutdown_connections 2023-10-08T16:04:21.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.923+0000 7f1b3f38f700 1 --2- 172.21.15.133:0/1294108034 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f1b1c060550 0x7f1b1c062a00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.923+0000 7f1b3f38f700 1 --2- 172.21.15.133:0/1294108034 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b380ae5b0 0x7f1b38152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.923+0000 7f1b3f38f700 1 --2- 172.21.15.133:0/1294108034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b380687a0 0x7f1b3811cf10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.923+0000 7f1b3f38f700 1 --2- 172.21.15.133:0/1294108034 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b38067ce0 0x7f1b38155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:21.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.923+0000 7f1b3f38f700 1 -- 172.21.15.133:0/1294108034 >> 172.21.15.133:0/1294108034 conn(0x7f1b380b4ba0 msgr2=0x7f1b3813b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:21.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.923+0000 7f1b3f38f700 1 -- 172.21.15.133:0/1294108034 shutdown_connections 2023-10-08T16:04:21.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:21.923+0000 7f1b3f38f700 1 -- 172.21.15.133:0/1294108034 wait complete. 2023-10-08T16:04:21.940 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-08T16:04:21.940 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-08T16:04:21.940 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-08T16:04:21.941 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-08T16:04:21.941 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-08T16:04:21.941 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-08T16:04:21.942 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-08T16:04:21.942 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-08T16:04:22.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.075+0000 7fe0b5e19700 1 Processor -- start 2023-10-08T16:04:22.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.075+0000 7fe0b5e19700 1 -- start start 2023-10-08T16:04:22.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.075+0000 7fe0b5e19700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0b0067ea0 0x7fe0b00ad300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.075+0000 7fe0b5e19700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0b00af770 0x7fe0b006e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.075+0000 7fe0b5e19700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b00ae8e0 con 0x7fe0b00af380 2023-10-08T16:04:22.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.075+0000 7fe0b5e19700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b00afba0 con 0x7fe0b00af770 2023-10-08T16:04:22.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.075+0000 7fe0b5e19700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b00aed70 con 0x7fe0b0067ea0 2023-10-08T16:04:22.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.079+0000 7fe0b5618700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0b00af770 0x7fe0b006e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.079+0000 7fe0b5618700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0b00af770 0x7fe0b006e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42690/0 (socket says 172.21.15.133:42690) 2023-10-08T16:04:22.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.079+0000 7fe0b5618700 1 -- 172.21.15.133:0/480991900 learned_addr learned my addr 172.21.15.133:0/480991900 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.079+0000 7fe0b5618700 1 -- 172.21.15.133:0/480991900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0b0067ea0 msgr2=0x7fe0b00ad300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:22.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.079+0000 7fe0b5618700 1 --2- 172.21.15.133:0/480991900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0b0067ea0 0x7fe0b00ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.079+0000 7fe0b5618700 1 -- 172.21.15.133:0/480991900 >> v1:172.21.15.190:6789/0 conn(0x7fe0b00af380 legacy=0x7fe0b006dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.079+0000 7fe0b5618700 1 -- 172.21.15.133:0/480991900 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b00ad960 con 0x7fe0b00af770 2023-10-08T16:04:22.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.079+0000 7fe0b5618700 1 --2- 172.21.15.133:0/480991900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b00af770 0x7fe0b006e5f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00089b0 tx=0x7fe0a00082d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f725ecd1d995b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.079+0000 7fe0af7fe700 1 -- 172.21.15.133:0/480991900 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0010070 con 0x7fe0b00af770 2023-10-08T16:04:22.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.079+0000 7fe0af7fe700 1 -- 172.21.15.133:0/480991900 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a000da30 con 0x7fe0b00af770 2023-10-08T16:04:22.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.079+0000 7fe0af7fe700 1 -- 172.21.15.133:0/480991900 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a000ddf0 con 0x7fe0b00af770 2023-10-08T16:04:22.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.079+0000 7fe0b5e19700 1 -- 172.21.15.133:0/480991900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b00af770 msgr2=0x7fe0b006e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.079+0000 7fe0b5e19700 1 --2- 172.21.15.133:0/480991900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b00af770 0x7fe0b006e5f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00089b0 tx=0x7fe0a00082d0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.079+0000 7fe0b5e19700 1 -- 172.21.15.133:0/480991900 shutdown_connections 2023-10-08T16:04:22.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.079+0000 7fe0b5e19700 1 --2- 172.21.15.133:0/480991900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b00af770 0x7fe0b006e5f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.079+0000 7fe0b5e19700 1 --2- 172.21.15.133:0/480991900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0b0067ea0 0x7fe0b00ad300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.079+0000 7fe0b5e19700 1 -- 172.21.15.133:0/480991900 >> 172.21.15.133:0/480991900 conn(0x7fe0b00636b0 msgr2=0x7fe0b00b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.079+0000 7fe0b5e19700 1 -- 172.21.15.133:0/480991900 shutdown_connections 2023-10-08T16:04:22.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.079+0000 7fe0b5e19700 1 -- 172.21.15.133:0/480991900 wait complete. 2023-10-08T16:04:22.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe0b5e19700 1 Processor -- start 2023-10-08T16:04:22.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7f9303fff700 1 Processor -- start 2023-10-08T16:04:22.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7f9303fff700 1 -- start start 2023-10-08T16:04:22.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.079+0000 7fe4b3f20700 1 Processor -- start 2023-10-08T16:04:22.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe0b5e19700 1 -- start start 2023-10-08T16:04:22.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.079+0000 7fe4b3f20700 1 -- start start 2023-10-08T16:04:22.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b3f20700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4ac14a270 0x7fe4ac14a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b3f20700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe4ac14ab80 0x7fe4ac0adf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b3f20700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe4ac0ae4c0 0x7fe4ac0b2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b3f20700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ac06e910 con 0x7fe4ac0ae4c0 2023-10-08T16:04:22.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b3f20700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ac0ad530 con 0x7fe4ac14ab80 2023-10-08T16:04:22.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b3f20700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac0adaf0 con 0x7fe4ac14a270 2023-10-08T16:04:22.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fcddd805700 1 Processor -- start 2023-10-08T16:04:22.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fcddd805700 1 -- start start 2023-10-08T16:04:22.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7f9303fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f93040aea60 0x7f93040ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7f9303fff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f93040b0050 0x7f93040b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7f9303fff700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93040ac420 con 0x7f9304087510 2023-10-08T16:04:22.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7f9303fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93040ac700 con 0x7f93040aea60 2023-10-08T16:04:22.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7f9303fff700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93040addc0 con 0x7f93040b0050 2023-10-08T16:04:22.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7f9302ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f93040aea60 0x7f93040ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7f9302ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f93040aea60 0x7f93040ae2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42714/0 (socket says 172.21.15.133:42714) 2023-10-08T16:04:22.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7f93027fc700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f93040b0050 0x7f93040b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7f9302ffd700 1 -- 172.21.15.133:0/4219571781 learned_addr learned my addr 172.21.15.133:0/4219571781 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe0b5e19700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b0067ea0 0x7fe0b013bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe0b5e19700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0b00af380 0x7fe0b01441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe0b5e19700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0b00af770 0x7fe0b01446e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe0b5e19700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b0142090 con 0x7fe0b0067ea0 2023-10-08T16:04:22.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe0b5e19700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b0143630 con 0x7fe0b00af770 2023-10-08T16:04:22.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe0b5e19700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b0141a80 con 0x7fe0b00af380 2023-10-08T16:04:22.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe0b5618700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0b00af770 0x7fe0b01446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe0b5618700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0b00af770 0x7fe0b01446e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.133:53236/0 (socket says 172.21.15.133:53236) 2023-10-08T16:04:22.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe0b5618700 1 -- 172.21.15.133:0/656883556 learned_addr learned my addr 172.21.15.133:0/656883556 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe0b4e17700 1 --2- 172.21.15.133:0/656883556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b0067ea0 0x7fe0b013bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe0affff700 1 --2- 172.21.15.133:0/656883556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0b00af380 0x7fe0b01441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fcddd805700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcdd8069410 0x7fcdd80b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fcddd805700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcdd8142680 0x7fcdd8068360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fcddd805700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd80ad9b0 con 0x7fcdd8142230 2023-10-08T16:04:22.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fcddd805700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd8142ae0 con 0x7fcdd8142680 2023-10-08T16:04:22.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fcddd805700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd8141de0 con 0x7fcdd8069410 2023-10-08T16:04:22.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b24bd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe4ac0ae4c0 0x7fe4ac0b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b24bd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe4ac0ae4c0 0x7fe4ac0b2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42702/0 (socket says 172.21.15.133:42702) 2023-10-08T16:04:22.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b24bd700 1 -- 172.21.15.133:0/1145034963 learned_addr learned my addr 172.21.15.133:0/1145034963 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b14bb700 1 --2- 172.21.15.133:0/1145034963 >> v2:172.21.15.190:3300/0 conn(0x7fe4ac14ab80 0x7fe4ac0adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b24bd700 1 -- 172.21.15.133:0/1145034963 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4ac14a270 msgr2=0x7fe4ac14a640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T16:04:22.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b24bd700 1 --2- 172.21.15.133:0/1145034963 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4ac14a270 0x7fe4ac14a640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b24bd700 1 -- 172.21.15.133:0/1145034963 >> v2:172.21.15.190:3300/0 conn(0x7fe4ac14ab80 msgr2=0x7fe4ac0adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:22.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b24bd700 1 --2- 172.21.15.133:0/1145034963 >> v2:172.21.15.190:3300/0 conn(0x7fe4ac14ab80 0x7fe4ac0adf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b24bd700 1 -- 172.21.15.133:0/1145034963 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ac0ac080 con 0x7fe4ac0ae4c0 2023-10-08T16:04:22.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b24bd700 1 --2- 172.21.15.133:0/1145034963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ac0ae4c0 0x7fe4ac0b2790 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac069fd0 tx=0x7fe4a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d7cbccd3ace26b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b0cba700 1 -- 172.21.15.133:0/1145034963 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8009e70 con 0x7fe4ac0ae4c0 2023-10-08T16:04:22.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b0cba700 1 -- 172.21.15.133:0/1145034963 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a800b860 con 0x7fe4ac0ae4c0 2023-10-08T16:04:22.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b0cba700 1 -- 172.21.15.133:0/1145034963 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a800bc00 con 0x7fe4ac0ae4c0 2023-10-08T16:04:22.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7f9302ffd700 1 -- 172.21.15.133:0/4219571781 >> v2:172.21.15.190:3300/0 conn(0x7f93040b0050 msgr2=0x7f93040b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:22.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7f9302ffd700 1 --2- 172.21.15.133:0/4219571781 >> v2:172.21.15.190:3300/0 conn(0x7f93040b0050 0x7f93040b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7f9302ffd700 1 -- 172.21.15.133:0/4219571781 >> v1:172.21.15.190:6789/0 conn(0x7f9304087510 legacy=0x7f9304067c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7f9302ffd700 1 -- 172.21.15.133:0/4219571781 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93040b0440 con 0x7f93040aea60 2023-10-08T16:04:22.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fcdd77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcdd8142680 0x7fcdd8068360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fcdd77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcdd8142680 0x7fcdd8068360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42736/0 (socket says 172.21.15.133:42736) 2023-10-08T16:04:22.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fcdd77fe700 1 -- 172.21.15.133:0/3466193919 learned_addr learned my addr 172.21.15.133:0/3466193919 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7f9302ffd700 1 --2- 172.21.15.133:0/4219571781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93040aea60 0x7f93040ae2e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f93040b0ca0 tx=0x7f92f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b815a5b64a1b149 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fcdd6ffd700 1 --2- 172.21.15.133:0/3466193919 >> v2:172.21.15.190:3300/0 conn(0x7fcdd8069410 0x7fcdd80b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7f9301ffb700 1 -- 172.21.15.133:0/4219571781 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f4009e70 con 0x7f93040aea60 2023-10-08T16:04:22.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7f9301ffb700 1 -- 172.21.15.133:0/4219571781 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f400b860 con 0x7f93040aea60 2023-10-08T16:04:22.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7f9301ffb700 1 -- 172.21.15.133:0/4219571781 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f400bc00 con 0x7f93040aea60 2023-10-08T16:04:22.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fcdd77fe700 1 -- 172.21.15.133:0/3466193919 >> v2:172.21.15.190:3300/0 conn(0x7fcdd8069410 msgr2=0x7fcdd80b50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:22.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fcdd77fe700 1 --2- 172.21.15.133:0/3466193919 >> v2:172.21.15.190:3300/0 conn(0x7fcdd8069410 0x7fcdd80b50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fcdd77fe700 1 -- 172.21.15.133:0/3466193919 >> v1:172.21.15.190:6789/0 conn(0x7fcdd8142230 legacy=0x7fcdd8067c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:22.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fcdd77fe700 1 -- 172.21.15.133:0/3466193919 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd80acf60 con 0x7fcdd8142680 2023-10-08T16:04:22.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b3f20700 1 -- 172.21.15.133:0/1145034963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ac0ae4c0 msgr2=0x7fe4ac0b2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b3f20700 1 --2- 172.21.15.133:0/1145034963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ac0ae4c0 0x7fe4ac0b2790 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac069fd0 tx=0x7fe4a8009250 comp rx=0 tx=0).stop 2023-10-08T16:04:22.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe0affff700 1 -- 172.21.15.133:0/656883556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0b00af770 msgr2=0x7fe0b01446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe0affff700 1 --2- 172.21.15.133:0/656883556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0b00af770 0x7fe0b01446e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe0affff700 1 -- 172.21.15.133:0/656883556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b0067ea0 msgr2=0x7fe0b013bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe0affff700 1 --2- 172.21.15.133:0/656883556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b0067ea0 0x7fe0b013bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe0affff700 1 -- 172.21.15.133:0/656883556 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a0008570 con 0x7fe0b00af380 2023-10-08T16:04:22.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b3f20700 1 -- 172.21.15.133:0/1145034963 shutdown_connections 2023-10-08T16:04:22.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b3f20700 1 --2- 172.21.15.133:0/1145034963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ac0ae4c0 0x7fe4ac0b2790 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b3f20700 1 --2- 172.21.15.133:0/1145034963 >> v2:172.21.15.190:3300/0 conn(0x7fe4ac14ab80 0x7fe4ac0adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b3f20700 1 --2- 172.21.15.133:0/1145034963 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4ac14a270 0x7fe4ac14a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b3f20700 1 -- 172.21.15.133:0/1145034963 >> 172.21.15.133:0/1145034963 conn(0x7fe4ac0b4990 msgr2=0x7fe4ac0b4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fcdd77fe700 1 --2- 172.21.15.133:0/3466193919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdd8142680 0x7fcdd8068360 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80b5900 tx=0x7fcdd0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd0309a1f0d22205 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b3f20700 1 -- 172.21.15.133:0/1145034963 shutdown_connections 2023-10-08T16:04:22.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe0affff700 1 --2- 172.21.15.133:0/656883556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0b00af380 0x7fe0b01441a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe0a800c910 tx=0x7fe0a8001710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fcdd5ffb700 1 -- 172.21.15.133:0/3466193919 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd000e070 con 0x7fcdd8142680 2023-10-08T16:04:22.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fcdd5ffb700 1 -- 172.21.15.133:0/3466193919 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd000ba10 con 0x7fcdd8142680 2023-10-08T16:04:22.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe0acff9700 1 -- 172.21.15.133:0/656883556 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8012630 con 0x7fe0b00af380 2023-10-08T16:04:22.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fe0acff9700 1 -- 172.21.15.133:0/656883556 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a8012790 con 0x7fe0b00af380 2023-10-08T16:04:22.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fe0acff9700 1 -- 172.21.15.133:0/656883556 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8012b50 con 0x7fe0b00af380 2023-10-08T16:04:22.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fe0b5e19700 1 -- 172.21.15.133:0/656883556 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b0143910 con 0x7fe0b00af380 2023-10-08T16:04:22.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fe0b5e19700 1 -- 172.21.15.133:0/656883556 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b01432b0 con 0x7fe0b00af380 2023-10-08T16:04:22.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f9303fff700 1 -- 172.21.15.133:0/4219571781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93040aea60 msgr2=0x7f93040ae2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f9303fff700 1 --2- 172.21.15.133:0/4219571781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93040aea60 0x7f93040ae2e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f93040b0ca0 tx=0x7f92f4009250 comp rx=0 tx=0).stop 2023-10-08T16:04:22.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.083+0000 7fe4b3f20700 1 -- 172.21.15.133:0/1145034963 wait complete. 2023-10-08T16:04:22.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f9303fff700 1 -- 172.21.15.133:0/4219571781 shutdown_connections 2023-10-08T16:04:22.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f9303fff700 1 --2- 172.21.15.133:0/4219571781 >> v2:172.21.15.190:3300/0 conn(0x7f93040b0050 0x7f93040b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f9303fff700 1 --2- 172.21.15.133:0/4219571781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93040aea60 0x7f93040ae2e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f9303fff700 1 -- 172.21.15.133:0/4219571781 >> 172.21.15.133:0/4219571781 conn(0x7f93040636b0 msgr2=0x7f93040b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fcdd5ffb700 1 -- 172.21.15.133:0/3466193919 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd00092e0 con 0x7fcdd8142680 2023-10-08T16:04:22.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fcddd805700 1 -- 172.21.15.133:0/3466193919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdd8142680 msgr2=0x7fcdd8068360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fcddd805700 1 --2- 172.21.15.133:0/3466193919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdd8142680 0x7fcdd8068360 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80b5900 tx=0x7fcdd0009840 comp rx=0 tx=0).stop 2023-10-08T16:04:22.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f9303fff700 1 -- 172.21.15.133:0/4219571781 shutdown_connections 2023-10-08T16:04:22.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f9303fff700 1 -- 172.21.15.133:0/4219571781 wait complete. 2023-10-08T16:04:22.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fe4b3f20700 1 Processor -- start 2023-10-08T16:04:22.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fe0b5e19700 1 -- 172.21.15.133:0/656883556 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe090000fd0 con 0x7fe0b00af380 2023-10-08T16:04:22.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fe4b3f20700 1 -- start start 2023-10-08T16:04:22.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fcddd805700 1 -- 172.21.15.133:0/3466193919 shutdown_connections 2023-10-08T16:04:22.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fcddd805700 1 --2- 172.21.15.133:0/3466193919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdd8142680 0x7fcdd8068360 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fcddd805700 1 --2- 172.21.15.133:0/3466193919 >> v2:172.21.15.190:3300/0 conn(0x7fcdd8069410 0x7fcdd80b50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fcddd805700 1 -- 172.21.15.133:0/3466193919 >> 172.21.15.133:0/3466193919 conn(0x7fcdd8063670 msgr2=0x7fcdd80b4990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fcddd805700 1 -- 172.21.15.133:0/3466193919 shutdown_connections 2023-10-08T16:04:22.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fcddd805700 1 -- 172.21.15.133:0/3466193919 wait complete. 2023-10-08T16:04:22.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f9303fff700 1 Processor -- start 2023-10-08T16:04:22.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f9303fff700 1 -- start start 2023-10-08T16:04:22.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fe4b3f20700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4ac0ae4c0 0x7fe4ac0a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fe4b3f20700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ac14a270 0x7fe4ac13b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fe4b3f20700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4ac14ab80 0x7fe4ac06b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fe4b3f20700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac0a5a00 con 0x7fe4ac14a270 2023-10-08T16:04:22.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fe4b3f20700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac0a66b0 con 0x7fe4ac0ae4c0 2023-10-08T16:04:22.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fe4b3f20700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac06db50 con 0x7fe4ac14ab80 2023-10-08T16:04:22.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fe4b14bb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ac14a270 0x7fe4ac13b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fe4b14bb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ac14a270 0x7fe4ac13b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42760/0 (socket says 172.21.15.133:42760) 2023-10-08T16:04:22.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fe4b14bb700 1 -- 172.21.15.133:0/1306874843 learned_addr learned my addr 172.21.15.133:0/1306874843 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f9303fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9304087510 0x7f9304162e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f9303fff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93040aea60 0x7f93040aa510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f9303fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93040b0050 0x7f93040aaa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f9303fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9304163350 con 0x7f9304087510 2023-10-08T16:04:22.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f9303fff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930406d290 con 0x7f93040b0050 2023-10-08T16:04:22.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f9303fff700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9304157bd0 con 0x7f93040aea60 2023-10-08T16:04:22.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fe4b24bd700 1 --2- 172.21.15.133:0/1306874843 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4ac14ab80 0x7fe4ac06b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fe0acff9700 1 -- 172.21.15.133:0/656883556 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe0a8003030 con 0x7fe0b00af380 2023-10-08T16:04:22.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fe0acff9700 1 --2- 172.21.15.133:0/656883556 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe09c0605d0 0x7fe09c062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fe0acff9700 1 -- 172.21.15.133:0/656883556 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe0a807c700 con 0x7fe0b00af380 2023-10-08T16:04:22.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fe0acff9700 1 --2- 172.21.15.133:0/656883556 >> [v2:172.21.15.133:6809/33493,v1:172.21.15.133:6811/33493] conn(0x7fe09c0687e0 0x7fe09c06abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fe0acff9700 1 -- 172.21.15.133:0/656883556 --> [v2:172.21.15.133:6809/33493,v1:172.21.15.133:6811/33493] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe09c06b2a0 con 0x7fe09c0687e0 2023-10-08T16:04:22.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fe0acff9700 1 -- 172.21.15.133:0/656883556 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0a807ec00 con 0x7fe0b00af380 2023-10-08T16:04:22.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fe0b4e17700 1 --2- 172.21.15.133:0/656883556 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe09c0605d0 0x7fe09c062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fe0b5618700 1 --2- 172.21.15.133:0/656883556 >> [v2:172.21.15.133:6809/33493,v1:172.21.15.133:6811/33493] conn(0x7fe09c0687e0 0x7fe09c06abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7fcddd805700 1 Processor -- start 2023-10-08T16:04:22.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fe4b14bb700 1 -- 172.21.15.133:0/1306874843 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4ac14ab80 msgr2=0x7fe4ac06b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fe4b14bb700 1 --2- 172.21.15.133:0/1306874843 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4ac14ab80 0x7fe4ac06b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fe4b14bb700 1 -- 172.21.15.133:0/1306874843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4ac0ae4c0 msgr2=0x7fe4ac0a54c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T16:04:22.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fe4b14bb700 1 --2- 172.21.15.133:0/1306874843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4ac0ae4c0 0x7fe4ac0a54c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fe4b14bb700 1 -- 172.21.15.133:0/1306874843 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a80094f0 con 0x7fe4ac14a270 2023-10-08T16:04:22.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f1111c48700 1 Processor -- start 2023-10-08T16:04:22.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f1111c48700 1 -- start start 2023-10-08T16:04:22.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f1111c48700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f110c0ae200 0x7f110c142610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f1111c48700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f110c0ae5d0 0x7f110c0ac680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f1111c48700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f110c06e070 0x7f110c06e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f1111c48700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110c0acbc0 con 0x7f110c06e070 2023-10-08T16:04:22.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f1111c48700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110c0abd20 con 0x7f110c0ae200 2023-10-08T16:04:22.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f1111c48700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110c142180 con 0x7f110c0ae5d0 2023-10-08T16:04:22.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f110bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f110c06e070 0x7f110c06e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f110bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f110c06e070 0x7f110c06e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42752/0 (socket says 172.21.15.133:42752) 2023-10-08T16:04:22.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f110bfff700 1 -- 172.21.15.133:0/3902428969 learned_addr learned my addr 172.21.15.133:0/3902428969 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f110b7fe700 1 --2- 172.21.15.133:0/3902428969 >> v2:172.21.15.190:3300/0 conn(0x7f110c0ae200 0x7f110c142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f110bfff700 1 -- 172.21.15.133:0/3902428969 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f110c0ae5d0 msgr2=0x7f110c0ac680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T16:04:22.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f110bfff700 1 --2- 172.21.15.133:0/3902428969 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f110c0ae5d0 0x7f110c0ac680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f110bfff700 1 -- 172.21.15.133:0/3902428969 >> v2:172.21.15.190:3300/0 conn(0x7f110c0ae200 msgr2=0x7f110c142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:22.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f110bfff700 1 --2- 172.21.15.133:0/3902428969 >> v2:172.21.15.190:3300/0 conn(0x7f110c0ae200 0x7f110c142610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f110bfff700 1 -- 172.21.15.133:0/3902428969 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c141b70 con 0x7f110c06e070 2023-10-08T16:04:22.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f110bfff700 1 --2- 172.21.15.133:0/3902428969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f110c06e070 0x7f110c06e4f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f110c0b5bc0 tx=0x7f1104009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453ca56f0c30ecb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.087+0000 7f93037fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93040b0050 0x7f93040aaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f93037fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93040b0050 0x7f93040aaa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.133:53272/0 (socket says 172.21.15.133:53272) 2023-10-08T16:04:22.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f93037fe700 1 -- 172.21.15.133:0/1661068624 learned_addr learned my addr 172.21.15.133:0/1661068624 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f9302ffd700 1 --2- 172.21.15.133:0/1661068624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9304087510 0x7f9304162e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f93027fc700 1 --2- 172.21.15.133:0/1661068624 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93040aea60 0x7f93040aa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fcddd805700 1 -- start start 2023-10-08T16:04:22.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fe4b14bb700 1 --2- 172.21.15.133:0/1306874843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ac14a270 0x7fe4ac13b3a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4009e50 tx=0x7fe4a400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fe4a1ffb700 1 -- 172.21.15.133:0/1306874843 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a400cb50 con 0x7fe4ac14a270 2023-10-08T16:04:22.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fe4a1ffb700 1 -- 172.21.15.133:0/1306874843 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a400f040 con 0x7fe4ac14a270 2023-10-08T16:04:22.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fe4a1ffb700 1 -- 172.21.15.133:0/1306874843 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4014480 con 0x7fe4ac14a270 2023-10-08T16:04:22.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fe0b5618700 1 --2- 172.21.15.133:0/656883556 >> [v2:172.21.15.133:6809/33493,v1:172.21.15.133:6811/33493] conn(0x7fe09c0687e0 0x7fe09c06abf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fe0b4e17700 1 --2- 172.21.15.133:0/656883556 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe09c0605d0 0x7fe09c062a80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4009b40 tx=0x7fe0a40090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fcddd805700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcdd8069410 0x7fcdd81570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fcddd805700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdd8142230 0x7fcdd806daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fcddd805700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcdd8142680 0x7fcdd8159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fcddd805700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd8156c40 con 0x7fcdd8142230 2023-10-08T16:04:22.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fcddd805700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd80a9620 con 0x7fcdd8069410 2023-10-08T16:04:22.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fcddd805700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd80a9900 con 0x7fcdd8142680 2023-10-08T16:04:22.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fe4b3f20700 1 -- 172.21.15.133:0/1306874843 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ac06de30 con 0x7fe4ac14a270 2023-10-08T16:04:22.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fe4b3f20700 1 -- 172.21.15.133:0/1306874843 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ac13b8e0 con 0x7fe4ac14a270 2023-10-08T16:04:22.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f0f27147700 1 Processor -- start 2023-10-08T16:04:22.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f9302ffd700 1 -- 172.21.15.133:0/1661068624 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93040aea60 msgr2=0x7f93040aa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f9302ffd700 1 --2- 172.21.15.133:0/1661068624 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93040aea60 0x7f93040aa510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f9302ffd700 1 -- 172.21.15.133:0/1661068624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93040b0050 msgr2=0x7f93040aaa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f9302ffd700 1 --2- 172.21.15.133:0/1661068624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93040b0050 0x7f93040aaa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f9302ffd700 1 -- 172.21.15.133:0/1661068624 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f40094f0 con 0x7f9304087510 2023-10-08T16:04:22.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f9302ffd700 1 --2- 172.21.15.133:0/1661068624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9304087510 0x7f9304162e10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f93040adb00 tx=0x7f92f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f92eaffd700 1 -- 172.21.15.133:0/1661068624 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f400bbe0 con 0x7f9304087510 2023-10-08T16:04:22.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f92eaffd700 1 -- 172.21.15.133:0/1661068624 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f4000c90 con 0x7f9304087510 2023-10-08T16:04:22.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f9303fff700 1 -- 172.21.15.133:0/1661068624 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f930415a270 con 0x7f9304087510 2023-10-08T16:04:22.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f92eaffd700 1 -- 172.21.15.133:0/1661068624 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f4011630 con 0x7f9304087510 2023-10-08T16:04:22.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f9303fff700 1 -- 172.21.15.133:0/1661068624 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9304157860 con 0x7f9304087510 2023-10-08T16:04:22.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fcdd67fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdd8142230 0x7fcdd806daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fcdd6ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcdd8069410 0x7fcdd81570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fcdd67fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdd8142230 0x7fcdd806daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42776/0 (socket says 172.21.15.133:42776) 2023-10-08T16:04:22.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fcdd67fc700 1 -- 172.21.15.133:0/2788190453 learned_addr learned my addr 172.21.15.133:0/2788190453 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f0f27147700 1 -- start start 2023-10-08T16:04:22.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fcdd77fe700 1 --2- 172.21.15.133:0/2788190453 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcdd8142680 0x7fcdd8159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f110a7fc700 1 -- 172.21.15.133:0/3902428969 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110400e070 con 0x7f110c06e070 2023-10-08T16:04:22.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fe0acff9700 1 -- 172.21.15.133:0/656883556 <== osd.0 v2:172.21.15.133:6809/33493 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe09c06b2a0 con 0x7fe09c0687e0 2023-10-08T16:04:22.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f0f27147700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0f200b1b90 0x7f0f200ad300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f0f27147700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0f20067e10 0x7f0f200af380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f0f27147700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f200ae8e0 con 0x7f0f200af8c0 2023-10-08T16:04:22.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f0f27147700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f200aed70 con 0x7f0f20067e10 2023-10-08T16:04:22.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f0f27147700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f200ad960 con 0x7f0f200b1b90 2023-10-08T16:04:22.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fe4b3f20700 1 -- 172.21.15.133:0/1306874843 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe4ac06d9b0 con 0x7fe4ac14a270 2023-10-08T16:04:22.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f0f26145700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0f200b1b90 0x7f0f200ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f0f26145700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0f200b1b90 0x7f0f200ad300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.133:53292/0 (socket says 172.21.15.133:53292) 2023-10-08T16:04:22.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f0f26145700 1 -- 172.21.15.133:0/2004570618 learned_addr learned my addr 172.21.15.133:0/2004570618 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f9303fff700 1 -- 172.21.15.133:0/1661068624 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f930406d440 con 0x7f9304087510 2023-10-08T16:04:22.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f0f26145700 1 -- 172.21.15.133:0/2004570618 >> v2:172.21.15.133:3300/0 conn(0x7f0f20067e10 msgr2=0x7f0f200af380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T16:04:22.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fcdd67fc700 1 -- 172.21.15.133:0/2788190453 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcdd8142680 msgr2=0x7fcdd8159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fcdd67fc700 1 --2- 172.21.15.133:0/2788190453 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcdd8142680 0x7fcdd8159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fcdd67fc700 1 -- 172.21.15.133:0/2788190453 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcdd8069410 msgr2=0x7fcdd81570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fcdd67fc700 1 --2- 172.21.15.133:0/2788190453 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcdd8069410 0x7fcdd81570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fcdd67fc700 1 -- 172.21.15.133:0/2788190453 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd0009ae0 con 0x7fcdd8142230 2023-10-08T16:04:22.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fcdd67fc700 1 --2- 172.21.15.133:0/2788190453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdd8142230 0x7fcdd806daf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc00b600 tx=0x7fcdcc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fcdbeffd700 1 -- 172.21.15.133:0/2788190453 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc00f510 con 0x7fcdd8142230 2023-10-08T16:04:22.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fcdbeffd700 1 -- 172.21.15.133:0/2788190453 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdcc00f690 con 0x7fcdd8142230 2023-10-08T16:04:22.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fcdbeffd700 1 -- 172.21.15.133:0/2788190453 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc00fa50 con 0x7fcdd8142230 2023-10-08T16:04:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fcddd805700 1 -- 172.21.15.133:0/2788190453 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd81565f0 con 0x7fcdd8142230 2023-10-08T16:04:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fcddd805700 1 -- 172.21.15.133:0/2788190453 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd814b8f0 con 0x7fcdd8142230 2023-10-08T16:04:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7fe4a1ffb700 1 -- 172.21.15.133:0/1306874843 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe4a40147f0 con 0x7fe4ac14a270 2023-10-08T16:04:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7fe4a1ffb700 1 --2- 172.21.15.133:0/1306874843 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe490060620 0x7fe490062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7fe4a1ffb700 1 -- 172.21.15.133:0/1306874843 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe4a407d2d0 con 0x7fe4ac14a270 2023-10-08T16:04:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7fe4a1ffb700 1 --2- 172.21.15.133:0/1306874843 >> [v2:172.21.15.133:6824/33492,v1:172.21.15.133:6825/33492] conn(0x7fe4900687b0 0x7fe49006abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7fe4a1ffb700 1 -- 172.21.15.133:0/1306874843 --> [v2:172.21.15.133:6824/33492,v1:172.21.15.133:6825/33492] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe49006b270 con 0x7fe4900687b0 2023-10-08T16:04:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f0f26145700 1 --2- 172.21.15.133:0/2004570618 >> v2:172.21.15.133:3300/0 conn(0x7f0f20067e10 0x7f0f200af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f0f26145700 1 -- 172.21.15.133:0/2004570618 >> v1:172.21.15.133:6789/0 conn(0x7f0f200af8c0 legacy=0x7f0f2006dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f0f26145700 1 -- 172.21.15.133:0/2004570618 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f200ae290 con 0x7f0f200b1b90 2023-10-08T16:04:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f110a7fc700 1 -- 172.21.15.133:0/3902428969 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110400ba50 con 0x7f110c06e070 2023-10-08T16:04:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f1111c48700 1 -- 172.21.15.133:0/3902428969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f110c06e070 msgr2=0x7f110c06e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.091+0000 7f1111c48700 1 --2- 172.21.15.133:0/3902428969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f110c06e070 0x7f110c06e4f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f110c0b5bc0 tx=0x7f1104009840 comp rx=0 tx=0).stop 2023-10-08T16:04:22.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f92eaffd700 1 -- 172.21.15.133:0/1661068624 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f92f4011a20 con 0x7f9304087510 2023-10-08T16:04:22.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f92eaffd700 1 --2- 172.21.15.133:0/1661068624 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f92f0060550 0x7f92f0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f92eaffd700 1 -- 172.21.15.133:0/1661068624 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f92f407deb0 con 0x7f9304087510 2023-10-08T16:04:22.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f93027fc700 1 --2- 172.21.15.133:0/1661068624 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f92f0060550 0x7f92f0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f92eaffd700 1 --2- 172.21.15.133:0/1661068624 >> [v2:172.21.15.190:6824/33686,v1:172.21.15.190:6825/33686] conn(0x7f92f0068760 0x7f92f006ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f92eaffd700 1 -- 172.21.15.133:0/1661068624 --> [v2:172.21.15.190:6824/33686,v1:172.21.15.190:6825/33686] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f92f006b220 con 0x7f92f0068760 2023-10-08T16:04:22.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f0f26145700 1 --2- 172.21.15.133:0/2004570618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f200b1b90 0x7f0f200ad300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0f2006a770 tx=0x7f0f14009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=117090a5248e923c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f92eaffd700 1 -- 172.21.15.133:0/1661068624 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92f40804f0 con 0x7f9304087510 2023-10-08T16:04:22.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f1111c48700 1 -- 172.21.15.133:0/3902428969 shutdown_connections 2023-10-08T16:04:22.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f1111c48700 1 --2- 172.21.15.133:0/3902428969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f110c06e070 0x7f110c06e4f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f1111c48700 1 --2- 172.21.15.133:0/3902428969 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f110c0ae5d0 0x7f110c0ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f1111c48700 1 --2- 172.21.15.133:0/3902428969 >> v2:172.21.15.190:3300/0 conn(0x7f110c0ae200 0x7f110c142610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f1111c48700 1 -- 172.21.15.133:0/3902428969 >> 172.21.15.133:0/3902428969 conn(0x7f110c0b4ba0 msgr2=0x7f110c0b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f93037fe700 1 --2- 172.21.15.133:0/1661068624 >> [v2:172.21.15.190:6824/33686,v1:172.21.15.190:6825/33686] conn(0x7f92f0068760 0x7f92f006ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f1111c48700 1 -- 172.21.15.133:0/3902428969 shutdown_connections 2023-10-08T16:04:22.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f1111c48700 1 -- 172.21.15.133:0/3902428969 wait complete. 2023-10-08T16:04:22.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7fe4a1ffb700 1 -- 172.21.15.133:0/1306874843 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4a404d940 con 0x7fe4ac14a270 2023-10-08T16:04:22.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7fe4b24bd700 1 --2- 172.21.15.133:0/1306874843 >> [v2:172.21.15.133:6824/33492,v1:172.21.15.133:6825/33492] conn(0x7fe4900687b0 0x7fe49006abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7fe4b24bd700 1 --2- 172.21.15.133:0/1306874843 >> [v2:172.21.15.133:6824/33492,v1:172.21.15.133:6825/33492] conn(0x7fe4900687b0 0x7fe49006abc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7fcdbeffd700 1 -- 172.21.15.133:0/2788190453 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fcdcc01a400 con 0x7fcdd8142230 2023-10-08T16:04:22.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7fcdbeffd700 1 --2- 172.21.15.133:0/2788190453 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fcdc4060550 0x7fcdc4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7fcdbeffd700 1 -- 172.21.15.133:0/2788190453 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcdcc07c310 con 0x7fcdd8142230 2023-10-08T16:04:22.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7fcdd6ffd700 1 --2- 172.21.15.133:0/2788190453 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fcdc4060550 0x7fcdc4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7fe4a1ffb700 1 -- 172.21.15.133:0/1306874843 <== osd.2 v2:172.21.15.133:6824/33492 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe49006b270 con 0x7fe4900687b0 2023-10-08T16:04:22.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f93027fc700 1 --2- 172.21.15.133:0/1661068624 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f92f0060550 0x7f92f0062a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f93041552d0 tx=0x7f92f80091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f93037fe700 1 --2- 172.21.15.133:0/1661068624 >> [v2:172.21.15.190:6824/33686,v1:172.21.15.190:6825/33686] conn(0x7f92f0068760 0x7f92f006ab70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f1111c48700 1 Processor -- start 2023-10-08T16:04:22.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f1111c48700 1 -- start start 2023-10-08T16:04:22.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f0f25143700 1 -- 172.21.15.133:0/2004570618 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1400b820 con 0x7f0f200b1b90 2023-10-08T16:04:22.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f0f25143700 1 -- 172.21.15.133:0/2004570618 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1400b980 con 0x7f0f200b1b90 2023-10-08T16:04:22.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f0f25143700 1 -- 172.21.15.133:0/2004570618 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1400bd20 con 0x7f0f200b1b90 2023-10-08T16:04:22.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f1111c48700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f110c06e070 0x7f110c13ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f1111c48700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f110c0ae200 0x7f110c140d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7fcddd805700 1 -- 172.21.15.133:0/2788190453 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcdd8141a30 con 0x7fcdd8142230 2023-10-08T16:04:22.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f1111c48700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f110c0ae5d0 0x7f110c159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f1111c48700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c15a4c0 con 0x7f110c0ae200 2023-10-08T16:04:22.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f1111c48700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c13b400 con 0x7f110c06e070 2023-10-08T16:04:22.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f1111c48700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110c159af0 con 0x7f110c0ae5d0 2023-10-08T16:04:22.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7fcdbeffd700 1 --2- 172.21.15.133:0/2788190453 >> [v2:172.21.15.133:6800/33490,v1:172.21.15.133:6801/33490] conn(0x7fcdc40686e0 0x7fcdc406aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7fcdbeffd700 1 -- 172.21.15.133:0/2788190453 --> [v2:172.21.15.133:6800/33490,v1:172.21.15.133:6801/33490] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcdc406b1a0 con 0x7fcdc40686e0 2023-10-08T16:04:22.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7fcdbeffd700 1 -- 172.21.15.133:0/2788190453 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcdcc04c8e0 con 0x7fcdd8142230 2023-10-08T16:04:22.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7fcdd77fe700 1 --2- 172.21.15.133:0/2788190453 >> [v2:172.21.15.133:6800/33490,v1:172.21.15.133:6801/33490] conn(0x7fcdc40686e0 0x7fcdc406aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.095+0000 7f110b7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f110c06e070 0x7f110c13ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f110b7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f110c06e070 0x7f110c13ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.133:53302/0 (socket says 172.21.15.133:53302) 2023-10-08T16:04:22.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f110b7fe700 1 -- 172.21.15.133:0/2190092310 learned_addr learned my addr 172.21.15.133:0/2190092310 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f92eaffd700 1 -- 172.21.15.133:0/1661068624 <== osd.7 v2:172.21.15.190:6824/33686 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f92f006b220 con 0x7f92f0068760 2023-10-08T16:04:22.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7fcdd6ffd700 1 --2- 172.21.15.133:0/2788190453 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fcdc4060550 0x7fcdc4062a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcdd814c020 tx=0x7fcdc8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f0f27147700 1 -- 172.21.15.133:0/2004570618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f200b1b90 msgr2=0x7f0f200ad300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f0f27147700 1 --2- 172.21.15.133:0/2004570618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f200b1b90 0x7f0f200ad300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0f2006a770 tx=0x7f0f14009250 comp rx=0 tx=0).stop 2023-10-08T16:04:22.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f110b7fe700 1 -- 172.21.15.133:0/2190092310 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f110c0ae5d0 msgr2=0x7f110c159f80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T16:04:22.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f110b7fe700 1 --2- 172.21.15.133:0/2190092310 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f110c0ae5d0 0x7f110c159f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f110b7fe700 1 -- 172.21.15.133:0/2190092310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f110c0ae200 msgr2=0x7f110c140d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f110b7fe700 1 --2- 172.21.15.133:0/2190092310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f110c0ae200 0x7f110c140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f110b7fe700 1 -- 172.21.15.133:0/2190092310 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1104009ae0 con 0x7f110c06e070 2023-10-08T16:04:22.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7fcdd77fe700 1 --2- 172.21.15.133:0/2788190453 >> [v2:172.21.15.133:6800/33490,v1:172.21.15.133:6801/33490] conn(0x7fcdc40686e0 0x7fcdc406aaf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f59874dc700 1 Processor -- start 2023-10-08T16:04:22.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f110b7fe700 1 --2- 172.21.15.133:0/2190092310 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f110c06e070 0x7f110c13ada0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f110000d8c0 tx=0x7f1100008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f0f27147700 1 -- 172.21.15.133:0/2004570618 shutdown_connections 2023-10-08T16:04:22.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f0f27147700 1 --2- 172.21.15.133:0/2004570618 >> v2:172.21.15.133:3300/0 conn(0x7f0f20067e10 0x7f0f200af380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f0f27147700 1 --2- 172.21.15.133:0/2004570618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f200b1b90 0x7f0f200ad300 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f0f27147700 1 -- 172.21.15.133:0/2004570618 >> 172.21.15.133:0/2004570618 conn(0x7f0f200636b0 msgr2=0x7f0f200b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f59874dc700 1 -- start start 2023-10-08T16:04:22.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7fe4b1cbc700 1 --2- 172.21.15.133:0/1306874843 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe490060620 0x7fe490062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f0f27147700 1 -- 172.21.15.133:0/2004570618 shutdown_connections 2023-10-08T16:04:22.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f0f27147700 1 -- 172.21.15.133:0/2004570618 wait complete. 2023-10-08T16:04:22.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7fcdbeffd700 1 -- 172.21.15.133:0/2788190453 <== osd.1 v2:172.21.15.133:6800/33490 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fcdc406b1a0 con 0x7fcdc40686e0 2023-10-08T16:04:22.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7fe4b1cbc700 1 --2- 172.21.15.133:0/1306874843 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe490060620 0x7fe490062ad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe49c009740 tx=0x7fe49c006c60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f10f37fe700 1 -- 172.21.15.133:0/2190092310 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110000de60 con 0x7f110c06e070 2023-10-08T16:04:22.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f10f37fe700 1 -- 172.21.15.133:0/2190092310 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110000b780 con 0x7f110c06e070 2023-10-08T16:04:22.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f10f37fe700 1 -- 172.21.15.133:0/2190092310 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110000bb00 con 0x7f110c06e070 2023-10-08T16:04:22.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f1111c48700 1 -- 172.21.15.133:0/2190092310 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f110c06b470 con 0x7f110c06e070 2023-10-08T16:04:22.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f1111c48700 1 -- 172.21.15.133:0/2190092310 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f110c141530 con 0x7f110c06e070 2023-10-08T16:04:22.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f0f27147700 1 Processor -- start 2023-10-08T16:04:22.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f59874dc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f59800b0070 0x7f59800ae160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f59864da700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f59800b1dc0 0x7f5980067c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49394/0 (socket says 172.21.15.133:49394) 2023-10-08T16:04:22.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f5985cd9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f59800b0070 0x7f59800ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f5985cd9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f59800b0070 0x7f59800ae160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42814/0 (socket says 172.21.15.133:42814) 2023-10-08T16:04:22.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f59864da700 1 -- 172.21.15.133:0/3275244025 learned_addr learned my addr 172.21.15.133:0/3275244025 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:22.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.099+0000 7f0f27147700 1 -- start start 2023-10-08T16:04:22.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f0f27147700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f20067e10 0x7f0f2006daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f0f27147700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f200af8c0 0x7f0f20159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f0f27147700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f200b1b90 0x7f0f2015a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f0f27147700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f200a7b10 con 0x7f0f20067e10 2023-10-08T16:04:22.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f0f27147700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f200a7830 con 0x7f0f200b1b90 2023-10-08T16:04:22.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f0f27147700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f200a85c0 con 0x7f0f200af8c0 2023-10-08T16:04:22.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f0f26145700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f20067e10 0x7f0f2006daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f0f26145700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f20067e10 0x7f0f2006daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42816/0 (socket says 172.21.15.133:42816) 2023-10-08T16:04:22.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f0f26145700 1 -- 172.21.15.133:0/258844047 learned_addr learned my addr 172.21.15.133:0/258844047 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f0f26946700 1 --2- 172.21.15.133:0/258844047 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f200b1b90 0x7f0f2015a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f0f26145700 1 -- 172.21.15.133:0/258844047 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f200af8c0 msgr2=0x7f0f20159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f0f26145700 1 --2- 172.21.15.133:0/258844047 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f200af8c0 0x7f0f20159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f0f26145700 1 -- 172.21.15.133:0/258844047 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f200b1b90 msgr2=0x7f0f2015a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f0f26145700 1 --2- 172.21.15.133:0/258844047 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f200b1b90 0x7f0f2015a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f0f26145700 1 -- 172.21.15.133:0/258844047 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f140094f0 con 0x7f0f20067e10 2023-10-08T16:04:22.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f10f37fe700 1 -- 172.21.15.133:0/2190092310 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f110001e460 con 0x7f110c06e070 2023-10-08T16:04:22.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f59874dc700 1 --2- 172.21.15.133:0/3275244025 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5980068380 0x7f5980151560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f59874dc700 1 -- 172.21.15.133:0/3275244025 --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59800ad4d0 con 0x7f59800b1dc0 2023-10-08T16:04:22.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f59874dc700 1 -- 172.21.15.133:0/3275244025 --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59800ae6a0 con 0x7f59800b0070 2023-10-08T16:04:22.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f59874dc700 1 -- 172.21.15.133:0/3275244025 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59800ac230 con 0x7f5980068380 2023-10-08T16:04:22.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f5986cdb700 1 --2- 172.21.15.133:0/3275244025 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5980068380 0x7f5980151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f5985cd9700 1 -- 172.21.15.133:0/3275244025 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5980068380 msgr2=0x7f5980151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:22.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f5985cd9700 1 --2- 172.21.15.133:0/3275244025 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5980068380 0x7f5980151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f5985cd9700 1 -- 172.21.15.133:0/3275244025 >> v1:172.21.15.133:6789/0 conn(0x7f59800b1dc0 legacy=0x7f5980067c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f5985cd9700 1 -- 172.21.15.133:0/3275244025 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59800ac510 con 0x7f59800b0070 2023-10-08T16:04:22.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f10f37fe700 1 --2- 172.21.15.133:0/2190092310 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f10f8060620 0x7f10f8062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f10f37fe700 1 -- 172.21.15.133:0/2190092310 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f110007ce90 con 0x7f110c06e070 2023-10-08T16:04:22.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f110affd700 1 --2- 172.21.15.133:0/2190092310 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f10f8060620 0x7f10f8062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f5985cd9700 1 --2- 172.21.15.133:0/3275244025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59800b0070 0x7f59800ae160 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5978009e60 tx=0x7f5978009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b1426a103ccae3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f0f26145700 1 --2- 172.21.15.133:0/258844047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f20067e10 0x7f0f2006daf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0f14009290 tx=0x7f0f14016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f59854d8700 1 -- 172.21.15.133:0/3275244025 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597800e070 con 0x7f59800b0070 2023-10-08T16:04:22.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f59854d8700 1 -- 172.21.15.133:0/3275244025 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597800bc30 con 0x7f59800b0070 2023-10-08T16:04:22.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f59854d8700 1 -- 172.21.15.133:0/3275244025 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978012430 con 0x7f59800b0070 2023-10-08T16:04:22.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f110affd700 1 --2- 172.21.15.133:0/2190092310 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f10f8060620 0x7f10f8062ad0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f110c0b02e0 tx=0x7f10fc007b50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f59874dc700 1 -- 172.21.15.133:0/3275244025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59800b0070 msgr2=0x7f59800ae160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.103+0000 7f59874dc700 1 --2- 172.21.15.133:0/3275244025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59800b0070 0x7f59800ae160 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5978009e60 tx=0x7f5978009780 comp rx=0 tx=0).stop 2023-10-08T16:04:22.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.107+0000 7f0f1e7fc700 1 -- 172.21.15.133:0/258844047 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f14011e20 con 0x7f0f20067e10 2023-10-08T16:04:22.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.107+0000 7f0f1e7fc700 1 -- 172.21.15.133:0/258844047 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1401a460 con 0x7f0f20067e10 2023-10-08T16:04:22.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.107+0000 7f0f1e7fc700 1 -- 172.21.15.133:0/258844047 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1401a820 con 0x7f0f20067e10 2023-10-08T16:04:22.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.107+0000 7f0f27147700 1 -- 172.21.15.133:0/258844047 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f2006e910 con 0x7f0f20067e10 2023-10-08T16:04:22.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.107+0000 7f0f27147700 1 -- 172.21.15.133:0/258844047 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f200a7340 con 0x7f0f20067e10 2023-10-08T16:04:22.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.107+0000 7f0f1e7fc700 1 -- 172.21.15.133:0/258844047 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0f1401ac10 con 0x7f0f20067e10 2023-10-08T16:04:22.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.107+0000 7f0f1e7fc700 1 --2- 172.21.15.133:0/258844047 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f0f0c060620 0x7f0f0c062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.107+0000 7f0f1e7fc700 1 -- 172.21.15.133:0/258844047 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0f1407e070 con 0x7f0f20067e10 2023-10-08T16:04:22.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.107+0000 7f0f25944700 1 --2- 172.21.15.133:0/258844047 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f0f0c060620 0x7f0f0c062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.107+0000 7f0f25944700 1 --2- 172.21.15.133:0/258844047 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f0f0c060620 0x7f0f0c062ad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0f200a9a50 tx=0x7f0f18009370 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.111+0000 7f1111c48700 1 --2- 172.21.15.133:0/2190092310 >> [v2:172.21.15.190:6809/33676,v1:172.21.15.190:6811/33676] conn(0x7f110c067ce0 0x7f110c0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.111+0000 7f59874dc700 1 -- 172.21.15.133:0/3275244025 shutdown_connections 2023-10-08T16:04:22.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.111+0000 7f59874dc700 1 --2- 172.21.15.133:0/3275244025 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5980068380 0x7f5980151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.111+0000 7f59874dc700 1 --2- 172.21.15.133:0/3275244025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59800b0070 0x7f59800ae160 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.111+0000 7f59874dc700 1 -- 172.21.15.133:0/3275244025 >> 172.21.15.133:0/3275244025 conn(0x7f59800636b0 msgr2=0x7f59800b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.111+0000 7f0f27147700 1 --2- 172.21.15.133:0/258844047 >> [v2:172.21.15.133:6808/33491,v1:172.21.15.133:6810/33491] conn(0x7f0f200a6c90 0x7f0f200ab050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.111+0000 7f1111c48700 1 -- 172.21.15.133:0/2190092310 --> [v2:172.21.15.190:6809/33676,v1:172.21.15.190:6811/33676] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f110c159600 con 0x7f110c067ce0 2023-10-08T16:04:22.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.111+0000 7f0f27147700 1 -- 172.21.15.133:0/258844047 --> [v2:172.21.15.133:6808/33491,v1:172.21.15.133:6810/33491] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f200b4780 con 0x7f0f200a6c90 2023-10-08T16:04:22.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.111+0000 7f59874dc700 1 -- 172.21.15.133:0/3275244025 shutdown_connections 2023-10-08T16:04:22.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.111+0000 7f0f26946700 1 --2- 172.21.15.133:0/258844047 >> [v2:172.21.15.133:6808/33491,v1:172.21.15.133:6810/33491] conn(0x7f0f200a6c90 0x7f0f200ab050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.111+0000 7f59874dc700 1 -- 172.21.15.133:0/3275244025 wait complete. 2023-10-08T16:04:22.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.111+0000 7f0f26946700 1 --2- 172.21.15.133:0/258844047 >> [v2:172.21.15.133:6808/33491,v1:172.21.15.133:6810/33491] conn(0x7f0f200a6c90 0x7f0f200ab050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.115+0000 7f0f1e7fc700 1 -- 172.21.15.133:0/258844047 <== osd.3 v2:172.21.15.133:6808/33491 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f0f200b4780 con 0x7f0f200a6c90 2023-10-08T16:04:22.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.111+0000 7f110bfff700 1 --2- 172.21.15.133:0/2190092310 >> [v2:172.21.15.190:6809/33676,v1:172.21.15.190:6811/33676] conn(0x7f110c067ce0 0x7f110c0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.111+0000 7f110bfff700 1 --2- 172.21.15.133:0/2190092310 >> [v2:172.21.15.190:6809/33676,v1:172.21.15.190:6811/33676] conn(0x7f110c067ce0 0x7f110c0680b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.115+0000 7f59874dc700 1 Processor -- start 2023-10-08T16:04:22.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.115+0000 7f59874dc700 1 -- start start 2023-10-08T16:04:22.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.115+0000 7f10f37fe700 1 -- 172.21.15.133:0/2190092310 <== osd.5 v2:172.21.15.190:6809/33676 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f11040092e0 con 0x7f110c067ce0 2023-10-08T16:04:22.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.115+0000 7f59874dc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5980068380 0x7f5980148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.115+0000 7f59874dc700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59800b0070 0x7f5980159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.115+0000 7f59874dc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59800b1dc0 0x7f5980159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.115+0000 7f59874dc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59801442e0 con 0x7f59800b1dc0 2023-10-08T16:04:22.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.115+0000 7f59874dc700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59801435e0 con 0x7f5980068380 2023-10-08T16:04:22.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.115+0000 7f59874dc700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598006d330 con 0x7f59800b0070 2023-10-08T16:04:22.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.115+0000 7f5986cdb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59800b1dc0 0x7f5980159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.115+0000 7f5986cdb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59800b1dc0 0x7f5980159da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42824/0 (socket says 172.21.15.133:42824) 2023-10-08T16:04:22.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.115+0000 7f5986cdb700 1 -- 172.21.15.133:0/3720815832 learned_addr learned my addr 172.21.15.133:0/3720815832 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.115+0000 7f59864da700 1 --2- 172.21.15.133:0/3720815832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5980068380 0x7f5980148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.115+0000 7f5985cd9700 1 --2- 172.21.15.133:0/3720815832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59800b0070 0x7f5980159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.115+0000 7f5986cdb700 1 -- 172.21.15.133:0/3720815832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59800b0070 msgr2=0x7f5980159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.115+0000 7f5986cdb700 1 --2- 172.21.15.133:0/3720815832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59800b0070 0x7f5980159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.115+0000 7f5986cdb700 1 -- 172.21.15.133:0/3720815832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5980068380 msgr2=0x7f5980148b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.115+0000 7f5986cdb700 1 --2- 172.21.15.133:0/3720815832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5980068380 0x7f5980148b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.115+0000 7f5986cdb700 1 -- 172.21.15.133:0/3720815832 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5978009a20 con 0x7f59800b1dc0 2023-10-08T16:04:22.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.115+0000 7f5985cd9700 1 --2- 172.21.15.133:0/3720815832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59800b0070 0x7f5980159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:22.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.115+0000 7f59864da700 1 --2- 172.21.15.133:0/3720815832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5980068380 0x7f5980148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:22.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.115+0000 7f5986cdb700 1 --2- 172.21.15.133:0/3720815832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59800b1dc0 0x7f5980159da0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f597000d8c0 tx=0x7f5970008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f59767fc700 1 -- 172.21.15.133:0/3720815832 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597000b5d0 con 0x7f59800b1dc0 2023-10-08T16:04:22.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f59767fc700 1 -- 172.21.15.133:0/3720815832 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597000b750 con 0x7f59800b1dc0 2023-10-08T16:04:22.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f59874dc700 1 -- 172.21.15.133:0/3720815832 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f598006cd70 con 0x7f59800b1dc0 2023-10-08T16:04:22.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f59874dc700 1 -- 172.21.15.133:0/3720815832 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5980149320 con 0x7f59800b1dc0 2023-10-08T16:04:22.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f59767fc700 1 -- 172.21.15.133:0/3720815832 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597000bb10 con 0x7f59800b1dc0 2023-10-08T16:04:22.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f9303fff700 1 -- 172.21.15.133:0/1661068624 --> [v2:172.21.15.190:6824/33686,v1:172.21.15.190:6825/33686] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f93041576c0 con 0x7f92f0068760 2023-10-08T16:04:22.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f59874dc700 1 -- 172.21.15.133:0/3720815832 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5964000fd0 con 0x7f59800b1dc0 2023-10-08T16:04:22.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7fe0b5e19700 1 -- 172.21.15.133:0/656883556 --> [v2:172.21.15.133:6809/33493,v1:172.21.15.133:6811/33493] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe090002d30 con 0x7fe09c0687e0 2023-10-08T16:04:22.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7fe0acff9700 1 -- 172.21.15.133:0/656883556 <== osd.0 v2:172.21.15.133:6809/33493 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe090002d30 con 0x7fe09c0687e0 2023-10-08T16:04:22.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f59767fc700 1 -- 172.21.15.133:0/3720815832 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f597001e460 con 0x7f59800b1dc0 2023-10-08T16:04:22.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f92eaffd700 1 -- 172.21.15.133:0/1661068624 <== osd.7 v2:172.21.15.190:6824/33686 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f93041576c0 con 0x7f92f0068760 2023-10-08T16:04:22.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f63d7187700 1 Processor -- start 2023-10-08T16:04:22.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f63d7187700 1 -- start start 2023-10-08T16:04:22.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f9303fff700 1 -- 172.21.15.133:0/1661068624 >> [v2:172.21.15.190:6824/33686,v1:172.21.15.190:6825/33686] conn(0x7f92f0068760 msgr2=0x7f92f006ab70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f9303fff700 1 --2- 172.21.15.133:0/1661068624 >> [v2:172.21.15.190:6824/33686,v1:172.21.15.190:6825/33686] conn(0x7f92f0068760 0x7f92f006ab70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f9303fff700 1 -- 172.21.15.133:0/1661068624 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f92f0060550 msgr2=0x7f92f0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f9303fff700 1 --2- 172.21.15.133:0/1661068624 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f92f0060550 0x7f92f0062a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f93041552d0 tx=0x7f92f80091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f9303fff700 1 -- 172.21.15.133:0/1661068624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9304087510 msgr2=0x7f9304162e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f9303fff700 1 --2- 172.21.15.133:0/1661068624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9304087510 0x7f9304162e10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f93040adb00 tx=0x7f92f4017000 comp rx=0 tx=0).stop 2023-10-08T16:04:22.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f59767fc700 1 --2- 172.21.15.133:0/3720815832 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f596c060780 0x7f596c062c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f93037fe700 1 -- 172.21.15.133:0/1661068624 reap_dead start 2023-10-08T16:04:22.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f59767fc700 1 -- 172.21.15.133:0/3720815832 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f597007ce30 con 0x7f59800b1dc0 2023-10-08T16:04:22.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f9303fff700 1 -- 172.21.15.133:0/1661068624 shutdown_connections 2023-10-08T16:04:22.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f9303fff700 1 -- 172.21.15.133:0/1661068624 >> 172.21.15.133:0/1661068624 conn(0x7f93040636b0 msgr2=0x7f93040b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f59864da700 1 --2- 172.21.15.133:0/3720815832 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f596c060780 0x7f596c062c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f59767fc700 1 --2- 172.21.15.133:0/3720815832 >> [v2:172.21.15.190:6800/33677,v1:172.21.15.190:6801/33677] conn(0x7f596c068990 0x7f596c06ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f59767fc700 1 -- 172.21.15.133:0/3720815832 --> [v2:172.21.15.190:6800/33677,v1:172.21.15.190:6801/33677] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f596c06b450 con 0x7f596c068990 2023-10-08T16:04:22.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f59767fc700 1 -- 172.21.15.133:0/3720815832 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f597007f390 con 0x7f59800b1dc0 2023-10-08T16:04:22.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7fe0b5e19700 1 -- 172.21.15.133:0/656883556 >> [v2:172.21.15.133:6809/33493,v1:172.21.15.133:6811/33493] conn(0x7fe09c0687e0 msgr2=0x7fe09c06abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7fe0b5e19700 1 --2- 172.21.15.133:0/656883556 >> [v2:172.21.15.133:6809/33493,v1:172.21.15.133:6811/33493] conn(0x7fe09c0687e0 0x7fe09c06abf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f63d7187700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63d00b0070 0x7f63d00ae160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f9303fff700 1 -- 172.21.15.133:0/1661068624 shutdown_connections 2023-10-08T16:04:22.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7fe0b5e19700 1 -- 172.21.15.133:0/656883556 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe09c0605d0 msgr2=0x7fe09c062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.119+0000 7f5985cd9700 1 --2- 172.21.15.133:0/3720815832 >> [v2:172.21.15.190:6800/33677,v1:172.21.15.190:6801/33677] conn(0x7f596c068990 0x7f596c06ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f9303fff700 1 -- 172.21.15.133:0/1661068624 wait complete. 2023-10-08T16:04:22.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7fe0b5e19700 1 --2- 172.21.15.133:0/656883556 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe09c0605d0 0x7fe09c062a80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4009b40 tx=0x7fe0a40090f0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7fe0b5e19700 1 -- 172.21.15.133:0/656883556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0b00af380 msgr2=0x7fe0b01441a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7fe0b5e19700 1 --2- 172.21.15.133:0/656883556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0b00af380 0x7fe0b01441a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe0a800c910 tx=0x7fe0a8001710 comp rx=0 tx=0).stop 2023-10-08T16:04:22.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7fe0b5618700 1 -- 172.21.15.133:0/656883556 reap_dead start 2023-10-08T16:04:22.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f63d6185700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f63d00b1dc0 0x7f63d0067c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.133:42736/0 (socket says 172.21.15.133:42736) 2023-10-08T16:04:22.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f63d6185700 1 -- 172.21.15.133:0/2589675756 learned_addr learned my addr 172.21.15.133:0/2589675756 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:22.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f63d5984700 1 --2- 172.21.15.133:0/2589675756 >> v2:172.21.15.133:3300/0 conn(0x7f63d00b0070 0x7f63d00ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f63d7187700 1 --2- 172.21.15.133:0/2589675756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63d0068380 0x7f63d0151560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f59864da700 1 --2- 172.21.15.133:0/3720815832 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f596c060780 0x7f596c062c30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f597c001820 tx=0x7f597c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f63d7187700 1 -- 172.21.15.133:0/2589675756 --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d00ad4d0 con 0x7f63d00b1dc0 2023-10-08T16:04:22.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f63d7187700 1 -- 172.21.15.133:0/2589675756 --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d00ae6a0 con 0x7f63d00b0070 2023-10-08T16:04:22.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f63d7187700 1 -- 172.21.15.133:0/2589675756 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d00ac230 con 0x7f63d0068380 2023-10-08T16:04:22.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7fe0b5e19700 1 -- 172.21.15.133:0/656883556 shutdown_connections 2023-10-08T16:04:22.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7fe0b5e19700 1 -- 172.21.15.133:0/656883556 >> 172.21.15.133:0/656883556 conn(0x7fe0b00636b0 msgr2=0x7fe0b013db60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7fe0b5e19700 1 -- 172.21.15.133:0/656883556 shutdown_connections 2023-10-08T16:04:22.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7fe0b5e19700 1 -- 172.21.15.133:0/656883556 wait complete. 2023-10-08T16:04:22.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f63d6986700 1 --2- 172.21.15.133:0/2589675756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63d0068380 0x7f63d0151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f63d5183700 1 -- 172.21.15.133:0/2589675756 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3711671818 0 0) 0x7f63d00ad4d0 con 0x7f63d00b1dc0 2023-10-08T16:04:22.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f5985cd9700 1 --2- 172.21.15.133:0/3720815832 >> [v2:172.21.15.190:6800/33677,v1:172.21.15.190:6801/33677] conn(0x7f596c068990 0x7f596c06ada0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f63d5183700 1 -- 172.21.15.133:0/2589675756 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63bc003570 con 0x7f63d00b1dc0 2023-10-08T16:04:22.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f63d5984700 1 -- 172.21.15.133:0/2589675756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63d0068380 msgr2=0x7f63d0151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:22.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f63d5984700 1 --2- 172.21.15.133:0/2589675756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63d0068380 0x7f63d0151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f63d5984700 1 -- 172.21.15.133:0/2589675756 >> v1:172.21.15.190:6789/0 conn(0x7f63d00b1dc0 legacy=0x7f63d0067c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f63d5984700 1 -- 172.21.15.133:0/2589675756 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d00ac510 con 0x7f63d00b0070 2023-10-08T16:04:22.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f63d5984700 1 --2- 172.21.15.133:0/2589675756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63d00b0070 0x7f63d00ae160 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f63c00098e0 tx=0x7f63c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838803321ef5d4ea server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f63d5183700 1 -- 172.21.15.133:0/2589675756 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0011630 con 0x7f63d00b0070 2023-10-08T16:04:22.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f63d5183700 1 -- 172.21.15.133:0/2589675756 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c0011790 con 0x7f63d00b0070 2023-10-08T16:04:22.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f63d5183700 1 -- 172.21.15.133:0/2589675756 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0011b30 con 0x7f63d00b0070 2023-10-08T16:04:22.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f59767fc700 1 -- 172.21.15.133:0/3720815832 <== osd.6 v2:172.21.15.190:6800/33677 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f596c06b450 con 0x7f596c068990 2023-10-08T16:04:22.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f63d7187700 1 -- 172.21.15.133:0/2589675756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63d00b0070 msgr2=0x7f63d00ae160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f63d7187700 1 --2- 172.21.15.133:0/2589675756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63d00b0070 0x7f63d00ae160 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f63c00098e0 tx=0x7f63c00091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f63d7187700 1 -- 172.21.15.133:0/2589675756 shutdown_connections 2023-10-08T16:04:22.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f63d7187700 1 --2- 172.21.15.133:0/2589675756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63d0068380 0x7f63d0151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f63d7187700 1 --2- 172.21.15.133:0/2589675756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63d00b0070 0x7f63d00ae160 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.123+0000 7f63d7187700 1 -- 172.21.15.133:0/2589675756 >> 172.21.15.133:0/2589675756 conn(0x7f63d00636b0 msgr2=0x7f63d00b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.127+0000 7fe4b3f20700 1 -- 172.21.15.133:0/1306874843 --> [v2:172.21.15.133:6824/33492,v1:172.21.15.133:6825/33492] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe4ac04be40 con 0x7fe4900687b0 2023-10-08T16:04:22.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.127+0000 7fcddd805700 1 -- 172.21.15.133:0/2788190453 --> [v2:172.21.15.133:6800/33490,v1:172.21.15.133:6801/33490] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcdd80b02d0 con 0x7fcdc40686e0 2023-10-08T16:04:22.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.127+0000 7f63d7187700 1 -- 172.21.15.133:0/2589675756 shutdown_connections 2023-10-08T16:04:22.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.127+0000 7f63d7187700 1 -- 172.21.15.133:0/2589675756 wait complete. 2023-10-08T16:04:22.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.127+0000 7fe4a1ffb700 1 -- 172.21.15.133:0/1306874843 <== osd.2 v2:172.21.15.133:6824/33492 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe4ac04be40 con 0x7fe4900687b0 2023-10-08T16:04:22.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.127+0000 7fcdbeffd700 1 -- 172.21.15.133:0/2788190453 <== osd.1 v2:172.21.15.133:6800/33490 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcdd80b02d0 con 0x7fcdc40686e0 2023-10-08T16:04:22.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7f63d7187700 1 Processor -- start 2023-10-08T16:04:22.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7f63d7187700 1 -- start start 2023-10-08T16:04:22.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7f63d7187700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63d0068380 0x7f63d00a6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7f63d7187700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63d00b0070 0x7f63d00a6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7f63d7187700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63d00b1dc0 0x7f63d0156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7f63d7187700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d00a8030 con 0x7f63d0068380 2023-10-08T16:04:22.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7f63d7187700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d00a8230 con 0x7f63d00b1dc0 2023-10-08T16:04:22.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7f63d7187700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d00a5ae0 con 0x7f63d00b0070 2023-10-08T16:04:22.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7fcddd805700 1 -- 172.21.15.133:0/2788190453 >> [v2:172.21.15.133:6800/33490,v1:172.21.15.133:6801/33490] conn(0x7fcdc40686e0 msgr2=0x7fcdc406aaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7fcddd805700 1 --2- 172.21.15.133:0/2788190453 >> [v2:172.21.15.133:6800/33490,v1:172.21.15.133:6801/33490] conn(0x7fcdc40686e0 0x7fcdc406aaf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7f63d6185700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63d0068380 0x7f63d00a6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7f63d6185700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63d0068380 0x7f63d00a6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42846/0 (socket says 172.21.15.133:42846) 2023-10-08T16:04:22.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7f63d6185700 1 -- 172.21.15.133:0/4135586184 learned_addr learned my addr 172.21.15.133:0/4135586184 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7f63d5984700 1 --2- 172.21.15.133:0/4135586184 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63d00b0070 0x7f63d00a6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7f63d6986700 1 --2- 172.21.15.133:0/4135586184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63d00b1dc0 0x7f63d0156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7fcddd805700 1 -- 172.21.15.133:0/2788190453 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fcdc4060550 msgr2=0x7fcdc4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7fcddd805700 1 --2- 172.21.15.133:0/2788190453 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fcdc4060550 0x7fcdc4062a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcdd814c020 tx=0x7fcdc8008040 comp rx=0 tx=0).stop 2023-10-08T16:04:22.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7fcddd805700 1 -- 172.21.15.133:0/2788190453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdd8142230 msgr2=0x7fcdd806daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7fcddd805700 1 --2- 172.21.15.133:0/2788190453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdd8142230 0x7fcdd806daf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc00b600 tx=0x7fcdcc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7fcdd77fe700 1 -- 172.21.15.133:0/2788190453 reap_dead start 2023-10-08T16:04:22.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7fcddd805700 1 -- 172.21.15.133:0/2788190453 shutdown_connections 2023-10-08T16:04:22.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7fcddd805700 1 -- 172.21.15.133:0/2788190453 >> 172.21.15.133:0/2788190453 conn(0x7fcdd8063670 msgr2=0x7fcdd813f080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7f63d6185700 1 -- 172.21.15.133:0/4135586184 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63d00b0070 msgr2=0x7f63d00a6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7f63d6185700 1 --2- 172.21.15.133:0/4135586184 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63d00b0070 0x7f63d00a6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7f63d6185700 1 -- 172.21.15.133:0/4135586184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63d00b1dc0 msgr2=0x7f63d0156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7f63d6185700 1 --2- 172.21.15.133:0/4135586184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63d00b1dc0 0x7f63d0156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7f63d6185700 1 -- 172.21.15.133:0/4135586184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c0009420 con 0x7f63d0068380 2023-10-08T16:04:22.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7fcddd805700 1 -- 172.21.15.133:0/2788190453 shutdown_connections 2023-10-08T16:04:22.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7fcddd805700 1 -- 172.21.15.133:0/2788190453 wait complete. 2023-10-08T16:04:22.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7f63d6185700 1 --2- 172.21.15.133:0/4135586184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63d0068380 0x7f63d00a6830 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f63c800cc40 tx=0x7f63c8001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7f63c67fc700 1 -- 172.21.15.133:0/4135586184 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c800a9c0 con 0x7f63d0068380 2023-10-08T16:04:22.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7f63c67fc700 1 -- 172.21.15.133:0/4135586184 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c800ab20 con 0x7f63d0068380 2023-10-08T16:04:22.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7f63c67fc700 1 -- 172.21.15.133:0/4135586184 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c80070f0 con 0x7f63d0068380 2023-10-08T16:04:22.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7f63d7187700 1 -- 172.21.15.133:0/4135586184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d00a5dc0 con 0x7f63d0068380 2023-10-08T16:04:22.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.131+0000 7f63d7187700 1 -- 172.21.15.133:0/4135586184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d006cd60 con 0x7f63d0068380 2023-10-08T16:04:22.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.135+0000 7f63c67fc700 1 -- 172.21.15.133:0/4135586184 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f63c8007520 con 0x7f63d0068380 2023-10-08T16:04:22.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.135+0000 7f63c67fc700 1 --2- 172.21.15.133:0/4135586184 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f63b4060550 0x7f63b4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.135+0000 7f63c67fc700 1 -- 172.21.15.133:0/4135586184 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f63c807cbc0 con 0x7f63d0068380 2023-10-08T16:04:22.178 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2023-10-08T16:04:22.178 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-08T16:04:22.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f63d7187700 1 --2- 172.21.15.133:0/4135586184 >> [v2:172.21.15.190:6808/33678,v1:172.21.15.190:6810/33678] conn(0x7f63d00b5100 0x7f63d00aa770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f63d7187700 1 -- 172.21.15.133:0/4135586184 --> [v2:172.21.15.190:6808/33678,v1:172.21.15.190:6810/33678] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f63d00adc40 con 0x7f63d00b5100 2023-10-08T16:04:22.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f63d5984700 1 --2- 172.21.15.133:0/4135586184 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f63b4060550 0x7f63b4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f0f27147700 1 -- 172.21.15.133:0/258844047 --> [v2:172.21.15.133:6808/33491,v1:172.21.15.133:6810/33491] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0f20067580 con 0x7f0f200a6c90 2023-10-08T16:04:22.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f63d6986700 1 --2- 172.21.15.133:0/4135586184 >> [v2:172.21.15.190:6808/33678,v1:172.21.15.190:6810/33678] conn(0x7f63d00b5100 0x7f63d00aa770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7fe4b3f20700 1 -- 172.21.15.133:0/1306874843 >> [v2:172.21.15.133:6824/33492,v1:172.21.15.133:6825/33492] conn(0x7fe4900687b0 msgr2=0x7fe49006abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7fe4b3f20700 1 --2- 172.21.15.133:0/1306874843 >> [v2:172.21.15.133:6824/33492,v1:172.21.15.133:6825/33492] conn(0x7fe4900687b0 0x7fe49006abc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.180 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2023-10-08T16:04:22.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f0f1e7fc700 1 -- 172.21.15.133:0/258844047 <== osd.3 v2:172.21.15.133:6808/33491 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0f20067580 con 0x7f0f200a6c90 2023-10-08T16:04:22.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f63d5984700 1 --2- 172.21.15.133:0/4135586184 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f63b4060550 0x7f63b4062a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f63c00091e0 tx=0x7f63c0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.181 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T16:04:22.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f1111c48700 1 -- 172.21.15.133:0/2190092310 --> [v2:172.21.15.190:6809/33676,v1:172.21.15.190:6811/33676] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f110c159920 con 0x7f110c067ce0 2023-10-08T16:04:22.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7fe4b3f20700 1 -- 172.21.15.133:0/1306874843 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe490060620 msgr2=0x7fe490062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7fe4b3f20700 1 --2- 172.21.15.133:0/1306874843 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe490060620 0x7fe490062ad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe49c009740 tx=0x7fe49c006c60 comp rx=0 tx=0).stop 2023-10-08T16:04:22.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7fe4b3f20700 1 -- 172.21.15.133:0/1306874843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ac14a270 msgr2=0x7fe4ac13b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7fe4b3f20700 1 --2- 172.21.15.133:0/1306874843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ac14a270 0x7fe4ac13b3a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4009e50 tx=0x7fe4a400b040 comp rx=0 tx=0).stop 2023-10-08T16:04:22.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7fe4b24bd700 1 -- 172.21.15.133:0/1306874843 reap_dead start 2023-10-08T16:04:22.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7fe4b3f20700 1 -- 172.21.15.133:0/1306874843 shutdown_connections 2023-10-08T16:04:22.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7fe4b3f20700 1 -- 172.21.15.133:0/1306874843 >> 172.21.15.133:0/1306874843 conn(0x7fe4ac0b4990 msgr2=0x7fe4ac1497f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7fe4b3f20700 1 -- 172.21.15.133:0/1306874843 shutdown_connections 2023-10-08T16:04:22.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7fe4b3f20700 1 -- 172.21.15.133:0/1306874843 wait complete. 2023-10-08T16:04:22.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f63d6986700 1 --2- 172.21.15.133:0/4135586184 >> [v2:172.21.15.190:6808/33678,v1:172.21.15.190:6810/33678] conn(0x7f63d00b5100 0x7f63d00aa770 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f0f27147700 1 -- 172.21.15.133:0/258844047 >> [v2:172.21.15.133:6808/33491,v1:172.21.15.133:6810/33491] conn(0x7f0f200a6c90 msgr2=0x7f0f200ab050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f0f27147700 1 --2- 172.21.15.133:0/258844047 >> [v2:172.21.15.133:6808/33491,v1:172.21.15.133:6810/33491] conn(0x7f0f200a6c90 0x7f0f200ab050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f10f37fe700 1 -- 172.21.15.133:0/2190092310 <== osd.5 v2:172.21.15.190:6809/33676 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f110c159920 con 0x7f110c067ce0 2023-10-08T16:04:22.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f0f27147700 1 -- 172.21.15.133:0/258844047 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f0f0c060620 msgr2=0x7f0f0c062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f0f27147700 1 --2- 172.21.15.133:0/258844047 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f0f0c060620 0x7f0f0c062ad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0f200a9a50 tx=0x7f0f18009370 comp rx=0 tx=0).stop 2023-10-08T16:04:22.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f0f27147700 1 -- 172.21.15.133:0/258844047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f20067e10 msgr2=0x7f0f2006daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f0f27147700 1 --2- 172.21.15.133:0/258844047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f20067e10 0x7f0f2006daf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0f14009290 tx=0x7f0f14016000 comp rx=0 tx=0).stop 2023-10-08T16:04:22.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f0f26946700 1 -- 172.21.15.133:0/258844047 reap_dead start 2023-10-08T16:04:22.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f0f27147700 1 -- 172.21.15.133:0/258844047 shutdown_connections 2023-10-08T16:04:22.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f0f27147700 1 -- 172.21.15.133:0/258844047 >> 172.21.15.133:0/258844047 conn(0x7f0f200636b0 msgr2=0x7f0f200b33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f1111c48700 1 -- 172.21.15.133:0/2190092310 >> [v2:172.21.15.190:6809/33676,v1:172.21.15.190:6811/33676] conn(0x7f110c067ce0 msgr2=0x7f110c0680b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f1111c48700 1 --2- 172.21.15.133:0/2190092310 >> [v2:172.21.15.190:6809/33676,v1:172.21.15.190:6811/33676] conn(0x7f110c067ce0 0x7f110c0680b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f1111c48700 1 -- 172.21.15.133:0/2190092310 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f10f8060620 msgr2=0x7f10f8062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f1111c48700 1 --2- 172.21.15.133:0/2190092310 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f10f8060620 0x7f10f8062ad0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f110c0b02e0 tx=0x7f10fc007b50 comp rx=0 tx=0).stop 2023-10-08T16:04:22.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f1111c48700 1 -- 172.21.15.133:0/2190092310 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f110c06e070 msgr2=0x7f110c13ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f1111c48700 1 --2- 172.21.15.133:0/2190092310 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f110c06e070 0x7f110c13ada0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f110000d8c0 tx=0x7f1100008040 comp rx=0 tx=0).stop 2023-10-08T16:04:22.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f110bfff700 1 -- 172.21.15.133:0/2190092310 reap_dead start 2023-10-08T16:04:22.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f1111c48700 1 -- 172.21.15.133:0/2190092310 shutdown_connections 2023-10-08T16:04:22.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f1111c48700 1 -- 172.21.15.133:0/2190092310 >> 172.21.15.133:0/2190092310 conn(0x7f110c0b4ba0 msgr2=0x7f110c06e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f1111c48700 1 -- 172.21.15.133:0/2190092310 shutdown_connections 2023-10-08T16:04:22.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f0f27147700 1 -- 172.21.15.133:0/258844047 shutdown_connections 2023-10-08T16:04:22.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f1111c48700 1 -- 172.21.15.133:0/2190092310 wait complete. 2023-10-08T16:04:22.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f0f27147700 1 -- 172.21.15.133:0/258844047 wait complete. 2023-10-08T16:04:22.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.139+0000 7f63c67fc700 1 -- 172.21.15.133:0/4135586184 <== osd.4 v2:172.21.15.190:6808/33678 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f63d00adc40 con 0x7f63d00b5100 2023-10-08T16:04:22.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.147+0000 7f59874dc700 1 -- 172.21.15.133:0/3720815832 --> [v2:172.21.15.190:6800/33677,v1:172.21.15.190:6801/33677] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5964002d30 con 0x7f596c068990 2023-10-08T16:04:22.189 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2023-10-08T16:04:22.190 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T16:04:22.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.147+0000 7f59767fc700 1 -- 172.21.15.133:0/3720815832 <== osd.6 v2:172.21.15.190:6800/33677 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5964002d30 con 0x7f596c068990 2023-10-08T16:04:22.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.147+0000 7f59874dc700 1 -- 172.21.15.133:0/3720815832 >> [v2:172.21.15.190:6800/33677,v1:172.21.15.190:6801/33677] conn(0x7f596c068990 msgr2=0x7f596c06ada0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.147+0000 7f59874dc700 1 --2- 172.21.15.133:0/3720815832 >> [v2:172.21.15.190:6800/33677,v1:172.21.15.190:6801/33677] conn(0x7f596c068990 0x7f596c06ada0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.147+0000 7f59874dc700 1 -- 172.21.15.133:0/3720815832 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f596c060780 msgr2=0x7f596c062c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.147+0000 7f59874dc700 1 --2- 172.21.15.133:0/3720815832 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f596c060780 0x7f596c062c30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f597c001820 tx=0x7f597c009040 comp rx=0 tx=0).stop 2023-10-08T16:04:22.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.147+0000 7f59874dc700 1 -- 172.21.15.133:0/3720815832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59800b1dc0 msgr2=0x7f5980159da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.147+0000 7f59874dc700 1 --2- 172.21.15.133:0/3720815832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59800b1dc0 0x7f5980159da0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f597000d8c0 tx=0x7f5970008040 comp rx=0 tx=0).stop 2023-10-08T16:04:22.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.147+0000 7f5986cdb700 1 -- 172.21.15.133:0/3720815832 reap_dead start 2023-10-08T16:04:22.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.147+0000 7f59874dc700 1 -- 172.21.15.133:0/3720815832 shutdown_connections 2023-10-08T16:04:22.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.147+0000 7f59874dc700 1 -- 172.21.15.133:0/3720815832 >> 172.21.15.133:0/3720815832 conn(0x7f59800636b0 msgr2=0x7f59800687e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.151+0000 7f59874dc700 1 -- 172.21.15.133:0/3720815832 shutdown_connections 2023-10-08T16:04:22.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.151+0000 7f59874dc700 1 -- 172.21.15.133:0/3720815832 wait complete. 2023-10-08T16:04:22.193 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2023-10-08T16:04:22.193 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T16:04:22.194 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2023-10-08T16:04:22.194 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-08T16:04:22.195 INFO:teuthology.orchestra.run.smithi133.stdout:55834574855 2023-10-08T16:04:22.195 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-08T16:04:22.196 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2023-10-08T16:04:22.196 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-08T16:04:22.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.163+0000 7f63d7187700 1 -- 172.21.15.133:0/4135586184 --> [v2:172.21.15.190:6808/33678,v1:172.21.15.190:6810/33678] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f63d00aacb0 con 0x7f63d00b5100 2023-10-08T16:04:22.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.163+0000 7f63c67fc700 1 -- 172.21.15.133:0/4135586184 <== osd.4 v2:172.21.15.190:6808/33678 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f63d00aacb0 con 0x7f63d00b5100 2023-10-08T16:04:22.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.163+0000 7f63d7187700 1 -- 172.21.15.133:0/4135586184 >> [v2:172.21.15.190:6808/33678,v1:172.21.15.190:6810/33678] conn(0x7f63d00b5100 msgr2=0x7f63d00aa770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.163+0000 7f63d7187700 1 --2- 172.21.15.133:0/4135586184 >> [v2:172.21.15.190:6808/33678,v1:172.21.15.190:6810/33678] conn(0x7f63d00b5100 0x7f63d00aa770 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.163+0000 7f63d7187700 1 -- 172.21.15.133:0/4135586184 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f63b4060550 msgr2=0x7f63b4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.163+0000 7f63d7187700 1 --2- 172.21.15.133:0/4135586184 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f63b4060550 0x7f63b4062a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f63c00091e0 tx=0x7f63c0017000 comp rx=0 tx=0).stop 2023-10-08T16:04:22.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.163+0000 7f63d7187700 1 -- 172.21.15.133:0/4135586184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63d0068380 msgr2=0x7f63d00a6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.163+0000 7f63d7187700 1 --2- 172.21.15.133:0/4135586184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63d0068380 0x7f63d00a6830 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f63c800cc40 tx=0x7f63c8001a70 comp rx=0 tx=0).stop 2023-10-08T16:04:22.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.163+0000 7f63d6986700 1 -- 172.21.15.133:0/4135586184 reap_dead start 2023-10-08T16:04:22.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.163+0000 7f63d7187700 1 -- 172.21.15.133:0/4135586184 shutdown_connections 2023-10-08T16:04:22.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.163+0000 7f63d7187700 1 -- 172.21.15.133:0/4135586184 >> 172.21.15.133:0/4135586184 conn(0x7f63d00636b0 msgr2=0x7f63d00b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.163+0000 7f63d7187700 1 -- 172.21.15.133:0/4135586184 shutdown_connections 2023-10-08T16:04:22.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.163+0000 7f63d7187700 1 -- 172.21.15.133:0/4135586184 wait complete. 2023-10-08T16:04:22.200 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2023-10-08T16:04:22.200 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-08T16:04:22.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.359+0000 7fcc2759e700 1 Processor -- start 2023-10-08T16:04:22.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.359+0000 7fcc2759e700 1 -- start start 2023-10-08T16:04:22.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.359+0000 7fcc2759e700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcc28067ea0 0x7fcc280ad300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.359+0000 7fcc2759e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcc280af380 0x7fcc280af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.359+0000 7fcc2759e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc280ae8e0 con 0x7fcc280b1b90 2023-10-08T16:04:22.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.359+0000 7fcc2759e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc280aed70 con 0x7fcc280af380 2023-10-08T16:04:22.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.359+0000 7fcc2759e700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc280ad960 con 0x7fcc28067ea0 2023-10-08T16:04:22.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.359+0000 7fcc25d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcc280af380 0x7fcc280af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.359+0000 7fcc26d9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcc280b1b90 0x7fcc28141b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49404/0 (socket says 172.21.15.133:49404) 2023-10-08T16:04:22.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.359+0000 7fcc26d9d700 1 -- 172.21.15.133:0/2829692503 learned_addr learned my addr 172.21.15.133:0/2829692503 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:22.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.359+0000 7fcc25d9b700 1 -- 172.21.15.133:0/2829692503 >> v2:172.21.15.190:3300/0 conn(0x7fcc28067ea0 msgr2=0x7fcc280ad300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:22.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.359+0000 7fcc25d9b700 1 --2- 172.21.15.133:0/2829692503 >> v2:172.21.15.190:3300/0 conn(0x7fcc28067ea0 0x7fcc280ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.359+0000 7fcc25d9b700 1 -- 172.21.15.133:0/2829692503 >> v1:172.21.15.133:6789/0 conn(0x7fcc280b1b90 legacy=0x7fcc28141b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.359+0000 7fcc25d9b700 1 -- 172.21.15.133:0/2829692503 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc280ae290 con 0x7fcc280af380 2023-10-08T16:04:22.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.359+0000 7fcc25d9b700 1 --2- 172.21.15.133:0/2829692503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc280af380 0x7fcc280af770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcc2806a770 tx=0x7fcc1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b806d6fcb2060a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.359+0000 7fcc2559a700 1 -- 172.21.15.133:0/2829692503 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c00b6b0 con 0x7fcc280af380 2023-10-08T16:04:22.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.359+0000 7fcc2559a700 1 -- 172.21.15.133:0/2829692503 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1c00b810 con 0x7fcc280af380 2023-10-08T16:04:22.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.359+0000 7fcc2559a700 1 -- 172.21.15.133:0/2829692503 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c00bbb0 con 0x7fcc280af380 2023-10-08T16:04:22.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.359+0000 7f07f4dc9700 1 Processor -- start 2023-10-08T16:04:22.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f684eac4700 1 Processor -- start 2023-10-08T16:04:22.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f684eac4700 1 -- start start 2023-10-08T16:04:22.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7fcc2759e700 1 -- 172.21.15.133:0/2829692503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc280af380 msgr2=0x7fcc280af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7fcc2759e700 1 --2- 172.21.15.133:0/2829692503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc280af380 0x7fcc280af770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcc2806a770 tx=0x7fcc1c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f07f4dc9700 1 -- start start 2023-10-08T16:04:22.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7fcc2759e700 1 -- 172.21.15.133:0/2829692503 shutdown_connections 2023-10-08T16:04:22.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7fcc2759e700 1 --2- 172.21.15.133:0/2829692503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc280af380 0x7fcc280af770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7fcc2759e700 1 --2- 172.21.15.133:0/2829692503 >> v2:172.21.15.190:3300/0 conn(0x7fcc28067ea0 0x7fcc280ad300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7fcc2759e700 1 -- 172.21.15.133:0/2829692503 >> 172.21.15.133:0/2829692503 conn(0x7fcc280636b0 msgr2=0x7fcc280b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7fcc2759e700 1 -- 172.21.15.133:0/2829692503 shutdown_connections 2023-10-08T16:04:22.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7fcc2759e700 1 -- 172.21.15.133:0/2829692503 wait complete. 2023-10-08T16:04:22.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f07f4dc9700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f07e8007630 0x7f07e8039ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f07f4dc9700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07e8035390 0x7f07e80c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f07f4dc9700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e8037e10 con 0x7f07e80378f0 2023-10-08T16:04:22.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f07f4dc9700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e8037560 con 0x7f07e8007630 2023-10-08T16:04:22.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f07f4dc9700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80cf990 con 0x7f07e8035390 2023-10-08T16:04:22.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f07ee59c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f07e8007630 0x7f07e8039ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f07edd9b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07e8035390 0x7f07e80c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f07edd9b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07e8035390 0x7f07e80c95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.133:45610/0 (socket says 172.21.15.133:45610) 2023-10-08T16:04:22.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f07edd9b700 1 -- 172.21.15.133:0/2374482910 learned_addr learned my addr 172.21.15.133:0/2374482910 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f684eac4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f68480634e0 0x7f68480b0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f684eac4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6848145a00 0x7f6848145e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7fcc2759e700 1 Processor -- start 2023-10-08T16:04:22.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f07edd9b700 1 -- 172.21.15.133:0/2374482910 >> v2:172.21.15.190:3300/0 conn(0x7f07e8007630 msgr2=0x7f07e8039ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:22.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f07edd9b700 1 --2- 172.21.15.133:0/2374482910 >> v2:172.21.15.190:3300/0 conn(0x7f07e8007630 0x7f07e8039ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f684d061700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f684813c130 0x7f684813c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49414/0 (socket says 172.21.15.133:49414) 2023-10-08T16:04:22.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f684d061700 1 -- 172.21.15.133:0/2246136377 learned_addr learned my addr 172.21.15.133:0/2246136377 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:22.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f07edd9b700 1 -- 172.21.15.133:0/2374482910 >> v1:172.21.15.190:6789/0 conn(0x7f07e80378f0 legacy=0x7f07e80c9b00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T16:04:22.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f07edd9b700 1 -- 172.21.15.133:0/2374482910 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e80380f0 con 0x7f07e8035390 2023-10-08T16:04:22.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f6847fff700 1 --2- 172.21.15.133:0/2246136377 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6848145a00 0x7f6848145e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7fcc2759e700 1 -- start start 2023-10-08T16:04:22.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f684eac4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68480b4fa0 con 0x7f684813c130 2023-10-08T16:04:22.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f07edd9b700 1 --2- 172.21.15.133:0/2374482910 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07e8035390 0x7f07e80c95c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f07e00099b0 tx=0x7f07e0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b54596730223c84 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f684eac4700 1 -- 172.21.15.133:0/2246136377 --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68480b1d10 con 0x7f68480634e0 2023-10-08T16:04:22.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f684eac4700 1 -- 172.21.15.133:0/2246136377 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68480b0bc0 con 0x7f6848145a00 2023-10-08T16:04:22.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f9bd920d700 1 Processor -- start 2023-10-08T16:04:22.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f68477fe700 1 -- 172.21.15.133:0/2246136377 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 789420091 0 0) 0x7f68480b4fa0 con 0x7f684813c130 2023-10-08T16:04:22.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f68477fe700 1 -- 172.21.15.133:0/2246136377 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6830003570 con 0x7f684813c130 2023-10-08T16:04:22.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f9bd920d700 1 -- start start 2023-10-08T16:04:22.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f07ed59a700 1 -- 172.21.15.133:0/2374482910 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e0009ea0 con 0x7f07e8035390 2023-10-08T16:04:22.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f07ed59a700 1 -- 172.21.15.133:0/2374482910 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e000b820 con 0x7f07e8035390 2023-10-08T16:04:22.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7f07ed59a700 1 -- 172.21.15.133:0/2374482910 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e0009ea0 con 0x7f07e8035390 2023-10-08T16:04:22.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7fcc2759e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc28067ea0 0x7fcc280a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.363+0000 7fcc2759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc280af380 0x7fcc280a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7fcc2759e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc280b1b90 0x7fcc280a8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7fcc2759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2814dfe0 con 0x7fcc280af380 2023-10-08T16:04:22.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7fcc2759e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc281534b0 con 0x7fcc280b1b90 2023-10-08T16:04:22.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7fcc2759e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc28153790 con 0x7fcc28067ea0 2023-10-08T16:04:22.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f684c860700 1 --2- 172.21.15.133:0/2246136377 >> v2:172.21.15.133:3300/0 conn(0x7f68480634e0 0x7f68480b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7fcc25d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc280af380 0x7fcc280a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7fcc25d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc280af380 0x7fcc280a5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42874/0 (socket says 172.21.15.133:42874) 2023-10-08T16:04:22.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7fcc25d9b700 1 -- 172.21.15.133:0/2341820270 learned_addr learned my addr 172.21.15.133:0/2341820270 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7fcc2659c700 1 --2- 172.21.15.133:0/2341820270 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc28067ea0 0x7fcc280a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7fcc26d9d700 1 --2- 172.21.15.133:0/2341820270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc280b1b90 0x7fcc280a8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f684c860700 1 -- 172.21.15.133:0/2246136377 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6848145a00 msgr2=0x7f6848145e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:22.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f684c860700 1 --2- 172.21.15.133:0/2246136377 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6848145a00 0x7f6848145e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f684c860700 1 -- 172.21.15.133:0/2246136377 >> v1:172.21.15.133:6789/0 conn(0x7f684813c130 legacy=0x7f684813c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f684c860700 1 -- 172.21.15.133:0/2246136377 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6848146390 con 0x7f68480634e0 2023-10-08T16:04:22.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f07f4dc9700 1 -- 172.21.15.133:0/2374482910 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07e8035390 msgr2=0x7f07e80c95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f07f4dc9700 1 --2- 172.21.15.133:0/2374482910 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07e8035390 0x7f07e80c95c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f07e00099b0 tx=0x7f07e0009250 comp rx=0 tx=0).stop 2023-10-08T16:04:22.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7fcc25d9b700 1 -- 172.21.15.133:0/2341820270 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc28067ea0 msgr2=0x7fcc280a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7fcc25d9b700 1 --2- 172.21.15.133:0/2341820270 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc28067ea0 0x7fcc280a9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7fcc25d9b700 1 -- 172.21.15.133:0/2341820270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc280b1b90 msgr2=0x7fcc280a8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7fcc25d9b700 1 --2- 172.21.15.133:0/2341820270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc280b1b90 0x7fcc280a8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7fcc25d9b700 1 -- 172.21.15.133:0/2341820270 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1c009420 con 0x7fcc280af380 2023-10-08T16:04:22.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9bd920d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9bd40b1dc0 0x7f9bd4143810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9bd920d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9bd4140430 0x7f9bd41408b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f684c860700 1 --2- 172.21.15.133:0/2246136377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68480634e0 0x7f68480b0680 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f68380098e0 tx=0x7f68380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731d15e7289f4818 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9bd920d700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd41445c0 con 0x7f9bd406dda0 2023-10-08T16:04:22.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9bd920d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd4143d50 con 0x7f9bd4140430 2023-10-08T16:04:22.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9bd920d700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd4140df0 con 0x7f9bd40b1dc0 2023-10-08T16:04:22.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f07f4dc9700 1 -- 172.21.15.133:0/2374482910 shutdown_connections 2023-10-08T16:04:22.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9bd37fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9bd4140430 0x7f9bd41408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f07f4dc9700 1 --2- 172.21.15.133:0/2374482910 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07e8035390 0x7f07e80c95c0 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f07e00099b0 tx=0x7f07e0009250 comp rx=0 tx=0).stop 2023-10-08T16:04:22.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f07f4dc9700 1 --2- 172.21.15.133:0/2374482910 >> v2:172.21.15.190:3300/0 conn(0x7f07e8007630 0x7f07e8039ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f07f4dc9700 1 -- 172.21.15.133:0/2374482910 >> 172.21.15.133:0/2374482910 conn(0x7f07e803ea80 msgr2=0x7f07e803aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7fcc25d9b700 1 --2- 172.21.15.133:0/2341820270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc280af380 0x7fcc280a5900 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcc2806a7a0 tx=0x7fcc1c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9bd37fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9bd4140430 0x7f9bd41408b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42880/0 (socket says 172.21.15.133:42880) 2023-10-08T16:04:22.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9bd37fe700 1 -- 172.21.15.133:0/2041047190 learned_addr learned my addr 172.21.15.133:0/2041047190 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7fcc167fc700 1 -- 172.21.15.133:0/2341820270 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c00bb90 con 0x7fcc280af380 2023-10-08T16:04:22.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7fcc2759e700 1 -- 172.21.15.133:0/2341820270 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc28153a70 con 0x7fcc280af380 2023-10-08T16:04:22.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7fcc2759e700 1 -- 172.21.15.133:0/2341820270 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc28068270 con 0x7fcc280af380 2023-10-08T16:04:22.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f68477fe700 1 -- 172.21.15.133:0/2246136377 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683800b640 con 0x7f68480634e0 2023-10-08T16:04:22.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f68477fe700 1 -- 172.21.15.133:0/2246136377 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683800b7a0 con 0x7f68480634e0 2023-10-08T16:04:22.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f68477fe700 1 -- 172.21.15.133:0/2246136377 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683800bb60 con 0x7f68480634e0 2023-10-08T16:04:22.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9bd37fe700 1 -- 172.21.15.133:0/2041047190 >> v2:172.21.15.190:3300/0 conn(0x7f9bd40b1dc0 msgr2=0x7f9bd4143810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T16:04:22.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9bd37fe700 1 --2- 172.21.15.133:0/2041047190 >> v2:172.21.15.190:3300/0 conn(0x7f9bd40b1dc0 0x7f9bd4143810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9bd37fe700 1 -- 172.21.15.133:0/2041047190 >> v1:172.21.15.190:6789/0 conn(0x7f9bd406dda0 legacy=0x7f9bd406e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:22.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9bd37fe700 1 -- 172.21.15.133:0/2041047190 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd406b580 con 0x7f9bd4140430 2023-10-08T16:04:22.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f07f4dc9700 1 -- 172.21.15.133:0/2374482910 shutdown_connections 2023-10-08T16:04:22.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9c2d4ea700 1 Processor -- start 2023-10-08T16:04:22.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7fcc167fc700 1 -- 172.21.15.133:0/2341820270 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1c011420 con 0x7fcc280af380 2023-10-08T16:04:22.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f63283d8700 1 Processor -- start 2023-10-08T16:04:22.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f63283d8700 1 -- start start 2023-10-08T16:04:22.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9bd37fe700 1 --2- 172.21.15.133:0/2041047190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bd4140430 0x7f9bd41408b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9bd40b4930 tx=0x7f9bcc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b63d58ea150b3b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f07f4dc9700 1 -- 172.21.15.133:0/2374482910 wait complete. 2023-10-08T16:04:22.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f684eac4700 1 -- 172.21.15.133:0/2246136377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68480634e0 msgr2=0x7f68480b0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f684eac4700 1 --2- 172.21.15.133:0/2246136377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68480634e0 0x7f68480b0680 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f68380098e0 tx=0x7f68380091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f6482f53700 1 Processor -- start 2023-10-08T16:04:22.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9c2d4ea700 1 -- start start 2023-10-08T16:04:22.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9bd2ffd700 1 -- 172.21.15.133:0/2041047190 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc00e070 con 0x7f9bd4140430 2023-10-08T16:04:22.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9bd2ffd700 1 -- 172.21.15.133:0/2041047190 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bcc00ba10 con 0x7f9bd4140430 2023-10-08T16:04:22.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9bd2ffd700 1 -- 172.21.15.133:0/2041047190 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc0092e0 con 0x7f9bd4140430 2023-10-08T16:04:22.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f684eac4700 1 -- 172.21.15.133:0/2246136377 shutdown_connections 2023-10-08T16:04:22.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f684eac4700 1 --2- 172.21.15.133:0/2246136377 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6848145a00 0x7f6848145e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f684eac4700 1 --2- 172.21.15.133:0/2246136377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68480634e0 0x7f68480b0680 secure :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f68380098e0 tx=0x7f68380091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f684eac4700 1 -- 172.21.15.133:0/2246136377 >> 172.21.15.133:0/2246136377 conn(0x7f6848066f90 msgr2=0x7f6848062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9c2d4ea700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c280ac010 0x7f9c280af4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9c2d4ea700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9c28068970 0x7f9c280afa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9c2d4ea700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c280681f0 con 0x7f9c28149ff0 2023-10-08T16:04:22.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9c2d4ea700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c280ad390 con 0x7f9c28068970 2023-10-08T16:04:22.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9c2d4ea700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c280ad590 con 0x7f9c280ac010 2023-10-08T16:04:22.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9c277fe700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9c28068970 0x7f9c280afa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9c27fff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c280ac010 0x7f9c280af4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f07f4dc9700 1 Processor -- start 2023-10-08T16:04:22.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9c277fe700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9c28068970 0x7f9c280afa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.133:53378/0 (socket says 172.21.15.133:53378) 2023-10-08T16:04:22.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9c2cce9700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f9c28149ff0 0x7f9c2814a470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.133:42748/0 (socket says 172.21.15.133:42748) 2023-10-08T16:04:22.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9c277fe700 1 -- 172.21.15.133:0/2225952975 learned_addr learned my addr 172.21.15.133:0/2225952975 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f07f4dc9700 1 -- start start 2023-10-08T16:04:22.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9bd920d700 1 -- 172.21.15.133:0/2041047190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bd4140430 msgr2=0x7f9bd41408b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f9bd920d700 1 --2- 172.21.15.133:0/2041047190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bd4140430 0x7f9bd41408b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9bd40b4930 tx=0x7f9bcc009840 comp rx=0 tx=0).stop 2023-10-08T16:04:22.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f684eac4700 1 -- 172.21.15.133:0/2246136377 shutdown_connections 2023-10-08T16:04:22.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f63283d8700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f63200a9b00 0x7f6320067ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7fcc167fc700 1 -- 172.21.15.133:0/2341820270 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c0117e0 con 0x7fcc280af380 2023-10-08T16:04:22.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f63283d8700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63200aa6b0 0x7f63200aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7fcc167fc700 1 -- 172.21.15.133:0/2341820270 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fcc1c011b50 con 0x7fcc280af380 2023-10-08T16:04:22.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.367+0000 7f684eac4700 1 -- 172.21.15.133:0/2246136377 wait complete. 2023-10-08T16:04:22.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f63283d8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63200afff0 con 0x7f6320145c60 2023-10-08T16:04:22.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f63283d8700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63200aac00 con 0x7f63200a9b00 2023-10-08T16:04:22.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f63283d8700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63200aaee0 con 0x7f63200aa6b0 2023-10-08T16:04:22.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6325973700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63200aa6b0 0x7f63200aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6325973700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63200aa6b0 0x7f63200aeb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.133:45654/0 (socket says 172.21.15.133:45654) 2023-10-08T16:04:22.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6325973700 1 -- 172.21.15.133:0/3210601734 learned_addr learned my addr 172.21.15.133:0/3210601734 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7fcc167fc700 1 --2- 172.21.15.133:0/2341820270 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fcc08060720 0x7fcc08062bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f07f4dc9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07e8007630 0x7f07e803c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f07f4dc9700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07e80378f0 0x7f07e80c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f07f4dc9700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07e80d2fa0 0x7f07e80d3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f07f4dc9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80d46d0 con 0x7f07e8007630 2023-10-08T16:04:22.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f07f4dc9700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80c7ae0 con 0x7f07e80d2fa0 2023-10-08T16:04:22.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f07f4dc9700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80c7dc0 con 0x7f07e80378f0 2023-10-08T16:04:22.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f9c27fff700 1 -- 172.21.15.133:0/2225952975 >> v2:172.21.15.190:3300/0 conn(0x7f9c28068970 msgr2=0x7f9c280afa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:22.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f9c27fff700 1 --2- 172.21.15.133:0/2225952975 >> v2:172.21.15.190:3300/0 conn(0x7f9c28068970 0x7f9c280afa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f9c27fff700 1 -- 172.21.15.133:0/2225952975 >> v1:172.21.15.190:6789/0 conn(0x7f9c28149ff0 legacy=0x7f9c2814a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f9c27fff700 1 -- 172.21.15.133:0/2225952975 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c28067ba0 con 0x7f9c280ac010 2023-10-08T16:04:22.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f9c27fff700 1 --2- 172.21.15.133:0/2225952975 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c280ac010 0x7f9c280af4f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9c180098e0 tx=0x7f9c180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f448270188d4d7a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f9c26ffd700 1 -- 172.21.15.133:0/2225952975 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1800b640 con 0x7f9c280ac010 2023-10-08T16:04:22.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f9c26ffd700 1 -- 172.21.15.133:0/2225952975 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1800b7a0 con 0x7f9c280ac010 2023-10-08T16:04:22.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f9c26ffd700 1 -- 172.21.15.133:0/2225952975 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1800bb40 con 0x7f9c280ac010 2023-10-08T16:04:22.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7fcc167fc700 1 -- 172.21.15.133:0/2341820270 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcc1c07def0 con 0x7fcc280af380 2023-10-08T16:04:22.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7fcc2659c700 1 --2- 172.21.15.133:0/2341820270 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fcc08060720 0x7fcc08062bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f07ee59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07e8007630 0x7f07e803c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f07ee59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07e8007630 0x7f07e803c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42892/0 (socket says 172.21.15.133:42892) 2023-10-08T16:04:22.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f07ee59c700 1 -- 172.21.15.133:0/1982278278 learned_addr learned my addr 172.21.15.133:0/1982278278 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f07eed9d700 1 --2- 172.21.15.133:0/1982278278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07e80d2fa0 0x7f07e80d3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f07edd9b700 1 --2- 172.21.15.133:0/1982278278 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07e80378f0 0x7f07e80c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f07ee59c700 1 -- 172.21.15.133:0/1982278278 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07e80378f0 msgr2=0x7f07e80c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6482f53700 1 -- start start 2023-10-08T16:04:22.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6325973700 1 -- 172.21.15.133:0/3210601734 >> v2:172.21.15.190:3300/0 conn(0x7f63200a9b00 msgr2=0x7f6320067ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T16:04:22.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6325973700 1 --2- 172.21.15.133:0/3210601734 >> v2:172.21.15.190:3300/0 conn(0x7f63200a9b00 0x7f6320067ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6325973700 1 -- 172.21.15.133:0/3210601734 >> v1:172.21.15.133:6789/0 conn(0x7f6320145c60 legacy=0x7f6320146100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6325973700 1 -- 172.21.15.133:0/3210601734 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63200abbb0 con 0x7f63200aa6b0 2023-10-08T16:04:22.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f684eac4700 1 Processor -- start 2023-10-08T16:04:22.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f684eac4700 1 -- start start 2023-10-08T16:04:22.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f9bd920d700 1 -- 172.21.15.133:0/2041047190 shutdown_connections 2023-10-08T16:04:22.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f9bd920d700 1 --2- 172.21.15.133:0/2041047190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bd4140430 0x7f9bd41408b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f9bd920d700 1 --2- 172.21.15.133:0/2041047190 >> v2:172.21.15.190:3300/0 conn(0x7f9bd40b1dc0 0x7f9bd4143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f9bd920d700 1 -- 172.21.15.133:0/2041047190 >> 172.21.15.133:0/2041047190 conn(0x7f9bd40636b0 msgr2=0x7f9bd40b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6325973700 1 --2- 172.21.15.133:0/3210601734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63200aa6b0 0x7f63200aeb20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f63100099e0 tx=0x7f6310009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ecec498d660d922 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7fcc2759e700 1 -- 172.21.15.133:0/2341820270 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc0c0052b0 con 0x7fcc280af380 2023-10-08T16:04:22.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7fcc2659c700 1 --2- 172.21.15.133:0/2341820270 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fcc08060720 0x7fcc08062bd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcc18009bf0 tx=0x7fcc180091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f9c2d4ea700 1 -- 172.21.15.133:0/2225952975 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c280ac010 msgr2=0x7f9c280af4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f9c2d4ea700 1 --2- 172.21.15.133:0/2225952975 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c280ac010 0x7f9c280af4f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9c180098e0 tx=0x7f9c180091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6325172700 1 -- 172.21.15.133:0/3210601734 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631000b820 con 0x7f63200aa6b0 2023-10-08T16:04:22.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6325172700 1 -- 172.21.15.133:0/3210601734 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631000b980 con 0x7f63200aa6b0 2023-10-08T16:04:22.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6325172700 1 -- 172.21.15.133:0/3210601734 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631000bd40 con 0x7f63200aa6b0 2023-10-08T16:04:22.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6482f53700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f647c142d90 0x7f647c13bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6482f53700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f647c0b43c0 0x7f647c13c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6482f53700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647c0b4fd0 con 0x7f647c0634e0 2023-10-08T16:04:22.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6482f53700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f647c13c9f0 con 0x7f647c0b43c0 2023-10-08T16:04:22.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6482f53700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f647c0b18e0 con 0x7f647c142d90 2023-10-08T16:04:22.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f684eac4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f684813c130 0x7f68480af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f07ee59c700 1 --2- 172.21.15.133:0/1982278278 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07e80378f0 0x7f07e80c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f07ee59c700 1 -- 172.21.15.133:0/1982278278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07e80d2fa0 msgr2=0x7f07e80d3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f07ee59c700 1 --2- 172.21.15.133:0/1982278278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07e80d2fa0 0x7f07e80d3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f07ee59c700 1 -- 172.21.15.133:0/1982278278 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e00094f0 con 0x7f07e8007630 2023-10-08T16:04:22.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f07edd9b700 1 --2- 172.21.15.133:0/1982278278 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07e80378f0 0x7f07e80c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:22.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f07ee59c700 1 --2- 172.21.15.133:0/1982278278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07e8007630 0x7f07e803c540 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f07e400ec80 tx=0x7f07e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f07de7fc700 1 -- 172.21.15.133:0/1982278278 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e400c850 con 0x7f07e8007630 2023-10-08T16:04:22.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f07de7fc700 1 -- 172.21.15.133:0/1982278278 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e400c9b0 con 0x7f07e8007630 2023-10-08T16:04:22.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f07de7fc700 1 -- 172.21.15.133:0/1982278278 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e400cd70 con 0x7f07e8007630 2023-10-08T16:04:22.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f07f4dc9700 1 -- 172.21.15.133:0/1982278278 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e80c8250 con 0x7f07e8007630 2023-10-08T16:04:22.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f07f4dc9700 1 -- 172.21.15.133:0/1982278278 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e80c8810 con 0x7f07e8007630 2023-10-08T16:04:22.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f684eac4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6848145a00 0x7f6848141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f684eac4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6848142500 0x7f6848159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f684eac4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68480ae360 con 0x7f6848142500 2023-10-08T16:04:22.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f684eac4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68481429a0 con 0x7f6848145a00 2023-10-08T16:04:22.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f684eac4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6848141470 con 0x7f684813c130 2023-10-08T16:04:22.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f9bd920d700 1 -- 172.21.15.133:0/2041047190 shutdown_connections 2023-10-08T16:04:22.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6481750700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f647c142d90 0x7f647c13bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6481750700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f647c142d90 0x7f647c13bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.133:53410/0 (socket says 172.21.15.133:53410) 2023-10-08T16:04:22.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6481750700 1 -- 172.21.15.133:0/2264531963 learned_addr learned my addr 172.21.15.133:0/2264531963 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6847fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6848145a00 0x7f6848141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f684c860700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f684813c130 0x7f68480af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6847fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6848145a00 0x7f6848141fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.133:53422/0 (socket says 172.21.15.133:53422) 2023-10-08T16:04:22.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6847fff700 1 -- 172.21.15.133:0/1128311697 learned_addr learned my addr 172.21.15.133:0/1128311697 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f63283d8700 1 -- 172.21.15.133:0/3210601734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63200aa6b0 msgr2=0x7f63200aeb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f63283d8700 1 --2- 172.21.15.133:0/3210601734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63200aa6b0 0x7f63200aeb20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f63100099e0 tx=0x7f6310009250 comp rx=0 tx=0).stop 2023-10-08T16:04:22.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6482752700 1 --2- 172.21.15.133:0/2264531963 >> v2:172.21.15.133:3300/0 conn(0x7f647c0b43c0 0x7f647c13c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f63283d8700 1 -- 172.21.15.133:0/3210601734 shutdown_connections 2023-10-08T16:04:22.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f63283d8700 1 --2- 172.21.15.133:0/3210601734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63200aa6b0 0x7f63200aeb20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f63283d8700 1 --2- 172.21.15.133:0/3210601734 >> v2:172.21.15.190:3300/0 conn(0x7f63200a9b00 0x7f6320067ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f63283d8700 1 -- 172.21.15.133:0/3210601734 >> 172.21.15.133:0/3210601734 conn(0x7f63200b4ba0 msgr2=0x7f63200b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f684d061700 1 --2- 172.21.15.133:0/1128311697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6848142500 0x7f6848159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f684c860700 1 -- 172.21.15.133:0/1128311697 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6848145a00 msgr2=0x7f6848141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f684c860700 1 --2- 172.21.15.133:0/1128311697 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6848145a00 0x7f6848141fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f684c860700 1 -- 172.21.15.133:0/1128311697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6848142500 msgr2=0x7f6848159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f684c860700 1 --2- 172.21.15.133:0/1128311697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6848142500 0x7f6848159850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f684c860700 1 -- 172.21.15.133:0/1128311697 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6838009420 con 0x7f684813c130 2023-10-08T16:04:22.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6482752700 1 -- 172.21.15.133:0/2264531963 >> v2:172.21.15.190:3300/0 conn(0x7f647c142d90 msgr2=0x7f647c13bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:22.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6482752700 1 --2- 172.21.15.133:0/2264531963 >> v2:172.21.15.190:3300/0 conn(0x7f647c142d90 0x7f647c13bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6482752700 1 -- 172.21.15.133:0/2264531963 >> v1:172.21.15.133:6789/0 conn(0x7f647c0634e0 legacy=0x7f647c142680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6482752700 1 -- 172.21.15.133:0/2264531963 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647c0b4980 con 0x7f647c0b43c0 2023-10-08T16:04:22.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6847fff700 1 --2- 172.21.15.133:0/1128311697 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6848145a00 0x7f6848141fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:04:22.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f684c860700 1 --2- 172.21.15.133:0/1128311697 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f684813c130 0x7f68480af450 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6838016000 tx=0x7f6838017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6482752700 1 --2- 172.21.15.133:0/2264531963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c0b43c0 0x7f647c13c4b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f647c142330 tx=0x7f6474009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef140bd2dddc2b5d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.371+0000 7f6844ff9700 1 -- 172.21.15.133:0/1128311697 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683800bb20 con 0x7f684813c130 2023-10-08T16:04:22.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f63283d8700 1 -- 172.21.15.133:0/3210601734 shutdown_connections 2023-10-08T16:04:22.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f684eac4700 1 -- 172.21.15.133:0/1128311697 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6848141750 con 0x7f684813c130 2023-10-08T16:04:22.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f9c2d4ea700 1 -- 172.21.15.133:0/2225952975 shutdown_connections 2023-10-08T16:04:22.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f9c2d4ea700 1 --2- 172.21.15.133:0/2225952975 >> v2:172.21.15.190:3300/0 conn(0x7f9c28068970 0x7f9c280afa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f9c2d4ea700 1 --2- 172.21.15.133:0/2225952975 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c280ac010 0x7f9c280af4f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f9c2d4ea700 1 -- 172.21.15.133:0/2225952975 >> 172.21.15.133:0/2225952975 conn(0x7f9c28063670 msgr2=0x7f9c280b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f684eac4700 1 -- 172.21.15.133:0/1128311697 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68480af990 con 0x7f684813c130 2023-10-08T16:04:22.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f9bd920d700 1 -- 172.21.15.133:0/2041047190 wait complete. 2023-10-08T16:04:22.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f63283d8700 1 -- 172.21.15.133:0/3210601734 wait complete. 2023-10-08T16:04:22.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f6844ff9700 1 -- 172.21.15.133:0/1128311697 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6838006bc0 con 0x7f684813c130 2023-10-08T16:04:22.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f6844ff9700 1 -- 172.21.15.133:0/1128311697 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6838024440 con 0x7f684813c130 2023-10-08T16:04:22.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f9bd920d700 1 Processor -- start 2023-10-08T16:04:22.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f9bd920d700 1 -- start start 2023-10-08T16:04:22.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f63283d8700 1 Processor -- start 2023-10-08T16:04:22.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f63283d8700 1 -- start start 2023-10-08T16:04:22.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f9bd920d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bd406dda0 0x7f9bd40b4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f07f4dc9700 1 -- 172.21.15.133:0/1982278278 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d40052b0 con 0x7f07e8007630 2023-10-08T16:04:22.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f9bd920d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bd40b1dc0 0x7f9bd41500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f9bd920d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bd4140430 0x7f9bd4150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f9bd920d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd40a6e00 con 0x7f9bd40b1dc0 2023-10-08T16:04:22.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f9bd920d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd40a78d0 con 0x7f9bd406dda0 2023-10-08T16:04:22.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f9bd920d700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd40a7ad0 con 0x7f9bd4140430 2023-10-08T16:04:22.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f684eac4700 1 -- 172.21.15.133:0/1128311697 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68280052b0 con 0x7f684813c130 2023-10-08T16:04:22.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f6844ff9700 1 -- 172.21.15.133:0/1128311697 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6838024890 con 0x7f684813c130 2023-10-08T16:04:22.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f9bd3fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bd406dda0 0x7f9bd40b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f9bd3fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bd406dda0 0x7f9bd40b4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.133:53430/0 (socket says 172.21.15.133:53430) 2023-10-08T16:04:22.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f9bd3fff700 1 -- 172.21.15.133:0/175203033 learned_addr learned my addr 172.21.15.133:0/175203033 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f63283d8700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63200a9b00 0x7f6320144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f63283d8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63200aa6b0 0x7f632013d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f63283d8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6320145c60 0x7f632013beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f63283d8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632013e6d0 con 0x7f6320145c60 2023-10-08T16:04:22.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f63283d8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6320147340 con 0x7f63200aa6b0 2023-10-08T16:04:22.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f63283d8700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63201483b0 con 0x7f63200a9b00 2023-10-08T16:04:22.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f9bd8a0c700 1 --2- 172.21.15.133:0/175203033 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bd4140430 0x7f9bd4150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f9bd37fe700 1 --2- 172.21.15.133:0/175203033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bd40b1dc0 0x7f9bd41500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f6326975700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6320145c60 0x7f632013beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f6844ff9700 1 --2- 172.21.15.133:0/1128311697 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6834060550 0x7f6834062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f6326975700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6320145c60 0x7f632013beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42932/0 (socket says 172.21.15.133:42932) 2023-10-08T16:04:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f6326975700 1 -- 172.21.15.133:0/3466381760 learned_addr learned my addr 172.21.15.133:0/3466381760 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f6325973700 1 --2- 172.21.15.133:0/3466381760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63200aa6b0 0x7f632013d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f6326174700 1 --2- 172.21.15.133:0/3466381760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63200a9b00 0x7f6320144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f6844ff9700 1 -- 172.21.15.133:0/1128311697 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f683807e0c0 con 0x7f684813c130 2023-10-08T16:04:22.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f6847fff700 1 --2- 172.21.15.133:0/1128311697 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6834060550 0x7f6834062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.379+0000 7f9bd8a0c700 1 -- 172.21.15.133:0/175203033 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bd406dda0 msgr2=0x7f9bd40b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.379+0000 7f9bd8a0c700 1 --2- 172.21.15.133:0/175203033 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bd406dda0 0x7f9bd40b4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.379+0000 7f9bd8a0c700 1 -- 172.21.15.133:0/175203033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bd40b1dc0 msgr2=0x7f9bd41500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.379+0000 7f9bd8a0c700 1 --2- 172.21.15.133:0/175203033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bd40b1dc0 0x7f9bd41500d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.379+0000 7f9bd8a0c700 1 -- 172.21.15.133:0/175203033 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bcc009ae0 con 0x7f9bd4140430 2023-10-08T16:04:22.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f6326975700 1 -- 172.21.15.133:0/3466381760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63200a9b00 msgr2=0x7f6320144db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f6326975700 1 --2- 172.21.15.133:0/3466381760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63200a9b00 0x7f6320144db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.375+0000 7f6326975700 1 -- 172.21.15.133:0/3466381760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63200aa6b0 msgr2=0x7f632013d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.379+0000 7f6326975700 1 --2- 172.21.15.133:0/3466381760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63200aa6b0 0x7f632013d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.379+0000 7f6326975700 1 -- 172.21.15.133:0/3466381760 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63100094f0 con 0x7f6320145c60 2023-10-08T16:04:22.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.379+0000 7f6326975700 1 --2- 172.21.15.133:0/3466381760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6320145c60 0x7f632013beb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f631800c7f0 tx=0x7f6318001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.379+0000 7f9bd8a0c700 1 --2- 172.21.15.133:0/175203033 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bd4140430 0x7f9bd4150610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9bc400b4c0 tx=0x7f9bc4009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.379+0000 7f6847fff700 1 --2- 172.21.15.133:0/1128311697 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6834060550 0x7f6834062a00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f68481431d0 tx=0x7f683c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.379+0000 7fcc167fc700 1 -- 172.21.15.133:0/2341820270 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcc1c04e540 con 0x7fcc280af380 2023-10-08T16:04:22.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.379+0000 7f6480f4f700 1 -- 172.21.15.133:0/2264531963 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647400e070 con 0x7f647c0b43c0 2023-10-08T16:04:22.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.379+0000 7f07de7fc700 1 -- 172.21.15.133:0/1982278278 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f07e4013680 con 0x7f07e8007630 2023-10-08T16:04:22.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.379+0000 7f07de7fc700 1 --2- 172.21.15.133:0/1982278278 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f07d0060620 0x7f07d0062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.379+0000 7f07de7fc700 1 -- 172.21.15.133:0/1982278278 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f07e407d020 con 0x7f07e8007630 2023-10-08T16:04:22.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.379+0000 7f07edd9b700 1 --2- 172.21.15.133:0/1982278278 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f07d0060620 0x7f07d0062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.379+0000 7f07edd9b700 1 --2- 172.21.15.133:0/1982278278 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f07d0060620 0x7f07d0062ad0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f07e8039ac0 tx=0x7f07e0016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f9c2d4ea700 1 -- 172.21.15.133:0/2225952975 shutdown_connections 2023-10-08T16:04:22.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f9c2d4ea700 1 -- 172.21.15.133:0/2225952975 wait complete. 2023-10-08T16:04:22.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f6480f4f700 1 -- 172.21.15.133:0/2264531963 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f647400bb60 con 0x7f647c0b43c0 2023-10-08T16:04:22.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f6480f4f700 1 -- 172.21.15.133:0/2264531963 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6474012430 con 0x7f647c0b43c0 2023-10-08T16:04:22.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f9c2d4ea700 1 Processor -- start 2023-10-08T16:04:22.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f6482f53700 1 -- 172.21.15.133:0/2264531963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c0b43c0 msgr2=0x7f647c13c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f6482f53700 1 --2- 172.21.15.133:0/2264531963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c0b43c0 0x7f647c13c4b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f647c142330 tx=0x7f6474009780 comp rx=0 tx=0).stop 2023-10-08T16:04:22.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f9c2d4ea700 1 -- start start 2023-10-08T16:04:22.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f6482f53700 1 -- 172.21.15.133:0/2264531963 shutdown_connections 2023-10-08T16:04:22.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f6482f53700 1 --2- 172.21.15.133:0/2264531963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c0b43c0 0x7f647c13c4b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f6482f53700 1 --2- 172.21.15.133:0/2264531963 >> v2:172.21.15.190:3300/0 conn(0x7f647c142d90 0x7f647c13bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f6482f53700 1 -- 172.21.15.133:0/2264531963 >> 172.21.15.133:0/2264531963 conn(0x7f647c067ca0 msgr2=0x7f647c062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f6482f53700 1 -- 172.21.15.133:0/2264531963 shutdown_connections 2023-10-08T16:04:22.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f6482f53700 1 -- 172.21.15.133:0/2264531963 wait complete. 2023-10-08T16:04:22.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f63167fc700 1 -- 172.21.15.133:0/3466381760 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6318012630 con 0x7f6320145c60 2023-10-08T16:04:22.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f63167fc700 1 -- 172.21.15.133:0/3466381760 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6318012790 con 0x7f6320145c60 2023-10-08T16:04:22.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f63167fc700 1 -- 172.21.15.133:0/3466381760 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6318012b50 con 0x7f6320145c60 2023-10-08T16:04:22.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f9c2d4ea700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c28068970 0x7f9c28140a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f9c2d4ea700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c280ac010 0x7f9c28140fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f9c2d4ea700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c28149ff0 0x7f9c280aadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f9c2d4ea700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c28142940 con 0x7f9c28068970 2023-10-08T16:04:22.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f9c2d4ea700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c28157400 con 0x7f9c280ac010 2023-10-08T16:04:22.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f9c2d4ea700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c280a5840 con 0x7f9c28149ff0 2023-10-08T16:04:22.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f07de7fc700 1 -- 172.21.15.133:0/1982278278 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f07e404d770 con 0x7f07e8007630 2023-10-08T16:04:22.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f6482f53700 1 Processor -- start 2023-10-08T16:04:22.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f33a2507700 1 Processor -- start 2023-10-08T16:04:22.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f33a2507700 1 -- start start 2023-10-08T16:04:22.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f63283d8700 1 -- 172.21.15.133:0/3466381760 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f632013ca90 con 0x7f6320145c60 2023-10-08T16:04:22.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f63283d8700 1 -- 172.21.15.133:0/3466381760 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f632013d700 con 0x7f6320145c60 2023-10-08T16:04:22.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f6482f53700 1 -- start start 2023-10-08T16:04:22.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f9c27fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c28068970 0x7f9c28140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f9c27fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c28068970 0x7f9c28140a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42940/0 (socket says 172.21.15.133:42940) 2023-10-08T16:04:22.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f9c27fff700 1 -- 172.21.15.133:0/1190155200 learned_addr learned my addr 172.21.15.133:0/1190155200 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f9c2cce9700 1 --2- 172.21.15.133:0/1190155200 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c28149ff0 0x7f9c280aadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f9c27fff700 1 -- 172.21.15.133:0/1190155200 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c28149ff0 msgr2=0x7f9c280aadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f9c27fff700 1 --2- 172.21.15.133:0/1190155200 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c28149ff0 0x7f9c280aadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f9c27fff700 1 -- 172.21.15.133:0/1190155200 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c280ac010 msgr2=0x7f9c28140fb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:04:22.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f9c27fff700 1 --2- 172.21.15.133:0/1190155200 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c280ac010 0x7f9c28140fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f9c27fff700 1 -- 172.21.15.133:0/1190155200 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c18009420 con 0x7f9c28068970 2023-10-08T16:04:22.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f9c27fff700 1 --2- 172.21.15.133:0/1190155200 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c28068970 0x7f9c28140a70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009f80 tx=0x7f9c18017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f9c0ffff700 1 -- 172.21.15.133:0/1190155200 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1800bb20 con 0x7f9c28068970 2023-10-08T16:04:22.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f9c0ffff700 1 -- 172.21.15.133:0/1190155200 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c18024440 con 0x7f9c28068970 2023-10-08T16:04:22.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f9c0ffff700 1 -- 172.21.15.133:0/1190155200 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c18024800 con 0x7f9c28068970 2023-10-08T16:04:22.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f9c2d4ea700 1 -- 172.21.15.133:0/1190155200 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c28156e40 con 0x7f9c28068970 2023-10-08T16:04:22.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f9c2d4ea700 1 -- 172.21.15.133:0/1190155200 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c2806da70 con 0x7f9c28068970 2023-10-08T16:04:22.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f6482f53700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f647c0634e0 0x7f647c1595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f6482f53700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f647c0b43c0 0x7f647c13dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f6482f53700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c142d90 0x7f647c13f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f6482f53700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c145460 con 0x7f647c142d90 2023-10-08T16:04:22.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f6482f53700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c13d7a0 con 0x7f647c0b43c0 2023-10-08T16:04:22.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f6482f53700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647c13eef0 con 0x7f647c0634e0 2023-10-08T16:04:22.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.383+0000 7f63283d8700 1 -- 172.21.15.133:0/3466381760 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6320148570 con 0x7f6320145c60 2023-10-08T16:04:22.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f6481f51700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f647c0634e0 0x7f647c1595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f6481f51700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f647c0634e0 0x7f647c1595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.133:45706/0 (socket says 172.21.15.133:45706) 2023-10-08T16:04:22.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f6481f51700 1 -- 172.21.15.133:0/26533065 learned_addr learned my addr 172.21.15.133:0/26533065 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f63167fc700 1 -- 172.21.15.133:0/3466381760 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6318003030 con 0x7f6320145c60 2023-10-08T16:04:22.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f6481f51700 1 -- 172.21.15.133:0/26533065 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f647c0b43c0 msgr2=0x7f647c13dc30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:04:22.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f6481f51700 1 --2- 172.21.15.133:0/26533065 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f647c0b43c0 0x7f647c13dc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f6481f51700 1 -- 172.21.15.133:0/26533065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c142d90 msgr2=0x7f647c13f920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:04:22.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f6481f51700 1 --2- 172.21.15.133:0/26533065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c142d90 0x7f647c13f920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f6481f51700 1 -- 172.21.15.133:0/26533065 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6474009a20 con 0x7f647c0634e0 2023-10-08T16:04:22.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f63167fc700 1 --2- 172.21.15.133:0/3466381760 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6304060620 0x7f6304062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f63167fc700 1 -- 172.21.15.133:0/3466381760 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f631807c5e0 con 0x7f6320145c60 2023-10-08T16:04:22.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f6326174700 1 --2- 172.21.15.133:0/3466381760 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6304060620 0x7f6304062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f6326174700 1 --2- 172.21.15.133:0/3466381760 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6304060620 0x7f6304062ad0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f631c006fd0 tx=0x7f631c0090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f33a2507700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f339c067f10 0x7f339c13f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f33a2507700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f339c0b11f0 0x7f339c06e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f33a2507700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f339c0ad190 con 0x7f339c0ac440 2023-10-08T16:04:22.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f33a2507700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f339c140290 con 0x7f339c067f10 2023-10-08T16:04:22.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f33a2507700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339c0ae9b0 con 0x7f339c0b11f0 2023-10-08T16:04:22.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f33a0aa4700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f339c0ac440 0x7f339c0af510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49430/0 (socket says 172.21.15.133:49430) 2023-10-08T16:04:22.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f33a0aa4700 1 -- 172.21.15.133:0/911555335 learned_addr learned my addr 172.21.15.133:0/911555335 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:22.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f339b7fe700 1 --2- 172.21.15.133:0/911555335 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f339c0b11f0 0x7f339c06e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f339bfff700 1 --2- 172.21.15.133:0/911555335 >> v2:172.21.15.190:3300/0 conn(0x7f339c067f10 0x7f339c13f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f9c0ffff700 1 -- 172.21.15.133:0/1190155200 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9c18011420 con 0x7f9c28068970 2023-10-08T16:04:22.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f9bbbfff700 1 -- 172.21.15.133:0/175203033 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc400be70 con 0x7f9bd4140430 2023-10-08T16:04:22.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f9bd920d700 1 -- 172.21.15.133:0/175203033 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd4153be0 con 0x7f9bd4140430 2023-10-08T16:04:22.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f9bd920d700 1 -- 172.21.15.133:0/175203033 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd413dec0 con 0x7f9bd4140430 2023-10-08T16:04:22.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f339bfff700 1 -- 172.21.15.133:0/911555335 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f339c0b11f0 msgr2=0x7f339c06e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:22.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f339bfff700 1 --2- 172.21.15.133:0/911555335 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f339c0b11f0 0x7f339c06e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f339bfff700 1 -- 172.21.15.133:0/911555335 >> v1:172.21.15.133:6789/0 conn(0x7f339c0ac440 legacy=0x7f339c0af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f339bfff700 1 -- 172.21.15.133:0/911555335 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339c0ace20 con 0x7f339c067f10 2023-10-08T16:04:22.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.391+0000 7f6844ff9700 1 -- 172.21.15.133:0/1128311697 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f683804e6f0 con 0x7f684813c130 2023-10-08T16:04:22.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.391+0000 7f339bfff700 1 --2- 172.21.15.133:0/911555335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f339c067f10 0x7f339c13f2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f338c009e60 tx=0x7f338c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e63e53e772f775ba server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.391+0000 7f339affd700 1 -- 172.21.15.133:0/911555335 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c00e070 con 0x7f339c067f10 2023-10-08T16:04:22.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.391+0000 7f9c0ffff700 1 --2- 172.21.15.133:0/1190155200 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f9c14060550 0x7f9c14062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.391+0000 7f9c277fe700 1 --2- 172.21.15.133:0/1190155200 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f9c14060550 0x7f9c14062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.391+0000 7f9c277fe700 1 --2- 172.21.15.133:0/1190155200 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f9c14060550 0x7f9c14062a00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9c2806dee0 tx=0x7f9c2000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f9bbbfff700 1 -- 172.21.15.133:0/175203033 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc400f510 con 0x7f9bd4140430 2023-10-08T16:04:22.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.391+0000 7f9bbbfff700 1 -- 172.21.15.133:0/175203033 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc400f8d0 con 0x7f9bd4140430 2023-10-08T16:04:22.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.391+0000 7f339affd700 1 -- 172.21.15.133:0/911555335 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c00bb60 con 0x7f339c067f10 2023-10-08T16:04:22.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.391+0000 7f33a2507700 1 -- 172.21.15.133:0/911555335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f339c067f10 msgr2=0x7f339c13f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.391+0000 7f33a2507700 1 --2- 172.21.15.133:0/911555335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f339c067f10 0x7f339c13f2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f338c009e60 tx=0x7f338c009780 comp rx=0 tx=0).stop 2023-10-08T16:04:22.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.391+0000 7f33a2507700 1 -- 172.21.15.133:0/911555335 shutdown_connections 2023-10-08T16:04:22.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.391+0000 7f33a2507700 1 --2- 172.21.15.133:0/911555335 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f339c0b11f0 0x7f339c06e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.391+0000 7f33a2507700 1 --2- 172.21.15.133:0/911555335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f339c067f10 0x7f339c13f2f0 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f338c009e60 tx=0x7f338c009780 comp rx=0 tx=0).stop 2023-10-08T16:04:22.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.391+0000 7f33a2507700 1 -- 172.21.15.133:0/911555335 >> 172.21.15.133:0/911555335 conn(0x7f339c0b4ba0 msgr2=0x7f339c0b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.391+0000 7f33a2507700 1 -- 172.21.15.133:0/911555335 shutdown_connections 2023-10-08T16:04:22.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.391+0000 7f9bd920d700 1 -- 172.21.15.133:0/175203033 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd414fdf0 con 0x7f9bd4140430 2023-10-08T16:04:22.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f6481f51700 1 --2- 172.21.15.133:0/26533065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f647c0634e0 0x7f647c1595a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f647800c5c0 tx=0x7f647800c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f6471ffb700 1 -- 172.21.15.133:0/26533065 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6478011590 con 0x7f647c0634e0 2023-10-08T16:04:22.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f6482f53700 1 -- 172.21.15.133:0/26533065 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647c13f1d0 con 0x7f647c0634e0 2023-10-08T16:04:22.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f6482f53700 1 -- 172.21.15.133:0/26533065 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647c13cf70 con 0x7f647c0634e0 2023-10-08T16:04:22.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f6471ffb700 1 -- 172.21.15.133:0/26533065 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6478011710 con 0x7f647c0634e0 2023-10-08T16:04:22.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.387+0000 7f6471ffb700 1 -- 172.21.15.133:0/26533065 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6478011ad0 con 0x7f647c0634e0 2023-10-08T16:04:22.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.391+0000 7f6471ffb700 1 -- 172.21.15.133:0/26533065 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6478012420 con 0x7f647c0634e0 2023-10-08T16:04:22.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.391+0000 7f6471ffb700 1 --2- 172.21.15.133:0/26533065 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6460060620 0x7f6460062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.391+0000 7f6471ffb700 1 -- 172.21.15.133:0/26533065 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f647807bb40 con 0x7f647c0634e0 2023-10-08T16:04:22.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.391+0000 7f6481750700 1 --2- 172.21.15.133:0/26533065 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6460060620 0x7f6460062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.391+0000 7f6481750700 1 --2- 172.21.15.133:0/26533065 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6460060620 0x7f6460062ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f647c0714d0 tx=0x7f646c009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.395+0000 7f9bbbfff700 1 -- 172.21.15.133:0/175203033 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9bc400fcc0 con 0x7f9bd4140430 2023-10-08T16:04:22.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.395+0000 7f33a2507700 1 -- 172.21.15.133:0/911555335 wait complete. 2023-10-08T16:04:22.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.395+0000 7f6482f53700 1 -- 172.21.15.133:0/26533065 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f645c0052b0 con 0x7f647c0634e0 2023-10-08T16:04:22.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.395+0000 7f63167fc700 1 -- 172.21.15.133:0/3466381760 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f631804cc50 con 0x7f6320145c60 2023-10-08T16:04:22.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.395+0000 7f33a2507700 1 Processor -- start 2023-10-08T16:04:22.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.395+0000 7f9c0ffff700 1 -- 172.21.15.133:0/1190155200 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9c18053000 con 0x7f9c28068970 2023-10-08T16:04:22.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.395+0000 7f9c2d4ea700 1 -- 172.21.15.133:0/1190155200 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c28140790 con 0x7f9c28068970 2023-10-08T16:04:22.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.395+0000 7f33a2507700 1 -- start start 2023-10-08T16:04:22.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.395+0000 7f33a2507700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f339c0ac440 0x7f339c139db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.395+0000 7f33a2507700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f339c0b11f0 0x7f339c1567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.395+0000 7f33a2507700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f339c13cae0 0x7f339c156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.395+0000 7f33a2507700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c13b4f0 con 0x7f339c13cae0 2023-10-08T16:04:22.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.395+0000 7f33a2507700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c13aef0 con 0x7f339c0ac440 2023-10-08T16:04:22.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.395+0000 7f33a2507700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339c06cf60 con 0x7f339c0b11f0 2023-10-08T16:04:22.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.395+0000 7f339bfff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f339c0ac440 0x7f339c139db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.395+0000 7f339bfff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f339c0ac440 0x7f339c139db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.133:53442/0 (socket says 172.21.15.133:53442) 2023-10-08T16:04:22.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.395+0000 7f339bfff700 1 -- 172.21.15.133:0/1767915570 learned_addr learned my addr 172.21.15.133:0/1767915570 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:22.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.395+0000 7f339b7fe700 1 --2- 172.21.15.133:0/1767915570 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f339c0b11f0 0x7f339c1567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.395+0000 7f339bfff700 1 -- 172.21.15.133:0/1767915570 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f339c0b11f0 msgr2=0x7f339c1567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.395+0000 7f339bfff700 1 --2- 172.21.15.133:0/1767915570 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f339c0b11f0 0x7f339c1567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.395+0000 7f339bfff700 1 -- 172.21.15.133:0/1767915570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f339c13cae0 msgr2=0x7f339c156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.395+0000 7f339bfff700 1 --2- 172.21.15.133:0/1767915570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f339c13cae0 0x7f339c156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.395+0000 7f339bfff700 1 -- 172.21.15.133:0/1767915570 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338c009a20 con 0x7f339c0ac440 2023-10-08T16:04:22.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.395+0000 7f339bfff700 1 --2- 172.21.15.133:0/1767915570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f339c0ac440 0x7f339c139db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f338c00b6c0 tx=0x7f338c019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.395+0000 7f9bbbfff700 1 --2- 172.21.15.133:0/175203033 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f9bc0060580 0x7f9bc0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.395+0000 7f9bbbfff700 1 -- 172.21.15.133:0/175203033 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9bc407bf80 con 0x7f9bd4140430 2023-10-08T16:04:22.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.399+0000 7f9bd3fff700 1 --2- 172.21.15.133:0/175203033 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f9bc0060580 0x7f9bc0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.399+0000 7f9bbbfff700 1 -- 172.21.15.133:0/175203033 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9bd414fdf0 con 0x7f9bd4140430 2023-10-08T16:04:22.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.399+0000 7f3393fff700 1 -- 172.21.15.133:0/1767915570 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c012d60 con 0x7f339c0ac440 2023-10-08T16:04:22.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.399+0000 7f3393fff700 1 -- 172.21.15.133:0/1767915570 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c01b420 con 0x7f339c0ac440 2023-10-08T16:04:22.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.399+0000 7f3393fff700 1 -- 172.21.15.133:0/1767915570 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c01b7e0 con 0x7f339c0ac440 2023-10-08T16:04:22.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.399+0000 7f33a2507700 1 -- 172.21.15.133:0/1767915570 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339c13b180 con 0x7f339c0ac440 2023-10-08T16:04:22.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.399+0000 7f33a2507700 1 -- 172.21.15.133:0/1767915570 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f339c06dc70 con 0x7f339c0ac440 2023-10-08T16:04:22.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.403+0000 7f33a2507700 1 -- 172.21.15.133:0/1767915570 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33800052b0 con 0x7f339c0ac440 2023-10-08T16:04:22.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.403+0000 7f6471ffb700 1 -- 172.21.15.133:0/26533065 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6478049be0 con 0x7f647c0634e0 2023-10-08T16:04:22.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.399+0000 7f9bd3fff700 1 --2- 172.21.15.133:0/175203033 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f9bc0060580 0x7f9bc0062a30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8009b80 tx=0x7f9bc80091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.407+0000 7f3393fff700 1 -- 172.21.15.133:0/1767915570 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f338c01bbd0 con 0x7f339c0ac440 2023-10-08T16:04:22.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.407+0000 7f3393fff700 1 --2- 172.21.15.133:0/1767915570 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f337c0606a0 0x7f337c062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:22.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.407+0000 7f3393fff700 1 -- 172.21.15.133:0/1767915570 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f338c07e1f0 con 0x7f339c0ac440 2023-10-08T16:04:22.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.407+0000 7f9c0ffff700 1 -- 172.21.15.133:0/1190155200 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9c28140790 con 0x7f9c28068970 2023-10-08T16:04:22.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.411+0000 7f339b7fe700 1 --2- 172.21.15.133:0/1767915570 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f337c0606a0 0x7f337c062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:22.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.411+0000 7f339b7fe700 1 --2- 172.21.15.133:0/1767915570 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f337c0606a0 0x7f337c062b50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f339c06cb90 tx=0x7f3394008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:22.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.415+0000 7f3393fff700 1 -- 172.21.15.133:0/1767915570 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f338c04e800 con 0x7f339c0ac440 2023-10-08T16:04:22.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.679+0000 7fcc2759e700 1 -- 172.21.15.133:0/2341820270 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fcc0c005560 con 0x7fcc280af380 2023-10-08T16:04:22.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.683+0000 7fcc167fc700 1 -- 172.21.15.133:0/2341820270 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcc1c028020 con 0x7fcc280af380 2023-10-08T16:04:22.687 INFO:teuthology.orchestra.run.smithi133.stdout:55834574852 2023-10-08T16:04:22.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.687+0000 7fcc07fff700 1 -- 172.21.15.133:0/2341820270 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fcc08060720 msgr2=0x7fcc08062bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.687+0000 7fcc07fff700 1 --2- 172.21.15.133:0/2341820270 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fcc08060720 0x7fcc08062bd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcc18009bf0 tx=0x7fcc180091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.687+0000 7fcc07fff700 1 -- 172.21.15.133:0/2341820270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc280af380 msgr2=0x7fcc280a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.687+0000 7fcc07fff700 1 --2- 172.21.15.133:0/2341820270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc280af380 0x7fcc280a5900 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcc2806a7a0 tx=0x7fcc1c017000 comp rx=0 tx=0).stop 2023-10-08T16:04:22.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.687+0000 7fcc07fff700 1 -- 172.21.15.133:0/2341820270 shutdown_connections 2023-10-08T16:04:22.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.687+0000 7fcc07fff700 1 --2- 172.21.15.133:0/2341820270 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fcc08060720 0x7fcc08062bd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.687+0000 7fcc07fff700 1 --2- 172.21.15.133:0/2341820270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc280b1b90 0x7fcc280a8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.687+0000 7fcc07fff700 1 --2- 172.21.15.133:0/2341820270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc280af380 0x7fcc280a5900 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.687+0000 7fcc07fff700 1 --2- 172.21.15.133:0/2341820270 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc28067ea0 0x7fcc280a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.687+0000 7fcc07fff700 1 -- 172.21.15.133:0/2341820270 >> 172.21.15.133:0/2341820270 conn(0x7fcc280636b0 msgr2=0x7fcc2806fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.687+0000 7fcc07fff700 1 -- 172.21.15.133:0/2341820270 shutdown_connections 2023-10-08T16:04:22.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.687+0000 7fcc07fff700 1 -- 172.21.15.133:0/2341820270 wait complete. 2023-10-08T16:04:22.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.691+0000 7f07f4dc9700 1 -- 172.21.15.133:0/1982278278 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f07d4005830 con 0x7f07e8007630 2023-10-08T16:04:22.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.695+0000 7f63283d8700 1 -- 172.21.15.133:0/3466381760 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f63201471a0 con 0x7f6320145c60 2023-10-08T16:04:22.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.695+0000 7f07de7fc700 1 -- 172.21.15.133:0/1982278278 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f07e4017090 con 0x7f07e8007630 2023-10-08T16:04:22.700 INFO:teuthology.orchestra.run.smithi133.stdout:55834574852 2023-10-08T16:04:22.700 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2023-10-08T16:04:22.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.695+0000 7f63167fc700 1 -- 172.21.15.133:0/3466381760 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f63201471a0 con 0x7f6320145c60 2023-10-08T16:04:22.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.695+0000 7f07f4dc9700 1 -- 172.21.15.133:0/1982278278 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f07d0060620 msgr2=0x7f07d0062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.695+0000 7f07f4dc9700 1 --2- 172.21.15.133:0/1982278278 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f07d0060620 0x7f07d0062ad0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f07e8039ac0 tx=0x7f07e0016000 comp rx=0 tx=0).stop 2023-10-08T16:04:22.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.695+0000 7f07f4dc9700 1 -- 172.21.15.133:0/1982278278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07e8007630 msgr2=0x7f07e803c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.695+0000 7f07f4dc9700 1 --2- 172.21.15.133:0/1982278278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07e8007630 0x7f07e803c540 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f07e400ec80 tx=0x7f07e40091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.695+0000 7f07f4dc9700 1 -- 172.21.15.133:0/1982278278 shutdown_connections 2023-10-08T16:04:22.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.695+0000 7f07f4dc9700 1 --2- 172.21.15.133:0/1982278278 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f07d0060620 0x7f07d0062ad0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.695+0000 7f07f4dc9700 1 --2- 172.21.15.133:0/1982278278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07e80d2fa0 0x7f07e80d3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.695+0000 7f07f4dc9700 1 --2- 172.21.15.133:0/1982278278 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07e80378f0 0x7f07e80c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.695+0000 7f07f4dc9700 1 --2- 172.21.15.133:0/1982278278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07e8007630 0x7f07e803c540 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.695+0000 7f07f4dc9700 1 -- 172.21.15.133:0/1982278278 >> 172.21.15.133:0/1982278278 conn(0x7f07e803ea80 msgr2=0x7f07e8004f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.699+0000 7f07f4dc9700 1 -- 172.21.15.133:0/1982278278 shutdown_connections 2023-10-08T16:04:22.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.699+0000 7f07f4dc9700 1 -- 172.21.15.133:0/1982278278 wait complete. 2023-10-08T16:04:22.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2023-10-08T16:04:22.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.703+0000 7f684eac4700 1 -- 172.21.15.133:0/1128311697 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6828005830 con 0x7f684813c130 2023-10-08T16:04:22.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.703+0000 7f63283d8700 1 -- 172.21.15.133:0/3466381760 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6304060620 msgr2=0x7f6304062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.703+0000 7f63283d8700 1 --2- 172.21.15.133:0/3466381760 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6304060620 0x7f6304062ad0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f631c006fd0 tx=0x7f631c0090f0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.703+0000 7f63283d8700 1 -- 172.21.15.133:0/3466381760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6320145c60 msgr2=0x7f632013beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.703+0000 7f63283d8700 1 --2- 172.21.15.133:0/3466381760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6320145c60 0x7f632013beb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f631800c7f0 tx=0x7f6318001630 comp rx=0 tx=0).stop 2023-10-08T16:04:22.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.703+0000 7f63283d8700 1 -- 172.21.15.133:0/3466381760 shutdown_connections 2023-10-08T16:04:22.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.703+0000 7f63283d8700 1 --2- 172.21.15.133:0/3466381760 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6304060620 0x7f6304062ad0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.703+0000 7f63283d8700 1 --2- 172.21.15.133:0/3466381760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6320145c60 0x7f632013beb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.703+0000 7f63283d8700 1 --2- 172.21.15.133:0/3466381760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63200aa6b0 0x7f632013d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.703+0000 7f63283d8700 1 --2- 172.21.15.133:0/3466381760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f63200a9b00 0x7f6320144db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.703+0000 7f63283d8700 1 -- 172.21.15.133:0/3466381760 >> 172.21.15.133:0/3466381760 conn(0x7f63200b4ba0 msgr2=0x7f63200b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.703+0000 7f63283d8700 1 -- 172.21.15.133:0/3466381760 shutdown_connections 2023-10-08T16:04:22.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.703+0000 7f63283d8700 1 -- 172.21.15.133:0/3466381760 wait complete. 2023-10-08T16:04:22.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.703+0000 7f6844ff9700 1 -- 172.21.15.133:0/1128311697 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6838051d10 con 0x7f684813c130 2023-10-08T16:04:22.707 INFO:teuthology.orchestra.run.smithi133.stdout:55834574852 2023-10-08T16:04:22.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.703+0000 7f6482f53700 1 -- 172.21.15.133:0/26533065 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f645c005830 con 0x7f647c0634e0 2023-10-08T16:04:22.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f684eac4700 1 -- 172.21.15.133:0/1128311697 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6834060550 msgr2=0x7f6834062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f684eac4700 1 --2- 172.21.15.133:0/1128311697 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6834060550 0x7f6834062a00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f68481431d0 tx=0x7f683c008040 comp rx=0 tx=0).stop 2023-10-08T16:04:22.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f684eac4700 1 -- 172.21.15.133:0/1128311697 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f684813c130 msgr2=0x7f68480af450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f684eac4700 1 --2- 172.21.15.133:0/1128311697 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f684813c130 0x7f68480af450 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6838016000 tx=0x7f6838017000 comp rx=0 tx=0).stop 2023-10-08T16:04:22.709 INFO:teuthology.orchestra.run.smithi133.stdout:55834574852 2023-10-08T16:04:22.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f684eac4700 1 -- 172.21.15.133:0/1128311697 shutdown_connections 2023-10-08T16:04:22.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f684eac4700 1 --2- 172.21.15.133:0/1128311697 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6834060550 0x7f6834062a00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f684eac4700 1 --2- 172.21.15.133:0/1128311697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6848142500 0x7f6848159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f684eac4700 1 --2- 172.21.15.133:0/1128311697 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6848145a00 0x7f6848141fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f684eac4700 1 --2- 172.21.15.133:0/1128311697 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f684813c130 0x7f68480af450 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f684eac4700 1 -- 172.21.15.133:0/1128311697 >> 172.21.15.133:0/1128311697 conn(0x7f6848066f90 msgr2=0x7f68480b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f6471ffb700 1 -- 172.21.15.133:0/26533065 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6478017080 con 0x7f647c0634e0 2023-10-08T16:04:22.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f684eac4700 1 -- 172.21.15.133:0/1128311697 shutdown_connections 2023-10-08T16:04:22.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f684eac4700 1 -- 172.21.15.133:0/1128311697 wait complete. 2023-10-08T16:04:22.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f9bd920d700 1 -- 172.21.15.133:0/175203033 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f9bd414fdf0 con 0x7f9bd4140430 2023-10-08T16:04:22.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f9bbbfff700 1 -- 172.21.15.133:0/175203033 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9bd414fdf0 con 0x7f9bd4140430 2023-10-08T16:04:22.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f9c2d4ea700 1 -- 172.21.15.133:0/1190155200 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9c28140790 con 0x7f9c28068970 2023-10-08T16:04:22.713 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2023-10-08T16:04:22.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f6482f53700 1 -- 172.21.15.133:0/26533065 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6460060620 msgr2=0x7f6460062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f6482f53700 1 --2- 172.21.15.133:0/26533065 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6460060620 0x7f6460062ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f647c0714d0 tx=0x7f646c009250 comp rx=0 tx=0).stop 2023-10-08T16:04:22.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f6482f53700 1 -- 172.21.15.133:0/26533065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f647c0634e0 msgr2=0x7f647c1595a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f6482f53700 1 --2- 172.21.15.133:0/26533065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f647c0634e0 0x7f647c1595a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f647800c5c0 tx=0x7f647800c980 comp rx=0 tx=0).stop 2023-10-08T16:04:22.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f6482f53700 1 -- 172.21.15.133:0/26533065 shutdown_connections 2023-10-08T16:04:22.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f6482f53700 1 --2- 172.21.15.133:0/26533065 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6460060620 0x7f6460062ad0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f6482f53700 1 --2- 172.21.15.133:0/26533065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c142d90 0x7f647c13f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f6482f53700 1 --2- 172.21.15.133:0/26533065 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f647c0b43c0 0x7f647c13dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f6482f53700 1 --2- 172.21.15.133:0/26533065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f647c0634e0 0x7f647c1595a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f6482f53700 1 -- 172.21.15.133:0/26533065 >> 172.21.15.133:0/26533065 conn(0x7f647c067ca0 msgr2=0x7f647c0ae100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f6482f53700 1 -- 172.21.15.133:0/26533065 shutdown_connections 2023-10-08T16:04:22.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.707+0000 7f6482f53700 1 -- 172.21.15.133:0/26533065 wait complete. 2023-10-08T16:04:22.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.711+0000 7f9c0ffff700 1 -- 172.21.15.133:0/1190155200 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c28140790 con 0x7f9c28068970 2023-10-08T16:04:22.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.711+0000 7f9bd920d700 1 -- 172.21.15.133:0/175203033 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f9bc0060580 msgr2=0x7f9bc0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.711+0000 7f9bd920d700 1 --2- 172.21.15.133:0/175203033 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f9bc0060580 0x7f9bc0062a30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8009b80 tx=0x7f9bc80091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.711+0000 7f9bd920d700 1 -- 172.21.15.133:0/175203033 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bd4140430 msgr2=0x7f9bd4150610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.711+0000 7f9bd920d700 1 --2- 172.21.15.133:0/175203033 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bd4140430 0x7f9bd4150610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9bc400b4c0 tx=0x7f9bc4009060 comp rx=0 tx=0).stop 2023-10-08T16:04:22.716 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2023-10-08T16:04:22.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.715+0000 7f9bd920d700 1 -- 172.21.15.133:0/175203033 shutdown_connections 2023-10-08T16:04:22.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.715+0000 7f9bd920d700 1 --2- 172.21.15.133:0/175203033 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f9bc0060580 0x7f9bc0062a30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.715+0000 7f9bd920d700 1 --2- 172.21.15.133:0/175203033 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bd4140430 0x7f9bd4150610 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.717 INFO:teuthology.orchestra.run.smithi133.stdout:55834574852 2023-10-08T16:04:22.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.715+0000 7f9bd920d700 1 --2- 172.21.15.133:0/175203033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bd40b1dc0 0x7f9bd41500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.715+0000 7f9bd920d700 1 --2- 172.21.15.133:0/175203033 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bd406dda0 0x7f9bd40b4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.715+0000 7f9bd920d700 1 -- 172.21.15.133:0/175203033 >> 172.21.15.133:0/175203033 conn(0x7f9bd40636b0 msgr2=0x7f9bd406e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.715+0000 7f9bd920d700 1 -- 172.21.15.133:0/175203033 shutdown_connections 2023-10-08T16:04:22.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.715+0000 7f9bd920d700 1 -- 172.21.15.133:0/175203033 wait complete. 2023-10-08T16:04:22.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.715+0000 7f33a2507700 1 -- 172.21.15.133:0/1767915570 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3380005560 con 0x7f339c0ac440 2023-10-08T16:04:22.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.715+0000 7f3393fff700 1 -- 172.21.15.133:0/1767915570 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f338c051de0 con 0x7f339c0ac440 2023-10-08T16:04:22.719 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2023-10-08T16:04:22.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.715+0000 7f9c2d4ea700 1 -- 172.21.15.133:0/1190155200 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f9c14060550 msgr2=0x7f9c14062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.715+0000 7f9c2d4ea700 1 --2- 172.21.15.133:0/1190155200 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f9c14060550 0x7f9c14062a00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9c2806dee0 tx=0x7f9c2000b040 comp rx=0 tx=0).stop 2023-10-08T16:04:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.715+0000 7f9c2d4ea700 1 -- 172.21.15.133:0/1190155200 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c28068970 msgr2=0x7f9c28140a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.715+0000 7f9c2d4ea700 1 --2- 172.21.15.133:0/1190155200 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c28068970 0x7f9c28140a70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009f80 tx=0x7f9c18017000 comp rx=0 tx=0).stop 2023-10-08T16:04:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.715+0000 7f9c2d4ea700 1 -- 172.21.15.133:0/1190155200 shutdown_connections 2023-10-08T16:04:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.715+0000 7f9c2d4ea700 1 --2- 172.21.15.133:0/1190155200 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f9c14060550 0x7f9c14062a00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.715+0000 7f9c2d4ea700 1 --2- 172.21.15.133:0/1190155200 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c28149ff0 0x7f9c280aadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.715+0000 7f9c2d4ea700 1 --2- 172.21.15.133:0/1190155200 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c280ac010 0x7f9c28140fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.715+0000 7f9c2d4ea700 1 --2- 172.21.15.133:0/1190155200 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c28068970 0x7f9c28140a70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.715+0000 7f9c2d4ea700 1 -- 172.21.15.133:0/1190155200 >> 172.21.15.133:0/1190155200 conn(0x7f9c28063670 msgr2=0x7f9c2806fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.715+0000 7f9c2d4ea700 1 -- 172.21.15.133:0/1190155200 shutdown_connections 2023-10-08T16:04:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.715+0000 7f9c2d4ea700 1 -- 172.21.15.133:0/1190155200 wait complete. 2023-10-08T16:04:22.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.719+0000 7f33a2507700 1 -- 172.21.15.133:0/1767915570 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f337c0606a0 msgr2=0x7f337c062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.719+0000 7f33a2507700 1 --2- 172.21.15.133:0/1767915570 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f337c0606a0 0x7f337c062b50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f339c06cb90 tx=0x7f3394008040 comp rx=0 tx=0).stop 2023-10-08T16:04:22.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-10-08T16:04:22.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.719+0000 7f33a2507700 1 -- 172.21.15.133:0/1767915570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f339c0ac440 msgr2=0x7f339c139db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.719+0000 7f33a2507700 1 --2- 172.21.15.133:0/1767915570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f339c0ac440 0x7f339c139db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f338c00b6c0 tx=0x7f338c019000 comp rx=0 tx=0).stop 2023-10-08T16:04:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.719+0000 7f33a2507700 1 -- 172.21.15.133:0/1767915570 shutdown_connections 2023-10-08T16:04:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.719+0000 7f33a2507700 1 --2- 172.21.15.133:0/1767915570 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f337c0606a0 0x7f337c062b50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.719+0000 7f33a2507700 1 --2- 172.21.15.133:0/1767915570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f339c13cae0 0x7f339c156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.719+0000 7f33a2507700 1 --2- 172.21.15.133:0/1767915570 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f339c0b11f0 0x7f339c1567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.719+0000 7f33a2507700 1 --2- 172.21.15.133:0/1767915570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f339c0ac440 0x7f339c139db0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.719+0000 7f33a2507700 1 -- 172.21.15.133:0/1767915570 >> 172.21.15.133:0/1767915570 conn(0x7f339c0b4ba0 msgr2=0x7f339c068670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.719+0000 7f33a2507700 1 -- 172.21.15.133:0/1767915570 shutdown_connections 2023-10-08T16:04:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:22.719+0000 7f33a2507700 1 -- 172.21.15.133:0/1767915570 wait complete. 2023-10-08T16:04:22.726 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2023-10-08T16:04:22.728 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-10-08T16:04:22.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2023-10-08T16:04:22.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2023-10-08T16:04:22.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-10-08T16:04:23.704 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-08T16:04:23.717 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T16:04:23.724 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-08T16:04:23.726 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T16:04:23.729 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-08T16:04:23.731 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-08T16:04:23.735 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T16:04:23.735 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-08T16:04:23.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.851+0000 7f708d76f700 1 Processor -- start 2023-10-08T16:04:23.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.851+0000 7f708d76f700 1 -- start start 2023-10-08T16:04:23.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.851+0000 7f708d76f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70880ab350 0x7f70880b2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.851+0000 7f708d76f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7088146160 0x7f708814cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.851+0000 7f708d76f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f708806e220 con 0x7f70880b1030 2023-10-08T16:04:23.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.851+0000 7f708d76f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70880b0b60 con 0x7f7088146160 2023-10-08T16:04:23.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.851+0000 7f708d76f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70880aa920 con 0x7f70880ab350 2023-10-08T16:04:23.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.851+0000 7f70877fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7088146160 0x7f708814cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.851+0000 7f70877fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7088146160 0x7f708814cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42964/0 (socket says 172.21.15.133:42964) 2023-10-08T16:04:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.851+0000 7f70877fe700 1 -- 172.21.15.133:0/3670588372 learned_addr learned my addr 172.21.15.133:0/3670588372 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.851+0000 7f7086ffd700 1 --2- 172.21.15.133:0/3670588372 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70880ab350 0x7f70880b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.851+0000 7f70877fe700 1 -- 172.21.15.133:0/3670588372 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70880ab350 msgr2=0x7f70880b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.851+0000 7f70877fe700 1 --2- 172.21.15.133:0/3670588372 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70880ab350 0x7f70880b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.851+0000 7f70877fe700 1 -- 172.21.15.133:0/3670588372 >> v1:172.21.15.133:6789/0 conn(0x7f70880b1030 legacy=0x7f7088145a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.851+0000 7f70877fe700 1 -- 172.21.15.133:0/3670588372 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70880b0880 con 0x7f7088146160 2023-10-08T16:04:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.851+0000 7f7086ffd700 1 --2- 172.21.15.133:0/3670588372 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70880ab350 0x7f70880b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.851+0000 7f70877fe700 1 --2- 172.21.15.133:0/3670588372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7088146160 0x7f708814cfa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7080009f20 tx=0x7f7080009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1157860ccd183f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:23.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.855+0000 7f7085ffb700 1 -- 172.21.15.133:0/3670588372 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708000e070 con 0x7f7088146160 2023-10-08T16:04:23.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.855+0000 7f7085ffb700 1 -- 172.21.15.133:0/3670588372 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708000ba40 con 0x7f7088146160 2023-10-08T16:04:23.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.855+0000 7f7085ffb700 1 -- 172.21.15.133:0/3670588372 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70800092e0 con 0x7f7088146160 2023-10-08T16:04:23.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.855+0000 7f708d76f700 1 -- 172.21.15.133:0/3670588372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7088146160 msgr2=0x7f708814cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:23.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.855+0000 7f708d76f700 1 --2- 172.21.15.133:0/3670588372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7088146160 0x7f708814cfa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7080009f20 tx=0x7f7080009840 comp rx=0 tx=0).stop 2023-10-08T16:04:23.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.859+0000 7f708d76f700 1 -- 172.21.15.133:0/3670588372 shutdown_connections 2023-10-08T16:04:23.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.859+0000 7f708d76f700 1 --2- 172.21.15.133:0/3670588372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7088146160 0x7f708814cfa0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.859+0000 7f708d76f700 1 --2- 172.21.15.133:0/3670588372 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70880ab350 0x7f70880b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.859+0000 7f708d76f700 1 -- 172.21.15.133:0/3670588372 >> 172.21.15.133:0/3670588372 conn(0x7f70880b4990 msgr2=0x7f70880b4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:23.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.859+0000 7f708d76f700 1 -- 172.21.15.133:0/3670588372 shutdown_connections 2023-10-08T16:04:23.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.859+0000 7f708d76f700 1 -- 172.21.15.133:0/3670588372 wait complete. 2023-10-08T16:04:23.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.859+0000 7f708d76f700 1 Processor -- start 2023-10-08T16:04:23.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.859+0000 7f708d76f700 1 -- start start 2023-10-08T16:04:23.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.859+0000 7f708d76f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70880ab350 0x7f708813e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.859+0000 7f708d76f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70880b1030 0x7f70880acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.859+0000 7f708d76f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7088146160 0x7f7088143850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.859+0000 7f708d76f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70880aee60 con 0x7f70880b1030 2023-10-08T16:04:23.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.859+0000 7f708d76f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7088144b40 con 0x7f7088146160 2023-10-08T16:04:23.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.859+0000 7f708d76f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70880ad500 con 0x7f70880ab350 2023-10-08T16:04:23.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.859+0000 7f7086ffd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70880ab350 0x7f708813e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.859+0000 7f7086ffd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70880ab350 0x7f708813e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.133:45730/0 (socket says 172.21.15.133:45730) 2023-10-08T16:04:23.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.859+0000 7f7086ffd700 1 -- 172.21.15.133:0/2584682370 learned_addr learned my addr 172.21.15.133:0/2584682370 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:23.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.859+0000 7f70867fc700 1 --2- 172.21.15.133:0/2584682370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70880b1030 0x7f70880acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.863+0000 7f7086ffd700 1 -- 172.21.15.133:0/2584682370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7088146160 msgr2=0x7f7088143850 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T16:04:23.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.863+0000 7f7086ffd700 1 --2- 172.21.15.133:0/2584682370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7088146160 0x7f7088143850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.863+0000 7f7086ffd700 1 -- 172.21.15.133:0/2584682370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70880b1030 msgr2=0x7f70880acfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:23.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.863+0000 7f7086ffd700 1 --2- 172.21.15.133:0/2584682370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70880b1030 0x7f70880acfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.863+0000 7f7086ffd700 1 -- 172.21.15.133:0/2584682370 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7080009ae0 con 0x7f70880ab350 2023-10-08T16:04:23.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.863+0000 7f7086ffd700 1 --2- 172.21.15.133:0/2584682370 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70880ab350 0x7f708813e840 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f707800e900 tx=0x7f7078008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:23.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.863+0000 7f706effd700 1 -- 172.21.15.133:0/2584682370 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7078013410 con 0x7f70880ab350 2023-10-08T16:04:23.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.863+0000 7f708d76f700 1 -- 172.21.15.133:0/2584682370 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70880ae380 con 0x7f70880ab350 2023-10-08T16:04:23.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.863+0000 7f708d76f700 1 -- 172.21.15.133:0/2584682370 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7088145970 con 0x7f70880ab350 2023-10-08T16:04:23.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.863+0000 7f706effd700 1 -- 172.21.15.133:0/2584682370 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7078013570 con 0x7f70880ab350 2023-10-08T16:04:23.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.863+0000 7f706effd700 1 -- 172.21.15.133:0/2584682370 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70780138f0 con 0x7f70880ab350 2023-10-08T16:04:23.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.863+0000 7f708d76f700 1 -- 172.21.15.133:0/2584682370 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70680052b0 con 0x7f70880ab350 2023-10-08T16:04:23.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.867+0000 7f706effd700 1 -- 172.21.15.133:0/2584682370 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7078013ce0 con 0x7f70880ab350 2023-10-08T16:04:23.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.867+0000 7f706effd700 1 --2- 172.21.15.133:0/2584682370 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f7074060580 0x7f7074062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.867+0000 7f706effd700 1 -- 172.21.15.133:0/2584682370 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f707807c9a0 con 0x7f70880ab350 2023-10-08T16:04:23.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.867+0000 7f70867fc700 1 --2- 172.21.15.133:0/2584682370 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f7074060580 0x7f7074062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.867+0000 7f70867fc700 1 --2- 172.21.15.133:0/2584682370 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f7074060580 0x7f7074062a30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f708813c5f0 tx=0x7f707c007ea0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:23.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.879+0000 7f93a5d51700 1 Processor -- start 2023-10-08T16:04:23.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.879+0000 7f706effd700 1 -- 172.21.15.133:0/2584682370 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f707804d010 con 0x7f70880ab350 2023-10-08T16:04:23.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.879+0000 7f93a5d51700 1 -- start start 2023-10-08T16:04:23.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.879+0000 7f93a5d51700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f93a00b1dc0 0x7f93a00ae180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.879+0000 7f93a5d51700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93a0068380 0x7f93a01514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.879+0000 7f93a5d51700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a00b0ec0 con 0x7f93a00b0030 2023-10-08T16:04:23.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.879+0000 7f93a5d51700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a00ae6c0 con 0x7f93a00b1dc0 2023-10-08T16:04:23.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.879+0000 7f93a5d51700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a00ad4f0 con 0x7f93a0068380 2023-10-08T16:04:23.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.879+0000 7f93a4d4f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f93a00b1dc0 0x7f93a00ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.879+0000 7f93a4d4f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f93a00b1dc0 0x7f93a00ae180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42976/0 (socket says 172.21.15.133:42976) 2023-10-08T16:04:23.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.879+0000 7f93a4d4f700 1 -- 172.21.15.133:0/3204216062 learned_addr learned my addr 172.21.15.133:0/3204216062 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:23.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.879+0000 7f93a5550700 1 --2- 172.21.15.133:0/3204216062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93a0068380 0x7f93a01514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.879+0000 7f93a4d4f700 1 -- 172.21.15.133:0/3204216062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93a0068380 msgr2=0x7f93a01514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:23.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.879+0000 7f93a4d4f700 1 --2- 172.21.15.133:0/3204216062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93a0068380 0x7f93a01514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.879+0000 7f93a4d4f700 1 -- 172.21.15.133:0/3204216062 >> v1:172.21.15.133:6789/0 conn(0x7f93a00b0030 legacy=0x7f93a0067c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:23.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.879+0000 7f93a4d4f700 1 -- 172.21.15.133:0/3204216062 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a00ac250 con 0x7f93a00b1dc0 2023-10-08T16:04:23.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.879+0000 7f93a4d4f700 1 --2- 172.21.15.133:0/3204216062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93a00b1dc0 0x7f93a00ae180 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f93900099b0 tx=0x7f9390009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6051cff3b7e384 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:23.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.883+0000 7f939f7fe700 1 -- 172.21.15.133:0/3204216062 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9390009ea0 con 0x7f93a00b1dc0 2023-10-08T16:04:23.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.883+0000 7f939f7fe700 1 -- 172.21.15.133:0/3204216062 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939000b860 con 0x7f93a00b1dc0 2023-10-08T16:04:23.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.883+0000 7f939f7fe700 1 -- 172.21.15.133:0/3204216062 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939000bc00 con 0x7f93a00b1dc0 2023-10-08T16:04:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.883+0000 7f93a5d51700 1 -- 172.21.15.133:0/3204216062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93a00b1dc0 msgr2=0x7f93a00ae180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.883+0000 7f93a5d51700 1 --2- 172.21.15.133:0/3204216062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93a00b1dc0 0x7f93a00ae180 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f93900099b0 tx=0x7f9390009250 comp rx=0 tx=0).stop 2023-10-08T16:04:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.883+0000 7f93a5d51700 1 -- 172.21.15.133:0/3204216062 shutdown_connections 2023-10-08T16:04:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.883+0000 7f93a5d51700 1 --2- 172.21.15.133:0/3204216062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93a0068380 0x7f93a01514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.883+0000 7f93a5d51700 1 --2- 172.21.15.133:0/3204216062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93a00b1dc0 0x7f93a00ae180 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.883+0000 7f93a5d51700 1 -- 172.21.15.133:0/3204216062 >> 172.21.15.133:0/3204216062 conn(0x7f93a0063670 msgr2=0x7f93a00b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.883+0000 7f93a5d51700 1 -- 172.21.15.133:0/3204216062 shutdown_connections 2023-10-08T16:04:23.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.883+0000 7f93a5d51700 1 -- 172.21.15.133:0/3204216062 wait complete. 2023-10-08T16:04:23.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.883+0000 7f93a5d51700 1 Processor -- start 2023-10-08T16:04:23.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.883+0000 7f93a5d51700 1 -- start start 2023-10-08T16:04:23.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.883+0000 7f93a5d51700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93a0068380 0x7f93a014a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.883+0000 7f93a5d51700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93a00b0030 0x7f93a0143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.883+0000 7f93a5d51700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93a00b1dc0 0x7f93a0159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.883+0000 7f93a5d51700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a006be30 con 0x7f93a00b0030 2023-10-08T16:04:23.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.883+0000 7f93a5d51700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a014b7f0 con 0x7f93a00b1dc0 2023-10-08T16:04:23.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.883+0000 7f93a5d51700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a014ad10 con 0x7f93a0068380 2023-10-08T16:04:23.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f939ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93a00b0030 0x7f93a0143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f939ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93a00b0030 0x7f93a0143830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42986/0 (socket says 172.21.15.133:42986) 2023-10-08T16:04:23.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f939ffff700 1 -- 172.21.15.133:0/1333100537 learned_addr learned my addr 172.21.15.133:0/1333100537 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:23.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.883+0000 7f6928b11700 1 Processor -- start 2023-10-08T16:04:23.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.883+0000 7f6928b11700 1 -- start start 2023-10-08T16:04:23.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f93a4d4f700 1 --2- 172.21.15.133:0/1333100537 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93a0068380 0x7f93a014a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f93a5550700 1 --2- 172.21.15.133:0/1333100537 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93a00b1dc0 0x7f93a0159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f939ffff700 1 -- 172.21.15.133:0/1333100537 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93a0068380 msgr2=0x7f93a014a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f939ffff700 1 --2- 172.21.15.133:0/1333100537 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93a0068380 0x7f93a014a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f939ffff700 1 -- 172.21.15.133:0/1333100537 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93a00b1dc0 msgr2=0x7f93a0159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f939ffff700 1 --2- 172.21.15.133:0/1333100537 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93a00b1dc0 0x7f93a0159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f939ffff700 1 -- 172.21.15.133:0/1333100537 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93900094f0 con 0x7f93a00b0030 2023-10-08T16:04:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f6928b11700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6924087ba0 0x7f69240b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f939ffff700 1 --2- 172.21.15.133:0/1333100537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93a00b0030 0x7f93a0143830 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f939400c590 tx=0x7f939400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:23.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f6928b11700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f69240b0050 0x7f69240b0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f6928b11700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69240b0dd0 con 0x7f69240ac1a0 2023-10-08T16:04:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f6928b11700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69240b09a0 con 0x7f6924087ba0 2023-10-08T16:04:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f6928b11700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69240ae250 con 0x7f69240b0050 2023-10-08T16:04:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f69237fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6924087ba0 0x7f69240b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f69237fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6924087ba0 0x7f69240b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42990/0 (socket says 172.21.15.133:42990) 2023-10-08T16:04:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f69237fe700 1 -- 172.21.15.133:0/2645401930 learned_addr learned my addr 172.21.15.133:0/2645401930 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f6922ffd700 1 --2- 172.21.15.133:0/2645401930 >> v2:172.21.15.190:3300/0 conn(0x7f69240b0050 0x7f69240b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f69237fe700 1 -- 172.21.15.133:0/2645401930 >> v2:172.21.15.190:3300/0 conn(0x7f69240b0050 msgr2=0x7f69240b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f69237fe700 1 --2- 172.21.15.133:0/2645401930 >> v2:172.21.15.190:3300/0 conn(0x7f69240b0050 0x7f69240b0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f69237fe700 1 -- 172.21.15.133:0/2645401930 >> v1:172.21.15.190:6789/0 conn(0x7f69240ac1a0 legacy=0x7f6924068500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f69237fe700 1 -- 172.21.15.133:0/2645401930 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69240ad4b0 con 0x7f6924087ba0 2023-10-08T16:04:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f939cff9700 1 -- 172.21.15.133:0/1333100537 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9394011590 con 0x7f93a00b0030 2023-10-08T16:04:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f939cff9700 1 -- 172.21.15.133:0/1333100537 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9394011710 con 0x7f93a00b0030 2023-10-08T16:04:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f939cff9700 1 -- 172.21.15.133:0/1333100537 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9394011ad0 con 0x7f93a00b0030 2023-10-08T16:04:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f93a5d51700 1 -- 172.21.15.133:0/1333100537 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a014aff0 con 0x7f93a00b0030 2023-10-08T16:04:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f93a5d51700 1 -- 172.21.15.133:0/1333100537 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a014ba40 con 0x7f93a00b0030 2023-10-08T16:04:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f69237fe700 1 --2- 172.21.15.133:0/2645401930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6924087ba0 0x7f69240b1b90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f69240b0ca0 tx=0x7f6914009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c84a7ff405519c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f69227fc700 1 -- 172.21.15.133:0/2645401930 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691400b820 con 0x7f6924087ba0 2023-10-08T16:04:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f69227fc700 1 -- 172.21.15.133:0/2645401930 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691400b980 con 0x7f6924087ba0 2023-10-08T16:04:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f69227fc700 1 -- 172.21.15.133:0/2645401930 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691400bd20 con 0x7f6924087ba0 2023-10-08T16:04:23.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f939cff9700 1 -- 172.21.15.133:0/1333100537 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f939401b3b0 con 0x7f93a00b0030 2023-10-08T16:04:23.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f6928b11700 1 -- 172.21.15.133:0/2645401930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6924087ba0 msgr2=0x7f69240b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:23.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f6928b11700 1 --2- 172.21.15.133:0/2645401930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6924087ba0 0x7f69240b1b90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f69240b0ca0 tx=0x7f6914009250 comp rx=0 tx=0).stop 2023-10-08T16:04:23.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f939cff9700 1 --2- 172.21.15.133:0/1333100537 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f938c060620 0x7f938c062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f93a4d4f700 1 --2- 172.21.15.133:0/1333100537 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f938c060620 0x7f938c062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.887+0000 7f939cff9700 1 -- 172.21.15.133:0/1333100537 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f939407bc80 con 0x7f93a00b0030 2023-10-08T16:04:23.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f502333c700 1 Processor -- start 2023-10-08T16:04:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f93a4d4f700 1 --2- 172.21.15.133:0/1333100537 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f938c060620 0x7f938c062ad0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f93900099b0 tx=0x7f9390017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f93a5d51700 1 -- 172.21.15.133:0/1333100537 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a014b4d0 con 0x7f93a00b0030 2023-10-08T16:04:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f6928b11700 1 -- 172.21.15.133:0/2645401930 shutdown_connections 2023-10-08T16:04:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f6928b11700 1 --2- 172.21.15.133:0/2645401930 >> v2:172.21.15.190:3300/0 conn(0x7f69240b0050 0x7f69240b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f6928b11700 1 --2- 172.21.15.133:0/2645401930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6924087ba0 0x7f69240b1b90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f6928b11700 1 -- 172.21.15.133:0/2645401930 >> 172.21.15.133:0/2645401930 conn(0x7f69240636b0 msgr2=0x7f69240b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f6928b11700 1 -- 172.21.15.133:0/2645401930 shutdown_connections 2023-10-08T16:04:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f6928b11700 1 -- 172.21.15.133:0/2645401930 wait complete. 2023-10-08T16:04:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7fb5fdc9d700 1 Processor -- start 2023-10-08T16:04:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7fb5fdc9d700 1 -- start start 2023-10-08T16:04:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7fb5fdc9d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5f80b1dc0 0x7fb5f80ab730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7fb5fdc9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb5f80ad010 0x7fb5f80ad440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7fb5fdc9d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f8142720 con 0x7fb5f8142d60 2023-10-08T16:04:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7fb5fdc9d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f80ac500 con 0x7fb5f80ad010 2023-10-08T16:04:23.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7fb5fdc9d700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f80ae5f0 con 0x7fb5f80b1dc0 2023-10-08T16:04:23.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f502333c700 1 -- start start 2023-10-08T16:04:23.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f502333c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f501c0ae1c0 0x7f501c0ae590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f502333c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f501c0aead0 0x7f501c068370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f502333c700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f501c0acac0 con 0x7f501c0688b0 2023-10-08T16:04:23.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f502333c700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f501c0ad9c0 con 0x7f501c0aead0 2023-10-08T16:04:23.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f502333c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c068d10 con 0x7f501c0ae1c0 2023-10-08T16:04:23.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7fb5fd49c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb5f8142d60 0x7fb5f8067c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49458/0 (socket says 172.21.15.133:49458) 2023-10-08T16:04:23.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7fb5fd49c700 1 -- 172.21.15.133:0/757057849 learned_addr learned my addr 172.21.15.133:0/757057849 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:23.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f6928b11700 1 Processor -- start 2023-10-08T16:04:23.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7fb5f7fff700 1 --2- 172.21.15.133:0/757057849 >> v2:172.21.15.133:3300/0 conn(0x7fb5f80ad010 0x7fb5f80ad440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f6928b11700 1 -- start start 2023-10-08T16:04:23.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f50208d7700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f501c0aead0 0x7f501c068370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f50208d7700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f501c0aead0 0x7f501c068370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.133:53484/0 (socket says 172.21.15.133:53484) 2023-10-08T16:04:23.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f50208d7700 1 -- 172.21.15.133:0/2464656222 learned_addr learned my addr 172.21.15.133:0/2464656222 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:23.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7fb5f7fff700 1 -- 172.21.15.133:0/757057849 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5f80b1dc0 msgr2=0x7fb5f80ab730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T16:04:23.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7fb5f7fff700 1 --2- 172.21.15.133:0/757057849 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5f80b1dc0 0x7fb5f80ab730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7fb5f7fff700 1 -- 172.21.15.133:0/757057849 >> v1:172.21.15.133:6789/0 conn(0x7fb5f8142d60 legacy=0x7fb5f8067c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:23.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7fb5f7fff700 1 -- 172.21.15.133:0/757057849 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f80ac7c0 con 0x7fb5f80ad010 2023-10-08T16:04:23.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f50208d7700 1 -- 172.21.15.133:0/2464656222 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f501c0ae1c0 msgr2=0x7f501c0ae590 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T16:04:23.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f50208d7700 1 --2- 172.21.15.133:0/2464656222 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f501c0ae1c0 0x7f501c0ae590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7fb5f7fff700 1 --2- 172.21.15.133:0/757057849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f80ad010 0x7fb5f80ad440 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0098e0 tx=0x7fb5ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865e0579f3fd58a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:23.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f50208d7700 1 -- 172.21.15.133:0/2464656222 >> v1:172.21.15.190:6789/0 conn(0x7f501c0688b0 legacy=0x7f501c06e2a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T16:04:23.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f50208d7700 1 -- 172.21.15.133:0/2464656222 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501c0ac770 con 0x7f501c0aead0 2023-10-08T16:04:23.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f6928b11700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6924087ba0 0x7f6924158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f6928b11700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69240ac1a0 0x7f692416ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7efdd7fff700 1 Processor -- start 2023-10-08T16:04:23.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f4a4c99b700 1 Processor -- start 2023-10-08T16:04:23.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f4a4c99b700 1 -- start start 2023-10-08T16:04:23.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7efdd7fff700 1 -- start start 2023-10-08T16:04:23.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f6928b11700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69240b0050 0x7f6924167520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f6928b11700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692416a970 con 0x7f69240ac1a0 2023-10-08T16:04:23.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f6928b11700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6924159290 con 0x7f6924087ba0 2023-10-08T16:04:23.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f6928b11700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6924077cf0 con 0x7f69240b0050 2023-10-08T16:04:23.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f6922ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69240ac1a0 0x7f692416ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f6922ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69240ac1a0 0x7f692416ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43018/0 (socket says 172.21.15.133:43018) 2023-10-08T16:04:23.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f6922ffd700 1 -- 172.21.15.133:0/2976834896 learned_addr learned my addr 172.21.15.133:0/2976834896 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:23.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f6923fff700 1 --2- 172.21.15.133:0/2976834896 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69240b0050 0x7f6924167520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f6922ffd700 1 -- 172.21.15.133:0/2976834896 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69240b0050 msgr2=0x7f6924167520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:23.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f6922ffd700 1 --2- 172.21.15.133:0/2976834896 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69240b0050 0x7f6924167520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f6922ffd700 1 -- 172.21.15.133:0/2976834896 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6924087ba0 msgr2=0x7f6924158d50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T16:04:23.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f6922ffd700 1 --2- 172.21.15.133:0/2976834896 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6924087ba0 0x7f6924158d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f6922ffd700 1 -- 172.21.15.133:0/2976834896 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69140094f0 con 0x7f69240ac1a0 2023-10-08T16:04:23.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f6922ffd700 1 --2- 172.21.15.133:0/2976834896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69240ac1a0 0x7f692416ad90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f691800d890 tx=0x7f6918008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:23.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f4a4c99b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a480ab750 0x7f4a481442f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f4a4c99b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a481411f0 con 0x7f4a480b1dc0 2023-10-08T16:04:23.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f4a4c99b700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a4806b5a0 con 0x7f4a4806e700 2023-10-08T16:04:23.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7f4a4c99b700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4806b330 con 0x7f4a480ab750 2023-10-08T16:04:23.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7efdd7fff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdd80b1dc0 0x7efdd8143810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7efdd7fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efdd8140430 0x7efdd8140880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f50208d7700 1 --2- 172.21.15.133:0/2464656222 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f501c0aead0 0x7f501c068370 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f500c00b9f0 tx=0x7f500c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ff8784f0363e857 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:23.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7efdd7fff700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd81445c0 con 0x7efdd806dda0 2023-10-08T16:04:23.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7efdd7fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd8143d50 con 0x7efdd8140430 2023-10-08T16:04:23.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.891+0000 7efdd7fff700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd8140dc0 con 0x7efdd80b1dc0 2023-10-08T16:04:23.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f4a477fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4a480b1dc0 0x7f4a4806dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49462/0 (socket says 172.21.15.133:49462) 2023-10-08T16:04:23.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f4a477fe700 1 -- 172.21.15.133:0/3962365282 learned_addr learned my addr 172.21.15.133:0/3962365282 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:23.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f4a46ffd700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f4a4806e700 0x7f4a48148be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.133:42752/0 (socket says 172.21.15.133:42752) 2023-10-08T16:04:23.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f4a47fff700 1 --2- 172.21.15.133:0/3962365282 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a480ab750 0x7f4a481442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7efdd67fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efdd8140430 0x7efdd8140880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7efdd67fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efdd8140430 0x7efdd8140880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43024/0 (socket says 172.21.15.133:43024) 2023-10-08T16:04:23.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7efdd6ffd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdd80b1dc0 0x7efdd8143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7efdd67fc700 1 -- 172.21.15.133:0/1989989190 learned_addr learned my addr 172.21.15.133:0/1989989190 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:23.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f5013fff700 1 -- 172.21.15.133:0/2464656222 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c009e60 con 0x7f501c0aead0 2023-10-08T16:04:23.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7efdd67fc700 1 -- 172.21.15.133:0/1989989190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdd80b1dc0 msgr2=0x7efdd8143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:23.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7efdd67fc700 1 --2- 172.21.15.133:0/1989989190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdd80b1dc0 0x7efdd8143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7efdd67fc700 1 -- 172.21.15.133:0/1989989190 >> v1:172.21.15.190:6789/0 conn(0x7efdd806dda0 legacy=0x7efdd806e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:23.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7efdd67fc700 1 -- 172.21.15.133:0/1989989190 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd806b580 con 0x7efdd8140430 2023-10-08T16:04:23.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f5013fff700 1 -- 172.21.15.133:0/2464656222 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500c00b360 con 0x7f501c0aead0 2023-10-08T16:04:23.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f5013fff700 1 -- 172.21.15.133:0/2464656222 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c00b700 con 0x7f501c0aead0 2023-10-08T16:04:23.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7efdd67fc700 1 --2- 172.21.15.133:0/1989989190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdd8140430 0x7efdd8140880 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0099b0 tx=0x7efdcc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d737a31daeab161 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:23.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f4a47fff700 1 -- 172.21.15.133:0/3962365282 >> v1:172.21.15.190:6789/0 conn(0x7f4a4806e700 legacy=0x7f4a48148be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:23.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f4a47fff700 1 -- 172.21.15.133:0/3962365282 >> v1:172.21.15.133:6789/0 conn(0x7f4a480b1dc0 legacy=0x7f4a4806dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:23.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f4a47fff700 1 -- 172.21.15.133:0/3962365282 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a480aed70 con 0x7f4a480ab750 2023-10-08T16:04:23.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f4a47fff700 1 --2- 172.21.15.133:0/3962365282 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a480ab750 0x7f4a481442f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009910 tx=0x7f4a380091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=228efebca9b0bebc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:23.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f502333c700 1 -- 172.21.15.133:0/2464656222 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f501c0aead0 msgr2=0x7f501c068370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:23.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f502333c700 1 --2- 172.21.15.133:0/2464656222 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f501c0aead0 0x7f501c068370 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f500c00b9f0 tx=0x7f500c009250 comp rx=0 tx=0).stop 2023-10-08T16:04:23.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f502333c700 1 -- 172.21.15.133:0/2464656222 shutdown_connections 2023-10-08T16:04:23.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f4a467fc700 1 -- 172.21.15.133:0/3962365282 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3800b860 con 0x7f4a480ab750 2023-10-08T16:04:23.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f502333c700 1 --2- 172.21.15.133:0/2464656222 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f501c0aead0 0x7f501c068370 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f502333c700 1 --2- 172.21.15.133:0/2464656222 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f501c0ae1c0 0x7f501c0ae590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f502333c700 1 -- 172.21.15.133:0/2464656222 >> 172.21.15.133:0/2464656222 conn(0x7f501c0b4ba0 msgr2=0x7f501c0b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:23.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f4a467fc700 1 -- 172.21.15.133:0/3962365282 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3800b9c0 con 0x7f4a480ab750 2023-10-08T16:04:23.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f4a467fc700 1 -- 172.21.15.133:0/3962365282 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3800bd80 con 0x7f4a480ab750 2023-10-08T16:04:23.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f502333c700 1 -- 172.21.15.133:0/2464656222 shutdown_connections 2023-10-08T16:04:23.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f4a4c99b700 1 -- 172.21.15.133:0/3962365282 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a480ab750 msgr2=0x7f4a481442f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:23.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f4a4c99b700 1 --2- 172.21.15.133:0/3962365282 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a480ab750 0x7f4a481442f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009910 tx=0x7f4a380091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f502333c700 1 -- 172.21.15.133:0/2464656222 wait complete. 2023-10-08T16:04:23.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f4a4c99b700 1 -- 172.21.15.133:0/3962365282 shutdown_connections 2023-10-08T16:04:23.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f4a4c99b700 1 --2- 172.21.15.133:0/3962365282 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a480ab750 0x7f4a481442f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f4a4c99b700 1 -- 172.21.15.133:0/3962365282 >> 172.21.15.133:0/3962365282 conn(0x7f4a480636b0 msgr2=0x7f4a480b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:23.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f939cff9700 1 -- 172.21.15.133:0/1333100537 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f939404c2f0 con 0x7f93a00b0030 2023-10-08T16:04:23.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f69137fe700 1 -- 172.21.15.133:0/2976834896 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69180125f0 con 0x7f69240ac1a0 2023-10-08T16:04:23.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7fb5f77fe700 1 -- 172.21.15.133:0/757057849 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec009e80 con 0x7fb5f80ad010 2023-10-08T16:04:23.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7fb5f77fe700 1 -- 172.21.15.133:0/757057849 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ec00b860 con 0x7fb5f80ad010 2023-10-08T16:04:23.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7fb5f77fe700 1 -- 172.21.15.133:0/757057849 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec00bc20 con 0x7fb5f80ad010 2023-10-08T16:04:23.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7efdd5ffb700 1 -- 172.21.15.133:0/1989989190 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc009ea0 con 0x7efdd8140430 2023-10-08T16:04:23.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f69137fe700 1 -- 172.21.15.133:0/2976834896 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6918012750 con 0x7f69240ac1a0 2023-10-08T16:04:23.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f502333c700 1 Processor -- start 2023-10-08T16:04:23.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7f502333c700 1 -- start start 2023-10-08T16:04:23.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7ff4f4541700 1 Processor -- start 2023-10-08T16:04:23.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7ff4f4541700 1 -- start start 2023-10-08T16:04:23.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7fb5fdc9d700 1 -- 172.21.15.133:0/757057849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f80ad010 msgr2=0x7fb5f80ad440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:23.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7fb5fdc9d700 1 --2- 172.21.15.133:0/757057849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f80ad010 0x7fb5f80ad440 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0098e0 tx=0x7fb5ec0091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7efdd5ffb700 1 -- 172.21.15.133:0/1989989190 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdcc00b860 con 0x7efdd8140430 2023-10-08T16:04:23.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.895+0000 7efdd5ffb700 1 -- 172.21.15.133:0/1989989190 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc00bc00 con 0x7efdd8140430 2023-10-08T16:04:23.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7efdd7fff700 1 -- 172.21.15.133:0/1989989190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdd8140430 msgr2=0x7efdd8140880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:23.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7efdd7fff700 1 --2- 172.21.15.133:0/1989989190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdd8140430 0x7efdd8140880 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0099b0 tx=0x7efdcc009250 comp rx=0 tx=0).stop 2023-10-08T16:04:23.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f6928b11700 1 -- 172.21.15.133:0/2976834896 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69241670f0 con 0x7f69240ac1a0 2023-10-08T16:04:23.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f6928b11700 1 -- 172.21.15.133:0/2976834896 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69241597a0 con 0x7f69240ac1a0 2023-10-08T16:04:23.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f502333c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f501c0688b0 0x7f501c151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f502333c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f501c0ae1c0 0x7f501c143d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f502333c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f501c0aead0 0x7f501c13da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f502333c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c144900 con 0x7f501c0ae1c0 2023-10-08T16:04:23.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f502333c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c0a9860 con 0x7f501c0688b0 2023-10-08T16:04:23.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f502333c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c152410 con 0x7f501c0aead0 2023-10-08T16:04:23.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f4a4c99b700 1 -- 172.21.15.133:0/3962365282 shutdown_connections 2023-10-08T16:04:23.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7efdd7fff700 1 -- 172.21.15.133:0/1989989190 shutdown_connections 2023-10-08T16:04:23.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7efdd7fff700 1 --2- 172.21.15.133:0/1989989190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdd8140430 0x7efdd8140880 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0099b0 tx=0x7efdcc009250 comp rx=0 tx=0).stop 2023-10-08T16:04:23.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7efdd7fff700 1 --2- 172.21.15.133:0/1989989190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdd80b1dc0 0x7efdd8143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7efdd7fff700 1 -- 172.21.15.133:0/1989989190 >> 172.21.15.133:0/1989989190 conn(0x7efdd80636b0 msgr2=0x7efdd80b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:23.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f50210d8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f501c0688b0 0x7f501c151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f50210d8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f501c0688b0 0x7f501c151ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.133:53488/0 (socket says 172.21.15.133:53488) 2023-10-08T16:04:23.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f50210d8700 1 -- 172.21.15.133:0/361314381 learned_addr learned my addr 172.21.15.133:0/361314381 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:23.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7ff4f4541700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff4ec0aea40 0x7ff4ec067ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f69137fe700 1 -- 172.21.15.133:0/2976834896 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6918012ad0 con 0x7f69240ac1a0 2023-10-08T16:04:23.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7ff4f4541700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4ec0b1120 0x7ff4ec068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7ff4f4541700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4ec0a9d80 con 0x7ff4ec068d50 2023-10-08T16:04:23.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7ff4f4541700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4ec0b0330 con 0x7ff4ec0aea40 2023-10-08T16:04:23.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7ff4f4541700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec0aa210 con 0x7ff4ec0b1120 2023-10-08T16:04:23.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7ff4f22dd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff4ec0aea40 0x7ff4ec067ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7ff4f22dd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff4ec0aea40 0x7ff4ec067ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43026/0 (socket says 172.21.15.133:43026) 2023-10-08T16:04:23.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7ff4f22dd700 1 -- 172.21.15.133:0/3509999810 learned_addr learned my addr 172.21.15.133:0/3509999810 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:23.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f6928b11700 1 -- 172.21.15.133:0/2976834896 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f692416aab0 con 0x7f69240ac1a0 2023-10-08T16:04:23.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7efdd7fff700 1 -- 172.21.15.133:0/1989989190 shutdown_connections 2023-10-08T16:04:23.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f50210d8700 1 -- 172.21.15.133:0/361314381 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f501c0aead0 msgr2=0x7f501c13da00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:04:23.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f50210d8700 1 --2- 172.21.15.133:0/361314381 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f501c0aead0 0x7f501c13da00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f50210d8700 1 -- 172.21.15.133:0/361314381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f501c0ae1c0 msgr2=0x7f501c143d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:23.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f50208d7700 1 --2- 172.21.15.133:0/361314381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f501c0ae1c0 0x7f501c143d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7ff4f1adc700 1 --2- 172.21.15.133:0/3509999810 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4ec0b1120 0x7ff4ec068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7ff4f22dd700 1 -- 172.21.15.133:0/3509999810 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4ec0b1120 msgr2=0x7ff4ec068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:23.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7ff4f22dd700 1 --2- 172.21.15.133:0/3509999810 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4ec0b1120 0x7ff4ec068810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7ff4f22dd700 1 -- 172.21.15.133:0/3509999810 >> v1:172.21.15.133:6789/0 conn(0x7ff4ec068d50 legacy=0x7ff4ec145e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T16:04:23.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f50210d8700 1 --2- 172.21.15.133:0/361314381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f501c0ae1c0 0x7f501c143d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f50210d8700 1 -- 172.21.15.133:0/361314381 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500c0094f0 con 0x7f501c0688b0 2023-10-08T16:04:23.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f50208d7700 1 --2- 172.21.15.133:0/361314381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f501c0ae1c0 0x7f501c143d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:04:23.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f50210d8700 1 --2- 172.21.15.133:0/361314381 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f501c0688b0 0x7f501c151ed0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f501800b5e0 tx=0x7f50180090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:23.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f50117fa700 1 -- 172.21.15.133:0/361314381 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501800f510 con 0x7f501c0688b0 2023-10-08T16:04:23.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f69137fe700 1 -- 172.21.15.133:0/2976834896 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f691801e460 con 0x7f69240ac1a0 2023-10-08T16:04:23.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7efdd7fff700 1 -- 172.21.15.133:0/1989989190 wait complete. 2023-10-08T16:04:23.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7efdd7fff700 1 Processor -- start 2023-10-08T16:04:23.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f69137fe700 1 --2- 172.21.15.133:0/2976834896 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6908060520 0x7f69080629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f69137fe700 1 -- 172.21.15.133:0/2976834896 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f691807ce80 con 0x7f69240ac1a0 2023-10-08T16:04:23.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f69237fe700 1 --2- 172.21.15.133:0/2976834896 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6908060520 0x7f69080629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f50117fa700 1 -- 172.21.15.133:0/361314381 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501800f690 con 0x7f501c0688b0 2023-10-08T16:04:23.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f502333c700 1 -- 172.21.15.133:0/361314381 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f501c0a9b40 con 0x7f501c0688b0 2023-10-08T16:04:23.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f50117fa700 1 -- 172.21.15.133:0/361314381 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501800fa50 con 0x7f501c0688b0 2023-10-08T16:04:23.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f502333c700 1 -- 172.21.15.133:0/361314381 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f501c1519b0 con 0x7f501c0688b0 2023-10-08T16:04:23.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7f69237fe700 1 --2- 172.21.15.133:0/2976834896 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6908060520 0x7f69080629d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f69240b0ca0 tx=0x7f6914016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:23.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7efdd7fff700 1 -- start start 2023-10-08T16:04:23.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7efdd7fff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdd806dda0 0x7efdd813c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7efdd7fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdd80b1dc0 0x7efdd813cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7efdd7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdd8142f60 0x7efdd8159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7efdd7fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd813bd80 con 0x7efdd8142f60 2023-10-08T16:04:23.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7efdd7fff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd813bf80 con 0x7efdd80b1dc0 2023-10-08T16:04:23.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7efdd7fff700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd80ad7f0 con 0x7efdd806dda0 2023-10-08T16:04:23.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7efdd77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdd8142f60 0x7efdd8159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7efdd77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdd8142f60 0x7efdd8159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43048/0 (socket says 172.21.15.133:43048) 2023-10-08T16:04:23.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7efdd77fe700 1 -- 172.21.15.133:0/3309167639 learned_addr learned my addr 172.21.15.133:0/3309167639 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:23.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.903+0000 7efdd67fc700 1 --2- 172.21.15.133:0/3309167639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdd80b1dc0 0x7efdd813cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7ff4f22dd700 1 -- 172.21.15.133:0/3509999810 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec0ab0e0 con 0x7ff4ec0aea40 2023-10-08T16:04:23.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.899+0000 7ff4f22dd700 1 --2- 172.21.15.133:0/3509999810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4ec0aea40 0x7ff4ec067ce0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80099b0 tx=0x7ff4e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916ab7b824dea3e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:23.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.903+0000 7efdd77fe700 1 -- 172.21.15.133:0/3309167639 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdd806dda0 msgr2=0x7efdd813c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:23.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.903+0000 7efdd77fe700 1 --2- 172.21.15.133:0/3309167639 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdd806dda0 0x7efdd813c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.903+0000 7efdd77fe700 1 -- 172.21.15.133:0/3309167639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdd80b1dc0 msgr2=0x7efdd813cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:23.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.903+0000 7efdd77fe700 1 --2- 172.21.15.133:0/3309167639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdd80b1dc0 0x7efdd813cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.903+0000 7efdd77fe700 1 -- 172.21.15.133:0/3309167639 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdcc0094f0 con 0x7efdd8142f60 2023-10-08T16:04:23.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.903+0000 7efdd77fe700 1 --2- 172.21.15.133:0/3309167639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdd8142f60 0x7efdd8159cb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efdd000c8e0 tx=0x7efdd0001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:23.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.903+0000 7efdbeffd700 1 -- 172.21.15.133:0/3309167639 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd000ce80 con 0x7efdd8142f60 2023-10-08T16:04:23.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.903+0000 7ff4f12db700 1 -- 172.21.15.133:0/3509999810 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e800b860 con 0x7ff4ec0aea40 2023-10-08T16:04:23.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.903+0000 7efdbeffd700 1 -- 172.21.15.133:0/3309167639 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd000a7e0 con 0x7efdd8142f60 2023-10-08T16:04:23.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.903+0000 7efdbeffd700 1 -- 172.21.15.133:0/3309167639 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd000ab80 con 0x7efdd8142f60 2023-10-08T16:04:23.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.903+0000 7f69137fe700 1 -- 172.21.15.133:0/2976834896 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f692416aab0 con 0x7f69240ac1a0 2023-10-08T16:04:23.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.903+0000 7efdd7fff700 1 -- 172.21.15.133:0/3309167639 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd80ade00 con 0x7efdd8142f60 2023-10-08T16:04:23.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.903+0000 7ff4f12db700 1 -- 172.21.15.133:0/3509999810 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e800b9c0 con 0x7ff4ec0aea40 2023-10-08T16:04:23.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.903+0000 7ff4f12db700 1 -- 172.21.15.133:0/3509999810 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e800bd80 con 0x7ff4ec0aea40 2023-10-08T16:04:23.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.907+0000 7f50117fa700 1 -- 172.21.15.133:0/361314381 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f501802f920 con 0x7f501c0688b0 2023-10-08T16:04:23.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.903+0000 7efdd7fff700 1 -- 172.21.15.133:0/3309167639 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd80ac9a0 con 0x7efdd8142f60 2023-10-08T16:04:23.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.907+0000 7efdd7fff700 1 -- 172.21.15.133:0/3309167639 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd804be40 con 0x7efdd8142f60 2023-10-08T16:04:23.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.907+0000 7f50117fa700 1 --2- 172.21.15.133:0/361314381 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5000060550 0x7f5000062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.907+0000 7ff4f4541700 1 -- 172.21.15.133:0/3509999810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4ec0aea40 msgr2=0x7ff4ec067ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:23.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.907+0000 7ff4f4541700 1 --2- 172.21.15.133:0/3509999810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4ec0aea40 0x7ff4ec067ce0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80099b0 tx=0x7ff4e8009250 comp rx=0 tx=0).stop 2023-10-08T16:04:23.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.907+0000 7f50117fa700 1 -- 172.21.15.133:0/361314381 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f501807bac0 con 0x7f501c0688b0 2023-10-08T16:04:23.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.907+0000 7f50208d7700 1 --2- 172.21.15.133:0/361314381 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5000060550 0x7f5000062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.907+0000 7ff4f4541700 1 -- 172.21.15.133:0/3509999810 shutdown_connections 2023-10-08T16:04:23.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.907+0000 7ff4f4541700 1 --2- 172.21.15.133:0/3509999810 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4ec0b1120 0x7ff4ec068810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.907+0000 7ff4f4541700 1 --2- 172.21.15.133:0/3509999810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4ec0aea40 0x7ff4ec067ce0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.907+0000 7ff4f4541700 1 -- 172.21.15.133:0/3509999810 >> 172.21.15.133:0/3509999810 conn(0x7ff4ec0b4ba0 msgr2=0x7ff4ec0b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:23.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.907+0000 7f50208d7700 1 --2- 172.21.15.133:0/361314381 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5000060550 0x7f5000062a00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f500c00b9f0 tx=0x7f500c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:23.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7f4a4c99b700 1 -- 172.21.15.133:0/3962365282 wait complete. 2023-10-08T16:04:23.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7f4a4c99b700 1 Processor -- start 2023-10-08T16:04:23.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7fb5fdc9d700 1 -- 172.21.15.133:0/757057849 shutdown_connections 2023-10-08T16:04:23.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7fb5fdc9d700 1 --2- 172.21.15.133:0/757057849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f80ad010 0x7fb5f80ad440 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7fb5fdc9d700 1 --2- 172.21.15.133:0/757057849 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5f80b1dc0 0x7fb5f80ab730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7fb5fdc9d700 1 -- 172.21.15.133:0/757057849 >> 172.21.15.133:0/757057849 conn(0x7fb5f80636b0 msgr2=0x7fb5f80b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:23.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7fb5fdc9d700 1 -- 172.21.15.133:0/757057849 shutdown_connections 2023-10-08T16:04:23.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7fb5fdc9d700 1 -- 172.21.15.133:0/757057849 wait complete. 2023-10-08T16:04:23.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.907+0000 7efdbeffd700 1 -- 172.21.15.133:0/3309167639 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7efdd0012420 con 0x7efdd8142f60 2023-10-08T16:04:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7efdbeffd700 1 --2- 172.21.15.133:0/3309167639 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7efdc4060580 0x7efdc4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7efdd6ffd700 1 --2- 172.21.15.133:0/3309167639 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7efdc4060580 0x7efdc4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7efdd6ffd700 1 --2- 172.21.15.133:0/3309167639 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7efdc4060580 0x7efdc4062a30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efdc800df30 tx=0x7efdc800f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7efdbeffd700 1 -- 172.21.15.133:0/3309167639 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efdd007cc30 con 0x7efdd8142f60 2023-10-08T16:04:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7ff4f4541700 1 -- 172.21.15.133:0/3509999810 shutdown_connections 2023-10-08T16:04:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7fb5fdc9d700 1 Processor -- start 2023-10-08T16:04:23.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7ff4f4541700 1 -- 172.21.15.133:0/3509999810 wait complete. 2023-10-08T16:04:23.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7ff4f4541700 1 Processor -- start 2023-10-08T16:04:23.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7ff4f4541700 1 -- start start 2023-10-08T16:04:23.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7f502333c700 1 -- 172.21.15.133:0/361314381 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ffc0052b0 con 0x7f501c0688b0 2023-10-08T16:04:23.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7ff4f4541700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4ec068d50 0x7ff4ec0a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7ff4f4541700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4ec0aea40 0x7ff4ec0a6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7ff4f4541700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4ec0b1120 0x7ff4ec0a7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7ff4f4541700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec0a5740 con 0x7ff4ec0aea40 2023-10-08T16:04:23.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7ff4f4541700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec0a5a20 con 0x7ff4ec068d50 2023-10-08T16:04:23.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7ff4f4541700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec0a9570 con 0x7ff4ec0b1120 2023-10-08T16:04:23.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7ff4f1adc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4ec0aea40 0x7ff4ec0a6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7fb5fdc9d700 1 -- start start 2023-10-08T16:04:23.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7fb5fdc9d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5f80ad010 0x7fb5f80af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7fb5fdc9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f80b1dc0 0x7fb5f8133ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7fb5fdc9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5f8142d60 0x7fb5f8132f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7fb5fdc9d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f8136990 con 0x7fb5f80b1dc0 2023-10-08T16:04:23.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7fb5fdc9d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f806b470 con 0x7fb5f8142d60 2023-10-08T16:04:23.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7fb5fdc9d700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f806c110 con 0x7fb5f80ad010 2023-10-08T16:04:23.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7ff4f1adc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4ec0aea40 0x7ff4ec0a6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43050/0 (socket says 172.21.15.133:43050) 2023-10-08T16:04:23.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7ff4f1adc700 1 -- 172.21.15.133:0/2255541065 learned_addr learned my addr 172.21.15.133:0/2255541065 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:23.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7ff4f22dd700 1 --2- 172.21.15.133:0/2255541065 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4ec068d50 0x7ff4ec0a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7fb5fd49c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5f8142d60 0x7fb5f8132f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7fb5fcc9b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5f80ad010 0x7fb5f80af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7fb5f7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f80b1dc0 0x7fb5f8133ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7fb5fd49c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5f8142d60 0x7fb5f8132f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.133:53516/0 (socket says 172.21.15.133:53516) 2023-10-08T16:04:23.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7fb5fd49c700 1 -- 172.21.15.133:0/243687682 learned_addr learned my addr 172.21.15.133:0/243687682 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:23.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7f4a4c99b700 1 -- start start 2023-10-08T16:04:23.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7f4a4c99b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a4806e700 0x7f4a4813f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7f4a4c99b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a480ab750 0x7f4a48142b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7f4a4c99b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a480b1dc0 0x7f4a481536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7f4a4c99b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4813bb90 con 0x7f4a480ab750 2023-10-08T16:04:23.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7f4a4c99b700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4813f870 con 0x7f4a4806e700 2023-10-08T16:04:23.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7f4a4c99b700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4813d840 con 0x7f4a480b1dc0 2023-10-08T16:04:23.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7fb5f7fff700 1 -- 172.21.15.133:0/243687682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5f80ad010 msgr2=0x7fb5f80af380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:23.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7fb5f7fff700 1 --2- 172.21.15.133:0/243687682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5f80ad010 0x7fb5f80af380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7fb5f7fff700 1 -- 172.21.15.133:0/243687682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5f8142d60 msgr2=0x7fb5f8132f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:23.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7fb5f7fff700 1 --2- 172.21.15.133:0/243687682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5f8142d60 0x7fb5f8132f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7fb5f7fff700 1 -- 172.21.15.133:0/243687682 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec009420 con 0x7fb5f80b1dc0 2023-10-08T16:04:23.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7ff4f22dd700 1 -- 172.21.15.133:0/2255541065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4ec0b1120 msgr2=0x7ff4ec0a7110 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T16:04:23.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7ff4f22dd700 1 --2- 172.21.15.133:0/2255541065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4ec0b1120 0x7ff4ec0a7110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7ff4f22dd700 1 -- 172.21.15.133:0/2255541065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4ec0aea40 msgr2=0x7ff4ec0a6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:23.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.911+0000 7ff4f22dd700 1 --2- 172.21.15.133:0/2255541065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4ec0aea40 0x7ff4ec0a6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.915+0000 7ff4f22dd700 1 -- 172.21.15.133:0/2255541065 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e80094f0 con 0x7ff4ec068d50 2023-10-08T16:04:23.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.915+0000 7f4a46ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a480ab750 0x7f4a48142b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.915+0000 7fb5f7fff700 1 --2- 172.21.15.133:0/243687682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f80b1dc0 0x7fb5f8133ac0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec016000 tx=0x7fb5ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:23.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.915+0000 7f4a477fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a4806e700 0x7f4a4813f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.915+0000 7f4a477fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a4806e700 0x7f4a4813f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.133:53524/0 (socket says 172.21.15.133:53524) 2023-10-08T16:04:23.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.915+0000 7f4a477fe700 1 -- 172.21.15.133:0/3205677318 learned_addr learned my addr 172.21.15.133:0/3205677318 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:23.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.915+0000 7f4a46ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a480ab750 0x7f4a48142b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43072/0 (socket says 172.21.15.133:43072) 2023-10-08T16:04:23.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.915+0000 7ff4f22dd700 1 --2- 172.21.15.133:0/2255541065 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4ec068d50 0x7ff4ec0a5eb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0a9a90 tx=0x7ff4e8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:23.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.915+0000 7f4a47fff700 1 --2- 172.21.15.133:0/3205677318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a480b1dc0 0x7f4a481536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.915+0000 7f4a46ffd700 1 -- 172.21.15.133:0/3205677318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a480b1dc0 msgr2=0x7f4a481536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:23.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.915+0000 7f4a46ffd700 1 --2- 172.21.15.133:0/3205677318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a480b1dc0 0x7f4a481536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.915+0000 7f4a46ffd700 1 -- 172.21.15.133:0/3205677318 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a4806e700 msgr2=0x7f4a4813f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:23.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.915+0000 7f4a46ffd700 1 --2- 172.21.15.133:0/3205677318 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a4806e700 0x7f4a4813f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:23.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.915+0000 7f4a46ffd700 1 -- 172.21.15.133:0/3205677318 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a38009420 con 0x7f4a480ab750 2023-10-08T16:04:23.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.915+0000 7f4a46ffd700 1 --2- 172.21.15.133:0/3205677318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a480ab750 0x7f4a48142b00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4a4000cd30 tx=0x7f4a40001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:23.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.915+0000 7f4a377fe700 1 -- 172.21.15.133:0/3205677318 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4000ce30 con 0x7f4a480ab750 2023-10-08T16:04:23.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.915+0000 7efdbeffd700 1 -- 172.21.15.133:0/3309167639 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efdd004d180 con 0x7efdd8142f60 2023-10-08T16:04:23.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.915+0000 7f4a377fe700 1 -- 172.21.15.133:0/3205677318 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a40005df0 con 0x7f4a480ab750 2023-10-08T16:04:23.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.915+0000 7f4a4c99b700 1 -- 172.21.15.133:0/3205677318 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a4813b330 con 0x7f4a480ab750 2023-10-08T16:04:23.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.915+0000 7f4a377fe700 1 -- 172.21.15.133:0/3205677318 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4000aac0 con 0x7f4a480ab750 2023-10-08T16:04:23.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.915+0000 7f4a4c99b700 1 -- 172.21.15.133:0/3205677318 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a48143040 con 0x7f4a480ab750 2023-10-08T16:04:23.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.919+0000 7f4a377fe700 1 -- 172.21.15.133:0/3205677318 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4a400070f0 con 0x7f4a480ab750 2023-10-08T16:04:23.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.919+0000 7f4a377fe700 1 --2- 172.21.15.133:0/3205677318 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f4a2c0605a0 0x7f4a2c062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.919+0000 7f4a377fe700 1 -- 172.21.15.133:0/3205677318 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4a4007c640 con 0x7f4a480ab750 2023-10-08T16:04:23.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.919+0000 7f4a477fe700 1 --2- 172.21.15.133:0/3205677318 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f4a2c0605a0 0x7f4a2c062a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.919+0000 7f4a477fe700 1 --2- 172.21.15.133:0/3205677318 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f4a2c0605a0 0x7f4a2c062a50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c007fd0 tx=0x7f4a3c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:23.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.923+0000 7fb5f4ff9700 1 -- 172.21.15.133:0/243687682 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec01f070 con 0x7fb5f80b1dc0 2023-10-08T16:04:23.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.923+0000 7fb5f4ff9700 1 -- 172.21.15.133:0/243687682 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ec006af0 con 0x7fb5f80b1dc0 2023-10-08T16:04:23.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.923+0000 7f4a4c99b700 1 -- 172.21.15.133:0/3205677318 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a4804be40 con 0x7f4a480ab750 2023-10-08T16:04:23.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.923+0000 7fb5f4ff9700 1 -- 172.21.15.133:0/243687682 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec00b9d0 con 0x7fb5f80b1dc0 2023-10-08T16:04:23.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.923+0000 7fb5fdc9d700 1 -- 172.21.15.133:0/243687682 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f806c450 con 0x7fb5f80b1dc0 2023-10-08T16:04:23.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.923+0000 7fb5fdc9d700 1 -- 172.21.15.133:0/243687682 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f815a680 con 0x7fb5f80b1dc0 2023-10-08T16:04:23.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.923+0000 7ff4e27fc700 1 -- 172.21.15.133:0/2255541065 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e801f070 con 0x7ff4ec068d50 2023-10-08T16:04:23.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.923+0000 7ff4e27fc700 1 -- 172.21.15.133:0/2255541065 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e8002f30 con 0x7ff4ec068d50 2023-10-08T16:04:23.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.923+0000 7ff4e27fc700 1 -- 172.21.15.133:0/2255541065 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8011bd0 con 0x7ff4ec068d50 2023-10-08T16:04:23.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.927+0000 7ff4f4541700 1 -- 172.21.15.133:0/2255541065 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4ec0a63f0 con 0x7ff4ec068d50 2023-10-08T16:04:23.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.927+0000 7ff4f4541700 1 -- 172.21.15.133:0/2255541065 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ec15ed10 con 0x7ff4ec068d50 2023-10-08T16:04:23.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.927+0000 7fb5fdc9d700 1 -- 172.21.15.133:0/243687682 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f804be40 con 0x7fb5f80b1dc0 2023-10-08T16:04:23.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.927+0000 7f50117fa700 1 -- 172.21.15.133:0/361314381 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f501804c130 con 0x7f501c0688b0 2023-10-08T16:04:23.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.927+0000 7ff4e27fc700 1 -- 172.21.15.133:0/2255541065 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff4e8023070 con 0x7ff4ec068d50 2023-10-08T16:04:23.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.927+0000 7ff4e27fc700 1 --2- 172.21.15.133:0/2255541065 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff4d0060550 0x7ff4d0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.927+0000 7ff4f1adc700 1 --2- 172.21.15.133:0/2255541065 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff4d0060550 0x7ff4d0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.927+0000 7ff4e27fc700 1 -- 172.21.15.133:0/2255541065 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff4e807d570 con 0x7ff4ec068d50 2023-10-08T16:04:23.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.931+0000 7ff4f1adc700 1 --2- 172.21.15.133:0/2255541065 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff4d0060550 0x7ff4d0062a00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0ae4f0 tx=0x7ff4e4009920 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:23.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.935+0000 7f4a377fe700 1 -- 172.21.15.133:0/3205677318 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4a4004cd90 con 0x7f4a480ab750 2023-10-08T16:04:23.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.939+0000 7ff4f4541700 1 -- 172.21.15.133:0/2255541065 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4ec064810 con 0x7ff4ec068d50 2023-10-08T16:04:23.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.939+0000 7fb5f4ff9700 1 -- 172.21.15.133:0/243687682 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb5ec023070 con 0x7fb5f80b1dc0 2023-10-08T16:04:23.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.939+0000 7fb5f4ff9700 1 --2- 172.21.15.133:0/243687682 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb5dc0605f0 0x7fb5dc062aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:23.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.939+0000 7fb5f4ff9700 1 -- 172.21.15.133:0/243687682 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb5ec07dc10 con 0x7fb5f80b1dc0 2023-10-08T16:04:23.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.939+0000 7fb5fcc9b700 1 --2- 172.21.15.133:0/243687682 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb5dc0605f0 0x7fb5dc062aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:23.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.939+0000 7fb5f4ff9700 1 -- 172.21.15.133:0/243687682 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb5ec0a6c20 con 0x7fb5f80b1dc0 2023-10-08T16:04:23.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.939+0000 7fb5fcc9b700 1 --2- 172.21.15.133:0/243687682 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb5dc0605f0 0x7fb5dc062aa0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8006fd0 tx=0x7fb5e8000f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:23.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:23.951+0000 7ff4e27fc700 1 -- 172.21.15.133:0/2255541065 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff4e804dc10 con 0x7ff4ec068d50 2023-10-08T16:04:24.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.155+0000 7f708d76f700 1 -- 172.21.15.133:0/2584682370 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f7068005830 con 0x7f70880ab350 2023-10-08T16:04:24.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.155+0000 7f706effd700 1 -- 172.21.15.133:0/2584682370 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7078050630 con 0x7f70880ab350 2023-10-08T16:04:24.163 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2023-10-08T16:04:24.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.167+0000 7f706cff9700 1 -- 172.21.15.133:0/2584682370 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f7074060580 msgr2=0x7f7074062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.167+0000 7f706cff9700 1 --2- 172.21.15.133:0/2584682370 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f7074060580 0x7f7074062a30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f708813c5f0 tx=0x7f707c007ea0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.167+0000 7f706cff9700 1 -- 172.21.15.133:0/2584682370 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70880ab350 msgr2=0x7f708813e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.167+0000 7f706cff9700 1 --2- 172.21.15.133:0/2584682370 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70880ab350 0x7f708813e840 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f707800e900 tx=0x7f7078008040 comp rx=0 tx=0).stop 2023-10-08T16:04:24.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.167+0000 7f706cff9700 1 -- 172.21.15.133:0/2584682370 shutdown_connections 2023-10-08T16:04:24.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.167+0000 7f706cff9700 1 --2- 172.21.15.133:0/2584682370 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f7074060580 0x7f7074062a30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.167+0000 7f706cff9700 1 --2- 172.21.15.133:0/2584682370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7088146160 0x7f7088143850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.167+0000 7f706cff9700 1 --2- 172.21.15.133:0/2584682370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70880b1030 0x7f70880acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.167+0000 7f706cff9700 1 --2- 172.21.15.133:0/2584682370 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70880ab350 0x7f708813e840 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.167+0000 7f706cff9700 1 -- 172.21.15.133:0/2584682370 >> 172.21.15.133:0/2584682370 conn(0x7f70880b4990 msgr2=0x7f70880b3180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:24.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.167+0000 7f706cff9700 1 -- 172.21.15.133:0/2584682370 shutdown_connections 2023-10-08T16:04:24.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.167+0000 7f706cff9700 1 -- 172.21.15.133:0/2584682370 wait complete. 2023-10-08T16:04:24.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2023-10-08T16:04:24.183 DEBUG:teuthology.parallel:result is None 2023-10-08T16:04:24.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.191+0000 7f6928b11700 1 -- 172.21.15.133:0/2976834896 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f692416aab0 con 0x7f69240ac1a0 2023-10-08T16:04:24.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.191+0000 7f69137fe700 1 -- 172.21.15.133:0/2976834896 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f692416aab0 con 0x7f69240ac1a0 2023-10-08T16:04:24.194 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2023-10-08T16:04:24.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.191+0000 7f93a5d51700 1 -- 172.21.15.133:0/1333100537 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f93a004be40 con 0x7f93a00b0030 2023-10-08T16:04:24.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.191+0000 7f939cff9700 1 -- 172.21.15.133:0/1333100537 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9394017020 con 0x7f93a00b0030 2023-10-08T16:04:24.196 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2023-10-08T16:04:24.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.195+0000 7f6928b11700 1 -- 172.21.15.133:0/2976834896 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6908060520 msgr2=0x7f69080629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.195+0000 7f6928b11700 1 --2- 172.21.15.133:0/2976834896 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6908060520 0x7f69080629d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f69240b0ca0 tx=0x7f6914016000 comp rx=0 tx=0).stop 2023-10-08T16:04:24.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.195+0000 7f6928b11700 1 -- 172.21.15.133:0/2976834896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69240ac1a0 msgr2=0x7f692416ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.195+0000 7f6928b11700 1 --2- 172.21.15.133:0/2976834896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69240ac1a0 0x7f692416ad90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f691800d890 tx=0x7f6918008040 comp rx=0 tx=0).stop 2023-10-08T16:04:24.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.195+0000 7f6928b11700 1 -- 172.21.15.133:0/2976834896 shutdown_connections 2023-10-08T16:04:24.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.195+0000 7f6928b11700 1 --2- 172.21.15.133:0/2976834896 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6908060520 0x7f69080629d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.195+0000 7f6928b11700 1 --2- 172.21.15.133:0/2976834896 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69240b0050 0x7f6924167520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.195+0000 7f6928b11700 1 --2- 172.21.15.133:0/2976834896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69240ac1a0 0x7f692416ad90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.195+0000 7f6928b11700 1 --2- 172.21.15.133:0/2976834896 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6924087ba0 0x7f6924158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.195+0000 7f6928b11700 1 -- 172.21.15.133:0/2976834896 >> 172.21.15.133:0/2976834896 conn(0x7f69240636b0 msgr2=0x7f69240b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:24.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.195+0000 7f6928b11700 1 -- 172.21.15.133:0/2976834896 shutdown_connections 2023-10-08T16:04:24.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.195+0000 7f6928b11700 1 -- 172.21.15.133:0/2976834896 wait complete. 2023-10-08T16:04:24.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.195+0000 7f93a5d51700 1 -- 172.21.15.133:0/1333100537 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f938c060620 msgr2=0x7f938c062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.195+0000 7f93a5d51700 1 --2- 172.21.15.133:0/1333100537 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f938c060620 0x7f938c062ad0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f93900099b0 tx=0x7f9390017000 comp rx=0 tx=0).stop 2023-10-08T16:04:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.195+0000 7f93a5d51700 1 -- 172.21.15.133:0/1333100537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93a00b0030 msgr2=0x7f93a0143830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.195+0000 7f93a5d51700 1 --2- 172.21.15.133:0/1333100537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93a00b0030 0x7f93a0143830 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f939400c590 tx=0x7f939400c8a0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.195+0000 7f93a5d51700 1 -- 172.21.15.133:0/1333100537 shutdown_connections 2023-10-08T16:04:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.195+0000 7f93a5d51700 1 --2- 172.21.15.133:0/1333100537 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f938c060620 0x7f938c062ad0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.195+0000 7f93a5d51700 1 --2- 172.21.15.133:0/1333100537 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93a00b1dc0 0x7f93a0159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.195+0000 7f93a5d51700 1 --2- 172.21.15.133:0/1333100537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93a00b0030 0x7f93a0143830 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.195+0000 7f93a5d51700 1 --2- 172.21.15.133:0/1333100537 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93a0068380 0x7f93a014a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.195+0000 7f93a5d51700 1 -- 172.21.15.133:0/1333100537 >> 172.21.15.133:0/1333100537 conn(0x7f93a0063670 msgr2=0x7f93a014bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:24.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.195+0000 7f93a5d51700 1 -- 172.21.15.133:0/1333100537 shutdown_connections 2023-10-08T16:04:24.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.195+0000 7f93a5d51700 1 -- 172.21.15.133:0/1333100537 wait complete. 2023-10-08T16:04:24.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.207+0000 7efdd7fff700 1 -- 172.21.15.133:0/3309167639 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7efdd80adc60 con 0x7efdd8142f60 2023-10-08T16:04:24.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.207+0000 7efdbeffd700 1 -- 172.21.15.133:0/3309167639 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efdd80adc60 con 0x7efdd8142f60 2023-10-08T16:04:24.209 INFO:teuthology.orchestra.run.smithi133.stdout:55834574855 2023-10-08T16:04:24.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-10-08T16:04:24.211 DEBUG:teuthology.parallel:result is None 2023-10-08T16:04:24.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.207+0000 7efdd7fff700 1 -- 172.21.15.133:0/3309167639 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7efdc4060580 msgr2=0x7efdc4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.207+0000 7efdd7fff700 1 --2- 172.21.15.133:0/3309167639 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7efdc4060580 0x7efdc4062a30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efdc800df30 tx=0x7efdc800f040 comp rx=0 tx=0).stop 2023-10-08T16:04:24.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.207+0000 7efdd7fff700 1 -- 172.21.15.133:0/3309167639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdd8142f60 msgr2=0x7efdd8159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.207+0000 7efdd7fff700 1 --2- 172.21.15.133:0/3309167639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdd8142f60 0x7efdd8159cb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efdd000c8e0 tx=0x7efdd0001710 comp rx=0 tx=0).stop 2023-10-08T16:04:24.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.207+0000 7efdd7fff700 1 -- 172.21.15.133:0/3309167639 shutdown_connections 2023-10-08T16:04:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.207+0000 7efdd7fff700 1 --2- 172.21.15.133:0/3309167639 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7efdc4060580 0x7efdc4062a30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.207+0000 7efdd7fff700 1 --2- 172.21.15.133:0/3309167639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdd8142f60 0x7efdd8159cb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.207+0000 7efdd7fff700 1 --2- 172.21.15.133:0/3309167639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdd80b1dc0 0x7efdd813cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.207+0000 7efdd7fff700 1 --2- 172.21.15.133:0/3309167639 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efdd806dda0 0x7efdd813c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.207+0000 7efdd7fff700 1 -- 172.21.15.133:0/3309167639 >> 172.21.15.133:0/3309167639 conn(0x7efdd80636b0 msgr2=0x7efdd8139dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.207+0000 7efdd7fff700 1 -- 172.21.15.133:0/3309167639 shutdown_connections 2023-10-08T16:04:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.207+0000 7efdd7fff700 1 -- 172.21.15.133:0/3309167639 wait complete. 2023-10-08T16:04:24.214 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2023-10-08T16:04:24.214 DEBUG:teuthology.parallel:result is None 2023-10-08T16:04:24.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.215+0000 7fb5fdc9d700 1 -- 172.21.15.133:0/243687682 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb5f80ae030 con 0x7fb5f80b1dc0 2023-10-08T16:04:24.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.215+0000 7fb5f4ff9700 1 -- 172.21.15.133:0/243687682 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb5ec015090 con 0x7fb5f80b1dc0 2023-10-08T16:04:24.218 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2023-10-08T16:04:24.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.215+0000 7fb5fdc9d700 1 -- 172.21.15.133:0/243687682 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb5dc0605f0 msgr2=0x7fb5dc062aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.215+0000 7fb5fdc9d700 1 --2- 172.21.15.133:0/243687682 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb5dc0605f0 0x7fb5dc062aa0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8006fd0 tx=0x7fb5e8000f90 comp rx=0 tx=0).stop 2023-10-08T16:04:24.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.215+0000 7fb5fdc9d700 1 -- 172.21.15.133:0/243687682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f80b1dc0 msgr2=0x7fb5f8133ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.215+0000 7fb5fdc9d700 1 --2- 172.21.15.133:0/243687682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f80b1dc0 0x7fb5f8133ac0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec016000 tx=0x7fb5ec017000 comp rx=0 tx=0).stop 2023-10-08T16:04:24.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.219+0000 7fb5fdc9d700 1 -- 172.21.15.133:0/243687682 shutdown_connections 2023-10-08T16:04:24.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.219+0000 7fb5fdc9d700 1 --2- 172.21.15.133:0/243687682 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb5dc0605f0 0x7fb5dc062aa0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.219+0000 7fb5fdc9d700 1 --2- 172.21.15.133:0/243687682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5f8142d60 0x7fb5f8132f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.219+0000 7fb5fdc9d700 1 --2- 172.21.15.133:0/243687682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f80b1dc0 0x7fb5f8133ac0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.219+0000 7fb5fdc9d700 1 --2- 172.21.15.133:0/243687682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5f80ad010 0x7fb5f80af380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.219+0000 7fb5fdc9d700 1 -- 172.21.15.133:0/243687682 >> 172.21.15.133:0/243687682 conn(0x7fb5f80636b0 msgr2=0x7fb5f813d920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:24.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.219+0000 7fb5fdc9d700 1 -- 172.21.15.133:0/243687682 shutdown_connections 2023-10-08T16:04:24.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.219+0000 7fb5fdc9d700 1 -- 172.21.15.133:0/243687682 wait complete. 2023-10-08T16:04:24.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.219+0000 7f502333c700 1 -- 172.21.15.133:0/361314381 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4ffc005830 con 0x7f501c0688b0 2023-10-08T16:04:24.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.219+0000 7f50117fa700 1 -- 172.21.15.133:0/361314381 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f501804f750 con 0x7f501c0688b0 2023-10-08T16:04:24.223 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2023-10-08T16:04:24.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.219+0000 7f502333c700 1 -- 172.21.15.133:0/361314381 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5000060550 msgr2=0x7f5000062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.219+0000 7f502333c700 1 --2- 172.21.15.133:0/361314381 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5000060550 0x7f5000062a00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f500c00b9f0 tx=0x7f500c017000 comp rx=0 tx=0).stop 2023-10-08T16:04:24.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.219+0000 7f502333c700 1 -- 172.21.15.133:0/361314381 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f501c0688b0 msgr2=0x7f501c151ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.219+0000 7f502333c700 1 --2- 172.21.15.133:0/361314381 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f501c0688b0 0x7f501c151ed0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f501800b5e0 tx=0x7f50180090f0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.223+0000 7f502333c700 1 -- 172.21.15.133:0/361314381 shutdown_connections 2023-10-08T16:04:24.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.223+0000 7f502333c700 1 --2- 172.21.15.133:0/361314381 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5000060550 0x7f5000062a00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.223+0000 7f502333c700 1 --2- 172.21.15.133:0/361314381 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f501c0aead0 0x7f501c13da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.223+0000 7f502333c700 1 --2- 172.21.15.133:0/361314381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f501c0ae1c0 0x7f501c143d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.223+0000 7f502333c700 1 --2- 172.21.15.133:0/361314381 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f501c0688b0 0x7f501c151ed0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.223+0000 7f502333c700 1 -- 172.21.15.133:0/361314381 >> 172.21.15.133:0/361314381 conn(0x7f501c0b4ba0 msgr2=0x7f501c0b4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:24.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.223+0000 7f502333c700 1 -- 172.21.15.133:0/361314381 shutdown_connections 2023-10-08T16:04:24.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.223+0000 7f502333c700 1 -- 172.21.15.133:0/361314381 wait complete. 2023-10-08T16:04:24.226 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-10-08T16:04:24.227 DEBUG:teuthology.parallel:result is None 2023-10-08T16:04:24.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.231+0000 7f4a4c99b700 1 -- 172.21.15.133:0/3205677318 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4a4806eb90 con 0x7f4a480ab750 2023-10-08T16:04:24.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.231+0000 7f4a377fe700 1 -- 172.21.15.133:0/3205677318 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4a400503b0 con 0x7f4a480ab750 2023-10-08T16:04:24.234 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2023-10-08T16:04:24.235 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2023-10-08T16:04:24.235 DEBUG:teuthology.parallel:result is None 2023-10-08T16:04:24.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2023-10-08T16:04:24.237 DEBUG:teuthology.parallel:result is None 2023-10-08T16:04:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.235+0000 7f4a4c99b700 1 -- 172.21.15.133:0/3205677318 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f4a2c0605a0 msgr2=0x7f4a2c062a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.235+0000 7f4a4c99b700 1 --2- 172.21.15.133:0/3205677318 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f4a2c0605a0 0x7f4a2c062a50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c007fd0 tx=0x7f4a3c009040 comp rx=0 tx=0).stop 2023-10-08T16:04:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.235+0000 7f4a4c99b700 1 -- 172.21.15.133:0/3205677318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a480ab750 msgr2=0x7f4a48142b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.235+0000 7f4a4c99b700 1 --2- 172.21.15.133:0/3205677318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a480ab750 0x7f4a48142b00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4a4000cd30 tx=0x7f4a40001af0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.235+0000 7f4a4c99b700 1 -- 172.21.15.133:0/3205677318 shutdown_connections 2023-10-08T16:04:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.235+0000 7f4a4c99b700 1 --2- 172.21.15.133:0/3205677318 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f4a2c0605a0 0x7f4a2c062a50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.235+0000 7f4a4c99b700 1 --2- 172.21.15.133:0/3205677318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a480b1dc0 0x7f4a481536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.235+0000 7f4a4c99b700 1 --2- 172.21.15.133:0/3205677318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a480ab750 0x7f4a48142b00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.235+0000 7f4a4c99b700 1 --2- 172.21.15.133:0/3205677318 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a4806e700 0x7f4a4813f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.235+0000 7f4a4c99b700 1 -- 172.21.15.133:0/3205677318 >> 172.21.15.133:0/3205677318 conn(0x7f4a480636b0 msgr2=0x7f4a480b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.235+0000 7f4a4c99b700 1 -- 172.21.15.133:0/3205677318 shutdown_connections 2023-10-08T16:04:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.235+0000 7f4a4c99b700 1 -- 172.21.15.133:0/3205677318 wait complete. 2023-10-08T16:04:24.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.239+0000 7ff4f4541700 1 -- 172.21.15.133:0/2255541065 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff4ec0b05d0 con 0x7ff4ec068d50 2023-10-08T16:04:24.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.239+0000 7ff4e27fc700 1 -- 172.21.15.133:0/2255541065 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff4e802a020 con 0x7ff4ec068d50 2023-10-08T16:04:24.242 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2023-10-08T16:04:24.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.239+0000 7ff4f4541700 1 -- 172.21.15.133:0/2255541065 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff4d0060550 msgr2=0x7ff4d0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.239+0000 7ff4f4541700 1 --2- 172.21.15.133:0/2255541065 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff4d0060550 0x7ff4d0062a00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0ae4f0 tx=0x7ff4e4009920 comp rx=0 tx=0).stop 2023-10-08T16:04:24.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.239+0000 7ff4f4541700 1 -- 172.21.15.133:0/2255541065 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4ec068d50 msgr2=0x7ff4ec0a5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.239+0000 7ff4f4541700 1 --2- 172.21.15.133:0/2255541065 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4ec068d50 0x7ff4ec0a5eb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0a9a90 tx=0x7ff4e8017000 comp rx=0 tx=0).stop 2023-10-08T16:04:24.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.239+0000 7ff4f4541700 1 -- 172.21.15.133:0/2255541065 shutdown_connections 2023-10-08T16:04:24.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.239+0000 7ff4f4541700 1 --2- 172.21.15.133:0/2255541065 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff4d0060550 0x7ff4d0062a00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.239+0000 7ff4f4541700 1 --2- 172.21.15.133:0/2255541065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4ec0b1120 0x7ff4ec0a7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.239+0000 7ff4f4541700 1 --2- 172.21.15.133:0/2255541065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4ec0aea40 0x7ff4ec0a6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.239+0000 7ff4f4541700 1 --2- 172.21.15.133:0/2255541065 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4ec068d50 0x7ff4ec0a5eb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.239+0000 7ff4f4541700 1 -- 172.21.15.133:0/2255541065 >> 172.21.15.133:0/2255541065 conn(0x7ff4ec0b4ba0 msgr2=0x7ff4ec0b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:24.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.239+0000 7ff4f4541700 1 -- 172.21.15.133:0/2255541065 shutdown_connections 2023-10-08T16:04:24.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.239+0000 7ff4f4541700 1 -- 172.21.15.133:0/2255541065 wait complete. 2023-10-08T16:04:24.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2023-10-08T16:04:24.250 DEBUG:teuthology.parallel:result is None 2023-10-08T16:04:24.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-10-08T16:04:24.254 DEBUG:teuthology.parallel:result is None 2023-10-08T16:04:24.254 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-08T16:04:24.254 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:04:24.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.343+0000 7fb9e91c8700 1 Processor -- start 2023-10-08T16:04:24.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.343+0000 7fb9e91c8700 1 -- start start 2023-10-08T16:04:24.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.343+0000 7fb9e91c8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb9e406a900 0x7fb9e41459c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:24.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.343+0000 7fb9e91c8700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb9e406eb40 0x7fb9e40b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:24.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.343+0000 7fb9e91c8700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e406e6b0 con 0x7fb9e413c090 2023-10-08T16:04:24.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.343+0000 7fb9e91c8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e40b2580 con 0x7fb9e406a900 2023-10-08T16:04:24.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.343+0000 7fb9e91c8700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e406e060 con 0x7fb9e406eb40 2023-10-08T16:04:24.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.343+0000 7fb9e3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb9e406a900 0x7fb9e41459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:24.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.343+0000 7fb9e3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb9e406a900 0x7fb9e41459c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43074/0 (socket says 172.21.15.133:43074) 2023-10-08T16:04:24.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.343+0000 7fb9e3fff700 1 -- 172.21.15.133:0/2411219634 learned_addr learned my addr 172.21.15.133:0/2411219634 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:24.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.343+0000 7fb9e37fe700 1 --2- 172.21.15.133:0/2411219634 >> v2:172.21.15.190:3300/0 conn(0x7fb9e406eb40 0x7fb9e40b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:24.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.343+0000 7fb9e3fff700 1 -- 172.21.15.133:0/2411219634 >> v2:172.21.15.190:3300/0 conn(0x7fb9e406eb40 msgr2=0x7fb9e40b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:24.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.343+0000 7fb9e3fff700 1 --2- 172.21.15.133:0/2411219634 >> v2:172.21.15.190:3300/0 conn(0x7fb9e406eb40 0x7fb9e40b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.343+0000 7fb9e3fff700 1 -- 172.21.15.133:0/2411219634 >> v1:172.21.15.190:6789/0 conn(0x7fb9e413c090 legacy=0x7fb9e413c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.343+0000 7fb9e3fff700 1 -- 172.21.15.133:0/2411219634 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e406e340 con 0x7fb9e406a900 2023-10-08T16:04:24.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.347+0000 7fb9e3fff700 1 --2- 172.21.15.133:0/2411219634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e406a900 0x7fb9e41459c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb9e406d980 tx=0x7fb9d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ec4d3761d42e48 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:24.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.347+0000 7fb9e2ffd700 1 -- 172.21.15.133:0/2411219634 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8009e70 con 0x7fb9e406a900 2023-10-08T16:04:24.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.347+0000 7fb9e2ffd700 1 -- 172.21.15.133:0/2411219634 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d800b860 con 0x7fb9e406a900 2023-10-08T16:04:24.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.347+0000 7fb9e2ffd700 1 -- 172.21.15.133:0/2411219634 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d800bc00 con 0x7fb9e406a900 2023-10-08T16:04:24.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.347+0000 7fb9e91c8700 1 -- 172.21.15.133:0/2411219634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e406a900 msgr2=0x7fb9e41459c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.347+0000 7fb9e91c8700 1 --2- 172.21.15.133:0/2411219634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e406a900 0x7fb9e41459c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb9e406d980 tx=0x7fb9d8009250 comp rx=0 tx=0).stop 2023-10-08T16:04:24.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.347+0000 7fb9e91c8700 1 -- 172.21.15.133:0/2411219634 shutdown_connections 2023-10-08T16:04:24.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.347+0000 7fb9e91c8700 1 --2- 172.21.15.133:0/2411219634 >> v2:172.21.15.190:3300/0 conn(0x7fb9e406eb40 0x7fb9e40b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.347+0000 7fb9e91c8700 1 --2- 172.21.15.133:0/2411219634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e406a900 0x7fb9e41459c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.347+0000 7fb9e91c8700 1 -- 172.21.15.133:0/2411219634 >> 172.21.15.133:0/2411219634 conn(0x7fb9e4063640 msgr2=0x7fb9e4069fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:24.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.347+0000 7fb9e91c8700 1 -- 172.21.15.133:0/2411219634 shutdown_connections 2023-10-08T16:04:24.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.347+0000 7fb9e91c8700 1 -- 172.21.15.133:0/2411219634 wait complete. 2023-10-08T16:04:24.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.347+0000 7fb9e91c8700 1 Processor -- start 2023-10-08T16:04:24.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.347+0000 7fb9e91c8700 1 -- start start 2023-10-08T16:04:24.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.347+0000 7fb9e91c8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e406a900 0x7fb9e413d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:24.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.347+0000 7fb9e91c8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9e406eb40 0x7fb9e4155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:24.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.347+0000 7fb9e91c8700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9e413c090 0x7fb9e4155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:24.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.347+0000 7fb9e91c8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e413ddb0 con 0x7fb9e406a900 2023-10-08T16:04:24.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.347+0000 7fb9e91c8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e413fbf0 con 0x7fb9e406eb40 2023-10-08T16:04:24.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.347+0000 7fb9e91c8700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e413fe20 con 0x7fb9e413c090 2023-10-08T16:04:24.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.347+0000 7fb9e3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e406a900 0x7fb9e413d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:24.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.347+0000 7fb9e3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e406a900 0x7fb9e413d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43076/0 (socket says 172.21.15.133:43076) 2023-10-08T16:04:24.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.351+0000 7fb9e3fff700 1 -- 172.21.15.133:0/1880136701 learned_addr learned my addr 172.21.15.133:0/1880136701 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:24.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.351+0000 7fb9e37fe700 1 --2- 172.21.15.133:0/1880136701 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9e406eb40 0x7fb9e4155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:24.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.351+0000 7fb9e89c7700 1 --2- 172.21.15.133:0/1880136701 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9e413c090 0x7fb9e4155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:24.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.351+0000 7fb9e3fff700 1 -- 172.21.15.133:0/1880136701 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9e413c090 msgr2=0x7fb9e4155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.351+0000 7fb9e3fff700 1 --2- 172.21.15.133:0/1880136701 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9e413c090 0x7fb9e4155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.351+0000 7fb9e3fff700 1 -- 172.21.15.133:0/1880136701 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9e406eb40 msgr2=0x7fb9e4155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.351+0000 7fb9e3fff700 1 --2- 172.21.15.133:0/1880136701 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9e406eb40 0x7fb9e4155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.351+0000 7fb9e3fff700 1 -- 172.21.15.133:0/1880136701 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d80094f0 con 0x7fb9e406a900 2023-10-08T16:04:24.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.351+0000 7fb9e3fff700 1 --2- 172.21.15.133:0/1880136701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e406a900 0x7fb9e413d870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8006fd0 tx=0x7fb9d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:24.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.351+0000 7fb9cbfff700 1 -- 172.21.15.133:0/1880136701 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d800bbe0 con 0x7fb9e406a900 2023-10-08T16:04:24.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.351+0000 7fb9cbfff700 1 -- 172.21.15.133:0/1880136701 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d8011420 con 0x7fb9e406a900 2023-10-08T16:04:24.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.351+0000 7fb9e91c8700 1 -- 172.21.15.133:0/1880136701 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e413e5e0 con 0x7fb9e406a900 2023-10-08T16:04:24.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.351+0000 7fb9cbfff700 1 -- 172.21.15.133:0/1880136701 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d80117c0 con 0x7fb9e406a900 2023-10-08T16:04:24.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.351+0000 7fb9e91c8700 1 -- 172.21.15.133:0/1880136701 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e413f760 con 0x7fb9e406a900 2023-10-08T16:04:24.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.351+0000 7fb9e91c8700 1 -- 172.21.15.133:0/1880136701 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e404be40 con 0x7fb9e406a900 2023-10-08T16:04:24.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.355+0000 7fb9cbfff700 1 -- 172.21.15.133:0/1880136701 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb9d8011bb0 con 0x7fb9e406a900 2023-10-08T16:04:24.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.355+0000 7fb9cbfff700 1 --2- 172.21.15.133:0/1880136701 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb9d0060600 0x7fb9d0062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:24.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.355+0000 7fb9cbfff700 1 -- 172.21.15.133:0/1880136701 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb9d807d5b0 con 0x7fb9e406a900 2023-10-08T16:04:24.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.355+0000 7fb9e37fe700 1 --2- 172.21.15.133:0/1880136701 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb9d0060600 0x7fb9d0062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:24.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.355+0000 7fb9e37fe700 1 --2- 172.21.15.133:0/1880136701 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb9d0060600 0x7fb9d0062ab0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4145b60 tx=0x7fb9d400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:24.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.359+0000 7fb9cbfff700 1 -- 172.21.15.133:0/1880136701 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb9d804db80 con 0x7fb9e406a900 2023-10-08T16:04:24.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.507+0000 7fb9e91c8700 1 -- 172.21.15.133:0/1880136701 --> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb9e413baa0 con 0x7fb9d0060600 2023-10-08T16:04:24.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.523+0000 7fb9cbfff700 1 -- 172.21.15.133:0/1880136701 <== mgr.4104 v2:172.21.15.133:6832/33362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264481 (secure 0 0 0) 0x7fb9e413baa0 con 0x7fb9d0060600 2023-10-08T16:04:24.529 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:04:24.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.527+0000 7fb9e91c8700 1 -- 172.21.15.133:0/1880136701 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb9d0060600 msgr2=0x7fb9d0062ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.527+0000 7fb9e91c8700 1 --2- 172.21.15.133:0/1880136701 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb9d0060600 0x7fb9d0062ab0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4145b60 tx=0x7fb9d400b040 comp rx=0 tx=0).stop 2023-10-08T16:04:24.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.527+0000 7fb9e91c8700 1 -- 172.21.15.133:0/1880136701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e406a900 msgr2=0x7fb9e413d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.527+0000 7fb9e91c8700 1 --2- 172.21.15.133:0/1880136701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e406a900 0x7fb9e413d870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8006fd0 tx=0x7fb9d8017000 comp rx=0 tx=0).stop 2023-10-08T16:04:24.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.527+0000 7fb9e91c8700 1 -- 172.21.15.133:0/1880136701 shutdown_connections 2023-10-08T16:04:24.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.527+0000 7fb9e91c8700 1 --2- 172.21.15.133:0/1880136701 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb9d0060600 0x7fb9d0062ab0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.527+0000 7fb9e91c8700 1 --2- 172.21.15.133:0/1880136701 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9e413c090 0x7fb9e4155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.527+0000 7fb9e91c8700 1 --2- 172.21.15.133:0/1880136701 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9e406eb40 0x7fb9e4155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.527+0000 7fb9e91c8700 1 --2- 172.21.15.133:0/1880136701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e406a900 0x7fb9e413d870 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.527+0000 7fb9e91c8700 1 -- 172.21.15.133:0/1880136701 >> 172.21.15.133:0/1880136701 conn(0x7fb9e4063640 msgr2=0x7fb9e40b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:24.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.527+0000 7fb9e91c8700 1 -- 172.21.15.133:0/1880136701 shutdown_connections 2023-10-08T16:04:24.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.527+0000 7fb9e91c8700 1 -- 172.21.15.133:0/1880136701 wait complete. 2023-10-08T16:04:24.533 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-10-08T16:04:24.544 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T16:04:22.839320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381124,"kb_used_data":2820,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593596,"statfs":{"total":773094113280,"available":770655842304,"internally_reserved":0,"allocated":2887680,"data_stored":1749669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.204100"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.632077+0000","last_change":"2023-10-08T16:04:17.626888+0000","last_active":"2023-10-08T16:04:17.632077+0000","last_peered":"2023-10-08T16:04:17.632077+0000","last_clean":"2023-10-08T16:04:17.632077+0000","last_became_active":"2023-10-08T16:04:17.626468+0000","last_became_peered":"2023-10-08T16:04:17.626468+0000","last_unstale":"2023-10-08T16:04:17.632077+0000","last_undegraded":"2023-10-08T16:04:17.632077+0000","last_fullsized":"2023-10-08T16:04:17.632077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:37.040973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.627185+0000","last_change":"2023-10-08T16:04:17.624301+0000","last_active":"2023-10-08T16:04:17.627185+0000","last_peered":"2023-10-08T16:04:17.627185+0000","last_clean":"2023-10-08T16:04:17.627185+0000","last_became_active":"2023-10-08T16:04:17.623968+0000","last_became_peered":"2023-10-08T16:04:17.623968+0000","last_unstale":"2023-10-08T16:04:17.627185+0000","last_undegraded":"2023-10-08T16:04:17.627185+0000","last_fullsized":"2023-10-08T16:04:17.627185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635485+0000","last_change":"2023-10-08T16:04:17.624529+0000","last_active":"2023-10-08T16:04:17.635485+0000","last_peered":"2023-10-08T16:04:17.635485+0000","last_clean":"2023-10-08T16:04:17.635485+0000","last_became_active":"2023-10-08T16:04:17.624219+0000","last_became_peered":"2023-10-08T16:04:17.624219+0000","last_unstale":"2023-10-08T16:04:17.635485+0000","last_undegraded":"2023-10-08T16:04:17.635485+0000","last_fullsized":"2023-10-08T16:04:17.635485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:07.785877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.636047+0000","last_change":"2023-10-08T16:04:17.628602+0000","last_active":"2023-10-08T16:04:17.636047+0000","last_peered":"2023-10-08T16:04:17.636047+0000","last_clean":"2023-10-08T16:04:17.636047+0000","last_became_active":"2023-10-08T16:04:17.628308+0000","last_became_peered":"2023-10-08T16:04:17.628308+0000","last_unstale":"2023-10-08T16:04:17.636047+0000","last_undegraded":"2023-10-08T16:04:17.636047+0000","last_fullsized":"2023-10-08T16:04:17.636047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:48.519448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.628109+0000","last_change":"2023-10-08T16:04:17.626035+0000","last_active":"2023-10-08T16:04:17.628109+0000","last_peered":"2023-10-08T16:04:17.628109+0000","last_clean":"2023-10-08T16:04:17.628109+0000","last_became_active":"2023-10-08T16:04:17.625650+0000","last_became_peered":"2023-10-08T16:04:17.625650+0000","last_unstale":"2023-10-08T16:04:17.628109+0000","last_undegraded":"2023-10-08T16:04:17.628109+0000","last_fullsized":"2023-10-08T16:04:17.628109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:42.972904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.632991+0000","last_change":"2023-10-08T16:04:17.619829+0000","last_active":"2023-10-08T16:04:17.632991+0000","last_peered":"2023-10-08T16:04:17.632991+0000","last_clean":"2023-10-08T16:04:17.632991+0000","last_became_active":"2023-10-08T16:04:17.619494+0000","last_became_peered":"2023-10-08T16:04:17.619494+0000","last_unstale":"2023-10-08T16:04:17.632991+0000","last_undegraded":"2023-10-08T16:04:17.632991+0000","last_fullsized":"2023-10-08T16:04:17.632991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:02:45.593266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635803+0000","last_change":"2023-10-08T16:04:17.632040+0000","last_active":"2023-10-08T16:04:17.635803+0000","last_peered":"2023-10-08T16:04:17.635803+0000","last_clean":"2023-10-08T16:04:17.635803+0000","last_became_active":"2023-10-08T16:04:17.631722+0000","last_became_peered":"2023-10-08T16:04:17.631722+0000","last_unstale":"2023-10-08T16:04:17.635803+0000","last_undegraded":"2023-10-08T16:04:17.635803+0000","last_fullsized":"2023-10-08T16:04:17.635803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:52.670934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.634619+0000","last_change":"2023-10-08T16:04:17.629400+0000","last_active":"2023-10-08T16:04:17.634619+0000","last_peered":"2023-10-08T16:04:17.634619+0000","last_clean":"2023-10-08T16:04:17.634619+0000","last_became_active":"2023-10-08T16:04:17.628987+0000","last_became_peered":"2023-10-08T16:04:17.628987+0000","last_unstale":"2023-10-08T16:04:17.634619+0000","last_undegraded":"2023-10-08T16:04:17.634619+0000","last_fullsized":"2023-10-08T16:04:17.634619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:26.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.638924+0000","last_change":"2023-10-08T16:04:17.636654+0000","last_active":"2023-10-08T16:04:17.638924+0000","last_peered":"2023-10-08T16:04:17.638924+0000","last_clean":"2023-10-08T16:04:17.638924+0000","last_became_active":"2023-10-08T16:04:17.636350+0000","last_became_peered":"2023-10-08T16:04:17.636350+0000","last_unstale":"2023-10-08T16:04:17.638924+0000","last_undegraded":"2023-10-08T16:04:17.638924+0000","last_fullsized":"2023-10-08T16:04:17.638924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:38:37.066127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633210+0000","last_change":"2023-10-08T16:04:17.627620+0000","last_active":"2023-10-08T16:04:17.633210+0000","last_peered":"2023-10-08T16:04:17.633210+0000","last_clean":"2023-10-08T16:04:17.633210+0000","last_became_active":"2023-10-08T16:04:17.627074+0000","last_became_peered":"2023-10-08T16:04:17.627074+0000","last_unstale":"2023-10-08T16:04:17.633210+0000","last_undegraded":"2023-10-08T16:04:17.633210+0000","last_fullsized":"2023-10-08T16:04:17.633210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:15.965581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633228+0000","last_change":"2023-10-08T16:04:17.628765+0000","last_active":"2023-10-08T16:04:17.633228+0000","last_peered":"2023-10-08T16:04:17.633228+0000","last_clean":"2023-10-08T16:04:17.633228+0000","last_became_active":"2023-10-08T16:04:17.627965+0000","last_became_peered":"2023-10-08T16:04:17.627965+0000","last_unstale":"2023-10-08T16:04:17.633228+0000","last_undegraded":"2023-10-08T16:04:17.633228+0000","last_fullsized":"2023-10-08T16:04:17.633228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.628520+0000","last_change":"2023-10-08T16:04:17.617433+0000","last_active":"2023-10-08T16:04:17.628520+0000","last_peered":"2023-10-08T16:04:17.628520+0000","last_clean":"2023-10-08T16:04:17.628520+0000","last_became_active":"2023-10-08T16:04:17.616988+0000","last_became_peered":"2023-10-08T16:04:17.616988+0000","last_unstale":"2023-10-08T16:04:17.628520+0000","last_undegraded":"2023-10-08T16:04:17.628520+0000","last_fullsized":"2023-10-08T16:04:17.628520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:49.607853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.630551+0000","last_change":"2023-10-08T16:04:17.625824+0000","last_active":"2023-10-08T16:04:17.630551+0000","last_peered":"2023-10-08T16:04:17.630551+0000","last_clean":"2023-10-08T16:04:17.630551+0000","last_became_active":"2023-10-08T16:04:17.625529+0000","last_became_peered":"2023-10-08T16:04:17.625529+0000","last_unstale":"2023-10-08T16:04:17.630551+0000","last_undegraded":"2023-10-08T16:04:17.630551+0000","last_fullsized":"2023-10-08T16:04:17.630551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:07.051965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635548+0000","last_change":"2023-10-08T16:04:17.624728+0000","last_active":"2023-10-08T16:04:17.635548+0000","last_peered":"2023-10-08T16:04:17.635548+0000","last_clean":"2023-10-08T16:04:17.635548+0000","last_became_active":"2023-10-08T16:04:17.624197+0000","last_became_peered":"2023-10-08T16:04:17.624197+0000","last_unstale":"2023-10-08T16:04:17.635548+0000","last_undegraded":"2023-10-08T16:04:17.635548+0000","last_fullsized":"2023-10-08T16:04:17.635548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:08.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.625903+0000","last_change":"2023-10-08T16:04:17.621076+0000","last_active":"2023-10-08T16:04:17.625903+0000","last_peered":"2023-10-08T16:04:17.625903+0000","last_clean":"2023-10-08T16:04:17.625903+0000","last_became_active":"2023-10-08T16:04:17.620391+0000","last_became_peered":"2023-10-08T16:04:17.620391+0000","last_unstale":"2023-10-08T16:04:17.625903+0000","last_undegraded":"2023-10-08T16:04:17.625903+0000","last_fullsized":"2023-10-08T16:04:17.625903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:08.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633034+0000","last_change":"2023-10-08T16:04:17.620158+0000","last_active":"2023-10-08T16:04:17.633034+0000","last_peered":"2023-10-08T16:04:17.633034+0000","last_clean":"2023-10-08T16:04:17.633034+0000","last_became_active":"2023-10-08T16:04:17.619843+0000","last_became_peered":"2023-10-08T16:04:17.619843+0000","last_unstale":"2023-10-08T16:04:17.633034+0000","last_undegraded":"2023-10-08T16:04:17.633034+0000","last_fullsized":"2023-10-08T16:04:17.633034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.599406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633425+0000","last_change":"2023-10-08T16:04:17.625859+0000","last_active":"2023-10-08T16:04:17.633425+0000","last_peered":"2023-10-08T16:04:17.633425+0000","last_clean":"2023-10-08T16:04:17.633425+0000","last_became_active":"2023-10-08T16:04:17.625580+0000","last_became_peered":"2023-10-08T16:04:17.625580+0000","last_unstale":"2023-10-08T16:04:17.633425+0000","last_undegraded":"2023-10-08T16:04:17.633425+0000","last_fullsized":"2023-10-08T16:04:17.633425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:46.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635366+0000","last_change":"2023-10-08T16:04:17.627483+0000","last_active":"2023-10-08T16:04:17.635366+0000","last_peered":"2023-10-08T16:04:17.635366+0000","last_clean":"2023-10-08T16:04:17.635366+0000","last_became_active":"2023-10-08T16:04:17.627197+0000","last_became_peered":"2023-10-08T16:04:17.627197+0000","last_unstale":"2023-10-08T16:04:17.635366+0000","last_undegraded":"2023-10-08T16:04:17.635366+0000","last_fullsized":"2023-10-08T16:04:17.635366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:09.387194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.628134+0000","last_change":"2023-10-08T16:04:17.625900+0000","last_active":"2023-10-08T16:04:17.628134+0000","last_peered":"2023-10-08T16:04:17.628134+0000","last_clean":"2023-10-08T16:04:17.628134+0000","last_became_active":"2023-10-08T16:04:17.625586+0000","last_became_peered":"2023-10-08T16:04:17.625586+0000","last_unstale":"2023-10-08T16:04:17.628134+0000","last_undegraded":"2023-10-08T16:04:17.628134+0000","last_fullsized":"2023-10-08T16:04:17.628134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.599406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.628567+0000","last_change":"2023-10-08T16:04:17.623493+0000","last_active":"2023-10-08T16:04:17.628567+0000","last_peered":"2023-10-08T16:04:17.628567+0000","last_clean":"2023-10-08T16:04:17.628567+0000","last_became_active":"2023-10-08T16:04:17.623200+0000","last_became_peered":"2023-10-08T16:04:17.623200+0000","last_unstale":"2023-10-08T16:04:17.628567+0000","last_undegraded":"2023-10-08T16:04:17.628567+0000","last_fullsized":"2023-10-08T16:04:17.628567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:36.869466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635670+0000","last_change":"2023-10-08T16:04:17.625908+0000","last_active":"2023-10-08T16:04:17.635670+0000","last_peered":"2023-10-08T16:04:17.635670+0000","last_clean":"2023-10-08T16:04:17.635670+0000","last_became_active":"2023-10-08T16:04:17.623945+0000","last_became_peered":"2023-10-08T16:04:17.623945+0000","last_unstale":"2023-10-08T16:04:17.635670+0000","last_undegraded":"2023-10-08T16:04:17.635670+0000","last_fullsized":"2023-10-08T16:04:17.635670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:15.965581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633364+0000","last_change":"2023-10-08T16:04:17.624219+0000","last_active":"2023-10-08T16:04:17.633364+0000","last_peered":"2023-10-08T16:04:17.633364+0000","last_clean":"2023-10-08T16:04:17.633364+0000","last_became_active":"2023-10-08T16:04:17.623904+0000","last_became_peered":"2023-10-08T16:04:17.623904+0000","last_unstale":"2023-10-08T16:04:17.633364+0000","last_undegraded":"2023-10-08T16:04:17.633364+0000","last_fullsized":"2023-10-08T16:04:17.633364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:52.670934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.629217+0000","last_change":"2023-10-08T16:04:17.618857+0000","last_active":"2023-10-08T16:04:17.629217+0000","last_peered":"2023-10-08T16:04:17.629217+0000","last_clean":"2023-10-08T16:04:17.629217+0000","last_became_active":"2023-10-08T16:04:17.618549+0000","last_became_peered":"2023-10-08T16:04:17.618549+0000","last_unstale":"2023-10-08T16:04:17.629217+0000","last_undegraded":"2023-10-08T16:04:17.629217+0000","last_fullsized":"2023-10-08T16:04:17.629217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635992+0000","last_change":"2023-10-08T16:04:17.627955+0000","last_active":"2023-10-08T16:04:17.635992+0000","last_peered":"2023-10-08T16:04:17.635992+0000","last_clean":"2023-10-08T16:04:17.635992+0000","last_became_active":"2023-10-08T16:04:17.627673+0000","last_became_peered":"2023-10-08T16:04:17.627673+0000","last_unstale":"2023-10-08T16:04:17.635992+0000","last_undegraded":"2023-10-08T16:04:17.635992+0000","last_fullsized":"2023-10-08T16:04:17.635992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:26.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.634578+0000","last_change":"2023-10-08T16:04:17.629101+0000","last_active":"2023-10-08T16:04:17.634578+0000","last_peered":"2023-10-08T16:04:17.634578+0000","last_clean":"2023-10-08T16:04:17.634578+0000","last_became_active":"2023-10-08T16:04:17.628793+0000","last_became_peered":"2023-10-08T16:04:17.628793+0000","last_unstale":"2023-10-08T16:04:17.634578+0000","last_undegraded":"2023-10-08T16:04:17.634578+0000","last_fullsized":"2023-10-08T16:04:17.634578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:15.965581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633189+0000","last_change":"2023-10-08T16:04:17.625790+0000","last_active":"2023-10-08T16:04:17.633189+0000","last_peered":"2023-10-08T16:04:17.633189+0000","last_clean":"2023-10-08T16:04:17.633189+0000","last_became_active":"2023-10-08T16:04:17.625220+0000","last_became_peered":"2023-10-08T16:04:17.625220+0000","last_unstale":"2023-10-08T16:04:17.633189+0000","last_undegraded":"2023-10-08T16:04:17.633189+0000","last_fullsized":"2023-10-08T16:04:17.633189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:08.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.634632+0000","last_change":"2023-10-08T16:04:17.629988+0000","last_active":"2023-10-08T16:04:17.634632+0000","last_peered":"2023-10-08T16:04:17.634632+0000","last_clean":"2023-10-08T16:04:17.634632+0000","last_became_active":"2023-10-08T16:04:17.629574+0000","last_became_peered":"2023-10-08T16:04:17.629574+0000","last_unstale":"2023-10-08T16:04:17.634632+0000","last_undegraded":"2023-10-08T16:04:17.634632+0000","last_fullsized":"2023-10-08T16:04:17.634632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:26.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.631112+0000","last_change":"2023-10-08T16:04:17.626698+0000","last_active":"2023-10-08T16:04:17.631112+0000","last_peered":"2023-10-08T16:04:17.631112+0000","last_clean":"2023-10-08T16:04:17.631112+0000","last_became_active":"2023-10-08T16:04:17.626420+0000","last_became_peered":"2023-10-08T16:04:17.626420+0000","last_unstale":"2023-10-08T16:04:17.631112+0000","last_undegraded":"2023-10-08T16:04:17.631112+0000","last_fullsized":"2023-10-08T16:04:17.631112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.625706+0000","last_change":"2023-10-08T16:04:17.618551+0000","last_active":"2023-10-08T16:04:17.625706+0000","last_peered":"2023-10-08T16:04:17.625706+0000","last_clean":"2023-10-08T16:04:17.625706+0000","last_became_active":"2023-10-08T16:04:17.618207+0000","last_became_peered":"2023-10-08T16:04:17.618207+0000","last_unstale":"2023-10-08T16:04:17.625706+0000","last_undegraded":"2023-10-08T16:04:17.625706+0000","last_fullsized":"2023-10-08T16:04:17.625706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:16:31.009207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.636007+0000","last_change":"2023-10-08T16:04:17.627381+0000","last_active":"2023-10-08T16:04:17.636007+0000","last_peered":"2023-10-08T16:04:17.636007+0000","last_clean":"2023-10-08T16:04:17.636007+0000","last_became_active":"2023-10-08T16:04:17.627093+0000","last_became_peered":"2023-10-08T16:04:17.627093+0000","last_unstale":"2023-10-08T16:04:17.636007+0000","last_undegraded":"2023-10-08T16:04:17.636007+0000","last_fullsized":"2023-10-08T16:04:17.636007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:45.664795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635627+0000","last_change":"2023-10-08T16:04:17.629351+0000","last_active":"2023-10-08T16:04:17.635627+0000","last_peered":"2023-10-08T16:04:17.635627+0000","last_clean":"2023-10-08T16:04:17.635627+0000","last_became_active":"2023-10-08T16:04:17.629049+0000","last_became_peered":"2023-10-08T16:04:17.629049+0000","last_unstale":"2023-10-08T16:04:17.635627+0000","last_undegraded":"2023-10-08T16:04:17.635627+0000","last_fullsized":"2023-10-08T16:04:17.635627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:07.785877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635822+0000","last_change":"2023-10-08T16:04:17.632342+0000","last_active":"2023-10-08T16:04:17.635822+0000","last_peered":"2023-10-08T16:04:17.635822+0000","last_clean":"2023-10-08T16:04:17.635822+0000","last_became_active":"2023-10-08T16:04:17.632012+0000","last_became_peered":"2023-10-08T16:04:17.632012+0000","last_unstale":"2023-10-08T16:04:17.635822+0000","last_undegraded":"2023-10-08T16:04:17.635822+0000","last_fullsized":"2023-10-08T16:04:17.635822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633065+0000","last_change":"2023-10-08T16:04:17.623570+0000","last_active":"2023-10-08T16:04:17.633065+0000","last_peered":"2023-10-08T16:04:17.633065+0000","last_clean":"2023-10-08T16:04:17.633065+0000","last_became_active":"2023-10-08T16:04:17.623220+0000","last_became_peered":"2023-10-08T16:04:17.623220+0000","last_unstale":"2023-10-08T16:04:17.633065+0000","last_undegraded":"2023-10-08T16:04:17.633065+0000","last_fullsized":"2023-10-08T16:04:17.633065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:07.785877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.654725+0000","last_change":"2023-10-08T16:04:16.660492+0000","last_active":"2023-10-08T16:04:17.654725+0000","last_peered":"2023-10-08T16:04:17.654725+0000","last_clean":"2023-10-08T16:04:17.654725+0000","last_became_active":"2023-10-08T16:04:16.660183+0000","last_became_peered":"2023-10-08T16:04:16.660183+0000","last_unstale":"2023-10-08T16:04:17.654725+0000","last_undegraded":"2023-10-08T16:04:17.654725+0000","last_fullsized":"2023-10-08T16:04:17.654725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:08.532886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.632702+0000","last_change":"2023-10-08T16:04:17.621094+0000","last_active":"2023-10-08T16:04:17.632702+0000","last_peered":"2023-10-08T16:04:17.632702+0000","last_clean":"2023-10-08T16:04:17.632702+0000","last_became_active":"2023-10-08T16:04:17.620532+0000","last_became_peered":"2023-10-08T16:04:17.620532+0000","last_unstale":"2023-10-08T16:04:17.632702+0000","last_undegraded":"2023-10-08T16:04:17.632702+0000","last_fullsized":"2023-10-08T16:04:17.632702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:48:25.093009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.652629+0000","last_change":"2023-10-08T16:04:16.654209+0000","last_active":"2023-10-08T16:04:17.652629+0000","last_peered":"2023-10-08T16:04:17.652629+0000","last_clean":"2023-10-08T16:04:17.652629+0000","last_became_active":"2023-10-08T16:04:16.653936+0000","last_became_peered":"2023-10-08T16:04:16.653936+0000","last_unstale":"2023-10-08T16:04:17.652629+0000","last_undegraded":"2023-10-08T16:04:17.652629+0000","last_fullsized":"2023-10-08T16:04:17.652629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:39:19.429906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.617151+0000","last_change":"2023-10-08T16:04:16.656953+0000","last_active":"2023-10-08T16:04:17.617151+0000","last_peered":"2023-10-08T16:04:17.617151+0000","last_clean":"2023-10-08T16:04:17.617151+0000","last_became_active":"2023-10-08T16:04:16.656642+0000","last_became_peered":"2023-10-08T16:04:16.656642+0000","last_unstale":"2023-10-08T16:04:17.617151+0000","last_undegraded":"2023-10-08T16:04:17.617151+0000","last_fullsized":"2023-10-08T16:04:17.617151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:04.157234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.631064+0000","last_change":"2023-10-08T16:04:17.625387+0000","last_active":"2023-10-08T16:04:17.631064+0000","last_peered":"2023-10-08T16:04:17.631064+0000","last_clean":"2023-10-08T16:04:17.631064+0000","last_became_active":"2023-10-08T16:04:17.625086+0000","last_became_peered":"2023-10-08T16:04:17.625086+0000","last_unstale":"2023-10-08T16:04:17.631064+0000","last_undegraded":"2023-10-08T16:04:17.631064+0000","last_fullsized":"2023-10-08T16:04:17.631064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:08.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.610846+0000","last_change":"2023-10-08T16:04:16.651645+0000","last_active":"2023-10-08T16:04:17.610846+0000","last_peered":"2023-10-08T16:04:17.610846+0000","last_clean":"2023-10-08T16:04:17.610846+0000","last_became_active":"2023-10-08T16:04:16.651258+0000","last_became_peered":"2023-10-08T16:04:16.651258+0000","last_unstale":"2023-10-08T16:04:17.610846+0000","last_undegraded":"2023-10-08T16:04:17.610846+0000","last_fullsized":"2023-10-08T16:04:17.610846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:48.596542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.634676+0000","last_change":"2023-10-08T16:04:17.630066+0000","last_active":"2023-10-08T16:04:17.634676+0000","last_peered":"2023-10-08T16:04:17.634676+0000","last_clean":"2023-10-08T16:04:17.634676+0000","last_became_active":"2023-10-08T16:04:17.629765+0000","last_became_peered":"2023-10-08T16:04:17.629765+0000","last_unstale":"2023-10-08T16:04:17.634676+0000","last_undegraded":"2023-10-08T16:04:17.634676+0000","last_fullsized":"2023-10-08T16:04:17.634676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.617478+0000","last_change":"2023-10-08T16:04:16.655712+0000","last_active":"2023-10-08T16:04:17.617478+0000","last_peered":"2023-10-08T16:04:17.617478+0000","last_clean":"2023-10-08T16:04:17.617478+0000","last_became_active":"2023-10-08T16:04:16.654002+0000","last_became_peered":"2023-10-08T16:04:16.654002+0000","last_unstale":"2023-10-08T16:04:17.617478+0000","last_undegraded":"2023-10-08T16:04:17.617478+0000","last_fullsized":"2023-10-08T16:04:17.617478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633381+0000","last_change":"2023-10-08T16:04:17.624387+0000","last_active":"2023-10-08T16:04:17.633381+0000","last_peered":"2023-10-08T16:04:17.633381+0000","last_clean":"2023-10-08T16:04:17.633381+0000","last_became_active":"2023-10-08T16:04:17.624071+0000","last_became_peered":"2023-10-08T16:04:17.624071+0000","last_unstale":"2023-10-08T16:04:17.633381+0000","last_undegraded":"2023-10-08T16:04:17.633381+0000","last_fullsized":"2023-10-08T16:04:17.633381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:42.972904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.612317+0000","last_change":"2023-10-08T16:04:16.657245+0000","last_active":"2023-10-08T16:04:17.612317+0000","last_peered":"2023-10-08T16:04:17.612317+0000","last_clean":"2023-10-08T16:04:17.612317+0000","last_became_active":"2023-10-08T16:04:16.656992+0000","last_became_peered":"2023-10-08T16:04:16.656992+0000","last_unstale":"2023-10-08T16:04:17.612317+0000","last_undegraded":"2023-10-08T16:04:17.612317+0000","last_fullsized":"2023-10-08T16:04:17.612317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.632890+0000","last_change":"2023-10-08T16:04:17.622197+0000","last_active":"2023-10-08T16:04:17.632890+0000","last_peered":"2023-10-08T16:04:17.632890+0000","last_clean":"2023-10-08T16:04:17.632890+0000","last_became_active":"2023-10-08T16:04:17.621862+0000","last_became_peered":"2023-10-08T16:04:17.621862+0000","last_unstale":"2023-10-08T16:04:17.632890+0000","last_undegraded":"2023-10-08T16:04:17.632890+0000","last_fullsized":"2023-10-08T16:04:17.632890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:36.869466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.662519+0000","last_change":"2023-10-08T16:04:16.656378+0000","last_active":"2023-10-08T16:04:17.662519+0000","last_peered":"2023-10-08T16:04:17.662519+0000","last_clean":"2023-10-08T16:04:17.662519+0000","last_became_active":"2023-10-08T16:04:16.656041+0000","last_became_peered":"2023-10-08T16:04:16.656041+0000","last_unstale":"2023-10-08T16:04:17.662519+0000","last_undegraded":"2023-10-08T16:04:17.662519+0000","last_fullsized":"2023-10-08T16:04:17.662519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:08.375883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.628540+0000","last_change":"2023-10-08T16:04:17.621021+0000","last_active":"2023-10-08T16:04:17.628540+0000","last_peered":"2023-10-08T16:04:17.628540+0000","last_clean":"2023-10-08T16:04:17.628540+0000","last_became_active":"2023-10-08T16:04:17.620654+0000","last_became_peered":"2023-10-08T16:04:17.620654+0000","last_unstale":"2023-10-08T16:04:17.628540+0000","last_undegraded":"2023-10-08T16:04:17.628540+0000","last_fullsized":"2023-10-08T16:04:17.628540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:09.387194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.661504+0000","last_change":"2023-10-08T16:04:16.653310+0000","last_active":"2023-10-08T16:04:17.661504+0000","last_peered":"2023-10-08T16:04:17.661504+0000","last_clean":"2023-10-08T16:04:17.661504+0000","last_became_active":"2023-10-08T16:04:16.653001+0000","last_became_peered":"2023-10-08T16:04:16.653001+0000","last_unstale":"2023-10-08T16:04:17.661504+0000","last_undegraded":"2023-10-08T16:04:17.661504+0000","last_fullsized":"2023-10-08T16:04:17.661504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:48.596542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633485+0000","last_change":"2023-10-08T16:04:17.631423+0000","last_active":"2023-10-08T16:04:17.633485+0000","last_peered":"2023-10-08T16:04:17.633485+0000","last_clean":"2023-10-08T16:04:17.633485+0000","last_became_active":"2023-10-08T16:04:17.631130+0000","last_became_peered":"2023-10-08T16:04:17.631130+0000","last_unstale":"2023-10-08T16:04:17.633485+0000","last_undegraded":"2023-10-08T16:04:17.633485+0000","last_fullsized":"2023-10-08T16:04:17.633485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:35.211718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.657652+0000","last_change":"2023-10-08T16:04:16.661085+0000","last_active":"2023-10-08T16:04:17.657652+0000","last_peered":"2023-10-08T16:04:17.657652+0000","last_clean":"2023-10-08T16:04:17.657652+0000","last_became_active":"2023-10-08T16:04:16.660830+0000","last_became_peered":"2023-10-08T16:04:16.660830+0000","last_unstale":"2023-10-08T16:04:17.657652+0000","last_undegraded":"2023-10-08T16:04:17.657652+0000","last_fullsized":"2023-10-08T16:04:17.657652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:18.465207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635520+0000","last_change":"2023-10-08T16:04:17.623375+0000","last_active":"2023-10-08T16:04:17.635520+0000","last_peered":"2023-10-08T16:04:17.635520+0000","last_clean":"2023-10-08T16:04:17.635520+0000","last_became_active":"2023-10-08T16:04:17.623038+0000","last_became_peered":"2023-10-08T16:04:17.623038+0000","last_unstale":"2023-10-08T16:04:17.635520+0000","last_undegraded":"2023-10-08T16:04:17.635520+0000","last_fullsized":"2023-10-08T16:04:17.635520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.610515+0000","last_change":"2023-10-08T16:04:16.650083+0000","last_active":"2023-10-08T16:04:17.610515+0000","last_peered":"2023-10-08T16:04:17.610515+0000","last_clean":"2023-10-08T16:04:17.610515+0000","last_became_active":"2023-10-08T16:04:16.649675+0000","last_became_peered":"2023-10-08T16:04:16.649675+0000","last_unstale":"2023-10-08T16:04:17.610515+0000","last_undegraded":"2023-10-08T16:04:17.610515+0000","last_fullsized":"2023-10-08T16:04:17.610515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:04.030037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633354+0000","last_change":"2023-10-08T16:04:17.630525+0000","last_active":"2023-10-08T16:04:17.633354+0000","last_peered":"2023-10-08T16:04:17.633354+0000","last_clean":"2023-10-08T16:04:17.633354+0000","last_became_active":"2023-10-08T16:04:17.628865+0000","last_became_peered":"2023-10-08T16:04:17.628865+0000","last_unstale":"2023-10-08T16:04:17.633354+0000","last_undegraded":"2023-10-08T16:04:17.633354+0000","last_fullsized":"2023-10-08T16:04:17.633354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:46.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.615069+0000","last_change":"2023-10-08T16:04:16.655486+0000","last_active":"2023-10-08T16:04:17.615069+0000","last_peered":"2023-10-08T16:04:17.615069+0000","last_clean":"2023-10-08T16:04:17.615069+0000","last_became_active":"2023-10-08T16:04:16.653342+0000","last_became_peered":"2023-10-08T16:04:16.653342+0000","last_unstale":"2023-10-08T16:04:17.615069+0000","last_undegraded":"2023-10-08T16:04:17.615069+0000","last_fullsized":"2023-10-08T16:04:17.615069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:04.157234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.628618+0000","last_change":"2023-10-08T16:04:17.624815+0000","last_active":"2023-10-08T16:04:17.628618+0000","last_peered":"2023-10-08T16:04:17.628618+0000","last_clean":"2023-10-08T16:04:17.628618+0000","last_became_active":"2023-10-08T16:04:17.624454+0000","last_became_peered":"2023-10-08T16:04:17.624454+0000","last_unstale":"2023-10-08T16:04:17.628618+0000","last_undegraded":"2023-10-08T16:04:17.628618+0000","last_fullsized":"2023-10-08T16:04:17.628618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.662991+0000","last_change":"2023-10-08T16:04:16.659433+0000","last_active":"2023-10-08T16:04:17.662991+0000","last_peered":"2023-10-08T16:04:17.662991+0000","last_clean":"2023-10-08T16:04:17.662991+0000","last_became_active":"2023-10-08T16:04:16.658886+0000","last_became_peered":"2023-10-08T16:04:16.658886+0000","last_unstale":"2023-10-08T16:04:17.662991+0000","last_undegraded":"2023-10-08T16:04:17.662991+0000","last_fullsized":"2023-10-08T16:04:17.662991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:08.532886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633401+0000","last_change":"2023-10-08T16:04:17.628917+0000","last_active":"2023-10-08T16:04:17.633401+0000","last_peered":"2023-10-08T16:04:17.633401+0000","last_clean":"2023-10-08T16:04:17.633401+0000","last_became_active":"2023-10-08T16:04:17.628605+0000","last_became_peered":"2023-10-08T16:04:17.628605+0000","last_unstale":"2023-10-08T16:04:17.633401+0000","last_undegraded":"2023-10-08T16:04:17.633401+0000","last_fullsized":"2023-10-08T16:04:17.633401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:02:45.593266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.655682+0000","last_change":"2023-10-08T16:04:16.660881+0000","last_active":"2023-10-08T16:04:17.655682+0000","last_peered":"2023-10-08T16:04:17.655682+0000","last_clean":"2023-10-08T16:04:17.655682+0000","last_became_active":"2023-10-08T16:04:16.660651+0000","last_became_peered":"2023-10-08T16:04:16.660651+0000","last_unstale":"2023-10-08T16:04:17.655682+0000","last_undegraded":"2023-10-08T16:04:17.655682+0000","last_fullsized":"2023-10-08T16:04:17.655682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:54.682083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633460+0000","last_change":"2023-10-08T16:04:17.629002+0000","last_active":"2023-10-08T16:04:17.633460+0000","last_peered":"2023-10-08T16:04:17.633460+0000","last_clean":"2023-10-08T16:04:17.633460+0000","last_became_active":"2023-10-08T16:04:17.628701+0000","last_became_peered":"2023-10-08T16:04:17.628701+0000","last_unstale":"2023-10-08T16:04:17.633460+0000","last_undegraded":"2023-10-08T16:04:17.633460+0000","last_fullsized":"2023-10-08T16:04:17.633460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:45.664795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.659999+0000","last_change":"2023-10-08T16:04:16.652447+0000","last_active":"2023-10-08T16:04:17.659999+0000","last_peered":"2023-10-08T16:04:17.659999+0000","last_clean":"2023-10-08T16:04:17.659999+0000","last_became_active":"2023-10-08T16:04:16.651709+0000","last_became_peered":"2023-10-08T16:04:16.651709+0000","last_unstale":"2023-10-08T16:04:17.659999+0000","last_undegraded":"2023-10-08T16:04:17.659999+0000","last_fullsized":"2023-10-08T16:04:17.659999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:04.157234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633417+0000","last_change":"2023-10-08T16:04:17.631176+0000","last_active":"2023-10-08T16:04:17.633417+0000","last_peered":"2023-10-08T16:04:17.633417+0000","last_clean":"2023-10-08T16:04:17.633417+0000","last_became_active":"2023-10-08T16:04:17.630908+0000","last_became_peered":"2023-10-08T16:04:17.630908+0000","last_unstale":"2023-10-08T16:04:17.633417+0000","last_undegraded":"2023-10-08T16:04:17.633417+0000","last_fullsized":"2023-10-08T16:04:17.633417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:48.519448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.662439+0000","last_change":"2023-10-08T16:04:16.655771+0000","last_active":"2023-10-08T16:04:17.662439+0000","last_peered":"2023-10-08T16:04:17.662439+0000","last_clean":"2023-10-08T16:04:17.662439+0000","last_became_active":"2023-10-08T16:04:16.655245+0000","last_became_peered":"2023-10-08T16:04:16.655245+0000","last_unstale":"2023-10-08T16:04:17.662439+0000","last_undegraded":"2023-10-08T16:04:17.662439+0000","last_fullsized":"2023-10-08T16:04:17.662439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:48.596542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635952+0000","last_change":"2023-10-08T16:04:17.627726+0000","last_active":"2023-10-08T16:04:17.635952+0000","last_peered":"2023-10-08T16:04:17.635952+0000","last_clean":"2023-10-08T16:04:17.635952+0000","last_became_active":"2023-10-08T16:04:17.627369+0000","last_became_peered":"2023-10-08T16:04:17.627369+0000","last_unstale":"2023-10-08T16:04:17.635952+0000","last_undegraded":"2023-10-08T16:04:17.635952+0000","last_fullsized":"2023-10-08T16:04:17.635952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.619290+0000","last_change":"2023-10-08T16:04:16.654597+0000","last_active":"2023-10-08T16:04:17.619290+0000","last_peered":"2023-10-08T16:04:17.619290+0000","last_clean":"2023-10-08T16:04:17.619290+0000","last_became_active":"2023-10-08T16:04:16.654124+0000","last_became_peered":"2023-10-08T16:04:16.654124+0000","last_unstale":"2023-10-08T16:04:17.619290+0000","last_undegraded":"2023-10-08T16:04:17.619290+0000","last_fullsized":"2023-10-08T16:04:17.619290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.638582+0000","last_change":"2023-10-08T16:04:17.634090+0000","last_active":"2023-10-08T16:04:17.638582+0000","last_peered":"2023-10-08T16:04:17.638582+0000","last_clean":"2023-10-08T16:04:17.638582+0000","last_became_active":"2023-10-08T16:04:17.633811+0000","last_became_peered":"2023-10-08T16:04:17.633811+0000","last_unstale":"2023-10-08T16:04:17.638582+0000","last_undegraded":"2023-10-08T16:04:17.638582+0000","last_fullsized":"2023-10-08T16:04:17.638582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:08.121055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.613242+0000","last_change":"2023-10-08T16:04:06.370834+0000","last_active":"2023-10-08T16:04:17.613242+0000","last_peered":"2023-10-08T16:04:17.613242+0000","last_clean":"2023-10-08T16:04:17.613242+0000","last_became_active":"2023-10-08T16:04:06.368022+0000","last_became_peered":"2023-10-08T16:04:06.368022+0000","last_unstale":"2023-10-08T16:04:17.613242+0000","last_undegraded":"2023-10-08T16:04:17.613242+0000","last_fullsized":"2023-10-08T16:04:17.613242+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:05.034115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:05.034115+0000","last_clean_scrub_stamp":"2023-10-08T16:04:05.034115+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:37.338076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.610284+0000","last_change":"2023-10-08T16:04:16.646681+0000","last_active":"2023-10-08T16:04:17.610284+0000","last_peered":"2023-10-08T16:04:17.610284+0000","last_clean":"2023-10-08T16:04:17.610284+0000","last_became_active":"2023-10-08T16:04:16.646086+0000","last_became_peered":"2023-10-08T16:04:16.646086+0000","last_unstale":"2023-10-08T16:04:17.610284+0000","last_undegraded":"2023-10-08T16:04:17.610284+0000","last_fullsized":"2023-10-08T16:04:17.610284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:24.778540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.634986+0000","last_change":"2023-10-08T16:04:17.629806+0000","last_active":"2023-10-08T16:04:17.634986+0000","last_peered":"2023-10-08T16:04:17.634986+0000","last_clean":"2023-10-08T16:04:17.634986+0000","last_became_active":"2023-10-08T16:04:17.629127+0000","last_became_peered":"2023-10-08T16:04:17.629127+0000","last_unstale":"2023-10-08T16:04:17.634986+0000","last_undegraded":"2023-10-08T16:04:17.634986+0000","last_fullsized":"2023-10-08T16:04:17.634986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:33.720945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.613218+0000","last_change":"2023-10-08T16:04:16.661382+0000","last_active":"2023-10-08T16:04:17.613218+0000","last_peered":"2023-10-08T16:04:17.613218+0000","last_clean":"2023-10-08T16:04:17.613218+0000","last_became_active":"2023-10-08T16:04:16.661186+0000","last_became_peered":"2023-10-08T16:04:16.661186+0000","last_unstale":"2023-10-08T16:04:17.613218+0000","last_undegraded":"2023-10-08T16:04:17.613218+0000","last_fullsized":"2023-10-08T16:04:17.613218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:06.774566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.621479+0000","last_change":"2023-10-08T16:04:17.616018+0000","last_active":"2023-10-08T16:04:17.621479+0000","last_peered":"2023-10-08T16:04:17.621479+0000","last_clean":"2023-10-08T16:04:17.621479+0000","last_became_active":"2023-10-08T16:04:17.615671+0000","last_became_peered":"2023-10-08T16:04:17.615671+0000","last_unstale":"2023-10-08T16:04:17.621479+0000","last_undegraded":"2023-10-08T16:04:17.621479+0000","last_fullsized":"2023-10-08T16:04:17.621479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:05.041349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.619582+0000","last_change":"2023-10-08T16:04:16.654721+0000","last_active":"2023-10-08T16:04:17.619582+0000","last_peered":"2023-10-08T16:04:17.619582+0000","last_clean":"2023-10-08T16:04:17.619582+0000","last_became_active":"2023-10-08T16:04:16.654359+0000","last_became_peered":"2023-10-08T16:04:16.654359+0000","last_unstale":"2023-10-08T16:04:17.619582+0000","last_undegraded":"2023-10-08T16:04:17.619582+0000","last_fullsized":"2023-10-08T16:04:17.619582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:04.030037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.627610+0000","last_change":"2023-10-08T16:04:17.626207+0000","last_active":"2023-10-08T16:04:17.627610+0000","last_peered":"2023-10-08T16:04:17.627610+0000","last_clean":"2023-10-08T16:04:17.627610+0000","last_became_active":"2023-10-08T16:04:17.624876+0000","last_became_peered":"2023-10-08T16:04:17.624876+0000","last_unstale":"2023-10-08T16:04:17.627610+0000","last_undegraded":"2023-10-08T16:04:17.627610+0000","last_fullsized":"2023-10-08T16:04:17.627610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:15.965581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.610643+0000","last_change":"2023-10-08T16:04:16.654812+0000","last_active":"2023-10-08T16:04:17.610643+0000","last_peered":"2023-10-08T16:04:17.610643+0000","last_clean":"2023-10-08T16:04:17.610643+0000","last_became_active":"2023-10-08T16:04:16.654454+0000","last_became_peered":"2023-10-08T16:04:16.654454+0000","last_unstale":"2023-10-08T16:04:17.610643+0000","last_undegraded":"2023-10-08T16:04:17.610643+0000","last_fullsized":"2023-10-08T16:04:17.610643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.627862+0000","last_change":"2023-10-08T16:04:17.619617+0000","last_active":"2023-10-08T16:04:17.627862+0000","last_peered":"2023-10-08T16:04:17.627862+0000","last_clean":"2023-10-08T16:04:17.627862+0000","last_became_active":"2023-10-08T16:04:17.619294+0000","last_became_peered":"2023-10-08T16:04:17.619294+0000","last_unstale":"2023-10-08T16:04:17.627862+0000","last_undegraded":"2023-10-08T16:04:17.627862+0000","last_fullsized":"2023-10-08T16:04:17.627862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:25.789851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.612619+0000","last_change":"2023-10-08T16:04:16.662004+0000","last_active":"2023-10-08T16:04:17.612619+0000","last_peered":"2023-10-08T16:04:17.612619+0000","last_clean":"2023-10-08T16:04:17.612619+0000","last_became_active":"2023-10-08T16:04:16.661756+0000","last_became_peered":"2023-10-08T16:04:16.661756+0000","last_unstale":"2023-10-08T16:04:17.612619+0000","last_undegraded":"2023-10-08T16:04:17.612619+0000","last_fullsized":"2023-10-08T16:04:17.612619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:06.774566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.626656+0000","last_change":"2023-10-08T16:04:17.616691+0000","last_active":"2023-10-08T16:04:17.626656+0000","last_peered":"2023-10-08T16:04:17.626656+0000","last_clean":"2023-10-08T16:04:17.626656+0000","last_became_active":"2023-10-08T16:04:17.616348+0000","last_became_peered":"2023-10-08T16:04:17.616348+0000","last_unstale":"2023-10-08T16:04:17.626656+0000","last_undegraded":"2023-10-08T16:04:17.626656+0000","last_fullsized":"2023-10-08T16:04:17.626656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:08.121055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.614807+0000","last_change":"2023-10-08T16:04:16.662731+0000","last_active":"2023-10-08T16:04:17.614807+0000","last_peered":"2023-10-08T16:04:17.614807+0000","last_clean":"2023-10-08T16:04:17.614807+0000","last_became_active":"2023-10-08T16:04:16.662446+0000","last_became_peered":"2023-10-08T16:04:16.662446+0000","last_unstale":"2023-10-08T16:04:17.614807+0000","last_undegraded":"2023-10-08T16:04:17.614807+0000","last_fullsized":"2023-10-08T16:04:17.614807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:59.297962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.628102+0000","last_change":"2023-10-08T16:04:17.624687+0000","last_active":"2023-10-08T16:04:17.628102+0000","last_peered":"2023-10-08T16:04:17.628102+0000","last_clean":"2023-10-08T16:04:17.628102+0000","last_became_active":"2023-10-08T16:04:17.624319+0000","last_became_peered":"2023-10-08T16:04:17.624319+0000","last_unstale":"2023-10-08T16:04:17.628102+0000","last_undegraded":"2023-10-08T16:04:17.628102+0000","last_fullsized":"2023-10-08T16:04:17.628102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:04:18.608728+0000","last_change":"2023-10-08T16:04:16.661076+0000","last_active":"2023-10-08T16:04:18.608728+0000","last_peered":"2023-10-08T16:04:18.608728+0000","last_clean":"2023-10-08T16:04:18.608728+0000","last_became_active":"2023-10-08T16:04:16.660704+0000","last_became_peered":"2023-10-08T16:04:16.660704+0000","last_unstale":"2023-10-08T16:04:18.608728+0000","last_undegraded":"2023-10-08T16:04:18.608728+0000","last_fullsized":"2023-10-08T16:04:18.608728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.637441+0000","last_change":"2023-10-08T16:04:17.631960+0000","last_active":"2023-10-08T16:04:17.637441+0000","last_peered":"2023-10-08T16:04:17.637441+0000","last_clean":"2023-10-08T16:04:17.637441+0000","last_became_active":"2023-10-08T16:04:17.631615+0000","last_became_peered":"2023-10-08T16:04:17.631615+0000","last_unstale":"2023-10-08T16:04:17.637441+0000","last_undegraded":"2023-10-08T16:04:17.637441+0000","last_fullsized":"2023-10-08T16:04:17.637441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.599406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.654680+0000","last_change":"2023-10-08T16:04:16.659489+0000","last_active":"2023-10-08T16:04:17.654680+0000","last_peered":"2023-10-08T16:04:17.654680+0000","last_clean":"2023-10-08T16:04:17.654680+0000","last_became_active":"2023-10-08T16:04:16.659148+0000","last_became_peered":"2023-10-08T16:04:16.659148+0000","last_unstale":"2023-10-08T16:04:17.654680+0000","last_undegraded":"2023-10-08T16:04:17.654680+0000","last_fullsized":"2023-10-08T16:04:17.654680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635587+0000","last_change":"2023-10-08T16:04:17.624766+0000","last_active":"2023-10-08T16:04:17.635587+0000","last_peered":"2023-10-08T16:04:17.635587+0000","last_clean":"2023-10-08T16:04:17.635587+0000","last_became_active":"2023-10-08T16:04:17.624385+0000","last_became_peered":"2023-10-08T16:04:17.624385+0000","last_unstale":"2023-10-08T16:04:17.635587+0000","last_undegraded":"2023-10-08T16:04:17.635587+0000","last_fullsized":"2023-10-08T16:04:17.635587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.613137+0000","last_change":"2023-10-08T16:04:16.662618+0000","last_active":"2023-10-08T16:04:17.613137+0000","last_peered":"2023-10-08T16:04:17.613137+0000","last_clean":"2023-10-08T16:04:17.613137+0000","last_became_active":"2023-10-08T16:04:16.662327+0000","last_became_peered":"2023-10-08T16:04:16.662327+0000","last_unstale":"2023-10-08T16:04:17.613137+0000","last_undegraded":"2023-10-08T16:04:17.613137+0000","last_fullsized":"2023-10-08T16:04:17.613137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:06:41.062441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.632994+0000","last_change":"2023-10-08T16:04:17.623221+0000","last_active":"2023-10-08T16:04:17.632994+0000","last_peered":"2023-10-08T16:04:17.632994+0000","last_clean":"2023-10-08T16:04:17.632994+0000","last_became_active":"2023-10-08T16:04:17.622898+0000","last_became_peered":"2023-10-08T16:04:17.622898+0000","last_unstale":"2023-10-08T16:04:17.632994+0000","last_undegraded":"2023-10-08T16:04:17.632994+0000","last_fullsized":"2023-10-08T16:04:17.632994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:47.130200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.612371+0000","last_change":"2023-10-08T16:04:16.661483+0000","last_active":"2023-10-08T16:04:17.612371+0000","last_peered":"2023-10-08T16:04:17.612371+0000","last_clean":"2023-10-08T16:04:17.612371+0000","last_became_active":"2023-10-08T16:04:16.661055+0000","last_became_peered":"2023-10-08T16:04:16.661055+0000","last_unstale":"2023-10-08T16:04:17.612371+0000","last_undegraded":"2023-10-08T16:04:17.612371+0000","last_fullsized":"2023-10-08T16:04:17.612371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.631082+0000","last_change":"2023-10-08T16:04:17.627259+0000","last_active":"2023-10-08T16:04:17.631082+0000","last_peered":"2023-10-08T16:04:17.631082+0000","last_clean":"2023-10-08T16:04:17.631082+0000","last_became_active":"2023-10-08T16:04:17.626991+0000","last_became_peered":"2023-10-08T16:04:17.626991+0000","last_unstale":"2023-10-08T16:04:17.631082+0000","last_undegraded":"2023-10-08T16:04:17.631082+0000","last_fullsized":"2023-10-08T16:04:17.631082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:56.205550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.616711+0000","last_change":"2023-10-08T16:04:16.657613+0000","last_active":"2023-10-08T16:04:17.616711+0000","last_peered":"2023-10-08T16:04:17.616711+0000","last_clean":"2023-10-08T16:04:17.616711+0000","last_became_active":"2023-10-08T16:04:16.657299+0000","last_became_peered":"2023-10-08T16:04:16.657299+0000","last_unstale":"2023-10-08T16:04:17.616711+0000","last_undegraded":"2023-10-08T16:04:17.616711+0000","last_fullsized":"2023-10-08T16:04:17.616711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:24.778540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.630041+0000","last_change":"2023-10-08T16:04:17.621069+0000","last_active":"2023-10-08T16:04:17.630041+0000","last_peered":"2023-10-08T16:04:17.630041+0000","last_clean":"2023-10-08T16:04:17.630041+0000","last_became_active":"2023-10-08T16:04:17.620693+0000","last_became_peered":"2023-10-08T16:04:17.620693+0000","last_unstale":"2023-10-08T16:04:17.630041+0000","last_undegraded":"2023-10-08T16:04:17.630041+0000","last_fullsized":"2023-10-08T16:04:17.630041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.655542+0000","last_change":"2023-10-08T16:04:16.663488+0000","last_active":"2023-10-08T16:04:17.655542+0000","last_peered":"2023-10-08T16:04:17.655542+0000","last_clean":"2023-10-08T16:04:17.655542+0000","last_became_active":"2023-10-08T16:04:16.663184+0000","last_became_peered":"2023-10-08T16:04:16.663184+0000","last_unstale":"2023-10-08T16:04:17.655542+0000","last_undegraded":"2023-10-08T16:04:17.655542+0000","last_fullsized":"2023-10-08T16:04:17.655542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:26.863386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.628021+0000","last_change":"2023-10-08T16:04:17.623763+0000","last_active":"2023-10-08T16:04:17.628021+0000","last_peered":"2023-10-08T16:04:17.628021+0000","last_clean":"2023-10-08T16:04:17.628021+0000","last_became_active":"2023-10-08T16:04:17.622898+0000","last_became_peered":"2023-10-08T16:04:17.622898+0000","last_unstale":"2023-10-08T16:04:17.628021+0000","last_undegraded":"2023-10-08T16:04:17.628021+0000","last_fullsized":"2023-10-08T16:04:17.628021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:33.720945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.626676+0000","last_change":"2023-10-08T16:04:17.617498+0000","last_active":"2023-10-08T16:04:17.626676+0000","last_peered":"2023-10-08T16:04:17.626676+0000","last_clean":"2023-10-08T16:04:17.626676+0000","last_became_active":"2023-10-08T16:04:17.617179+0000","last_became_peered":"2023-10-08T16:04:17.617179+0000","last_unstale":"2023-10-08T16:04:17.626676+0000","last_undegraded":"2023-10-08T16:04:17.626676+0000","last_fullsized":"2023-10-08T16:04:17.626676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:56.205550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.654787+0000","last_change":"2023-10-08T16:04:16.661467+0000","last_active":"2023-10-08T16:04:17.654787+0000","last_peered":"2023-10-08T16:04:17.654787+0000","last_clean":"2023-10-08T16:04:17.654787+0000","last_became_active":"2023-10-08T16:04:16.661215+0000","last_became_peered":"2023-10-08T16:04:16.661215+0000","last_unstale":"2023-10-08T16:04:17.654787+0000","last_undegraded":"2023-10-08T16:04:17.654787+0000","last_fullsized":"2023-10-08T16:04:17.654787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.626550+0000","last_change":"2023-10-08T16:04:17.618169+0000","last_active":"2023-10-08T16:04:17.626550+0000","last_peered":"2023-10-08T16:04:17.626550+0000","last_clean":"2023-10-08T16:04:17.626550+0000","last_became_active":"2023-10-08T16:04:17.617216+0000","last_became_peered":"2023-10-08T16:04:17.617216+0000","last_unstale":"2023-10-08T16:04:17.626550+0000","last_undegraded":"2023-10-08T16:04:17.626550+0000","last_fullsized":"2023-10-08T16:04:17.626550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:07.051965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.655102+0000","last_change":"2023-10-08T16:04:16.661825+0000","last_active":"2023-10-08T16:04:17.655102+0000","last_peered":"2023-10-08T16:04:17.655102+0000","last_clean":"2023-10-08T16:04:17.655102+0000","last_became_active":"2023-10-08T16:04:16.661224+0000","last_became_peered":"2023-10-08T16:04:16.661224+0000","last_unstale":"2023-10-08T16:04:17.655102+0000","last_undegraded":"2023-10-08T16:04:17.655102+0000","last_fullsized":"2023-10-08T16:04:17.655102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:08.375883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.632594+0000","last_change":"2023-10-08T16:04:17.621807+0000","last_active":"2023-10-08T16:04:17.632594+0000","last_peered":"2023-10-08T16:04:17.632594+0000","last_clean":"2023-10-08T16:04:17.632594+0000","last_became_active":"2023-10-08T16:04:17.621550+0000","last_became_peered":"2023-10-08T16:04:17.621550+0000","last_unstale":"2023-10-08T16:04:17.632594+0000","last_undegraded":"2023-10-08T16:04:17.632594+0000","last_fullsized":"2023-10-08T16:04:17.632594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:33.720945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.656319+0000","last_change":"2023-10-08T16:04:16.662223+0000","last_active":"2023-10-08T16:04:17.656319+0000","last_peered":"2023-10-08T16:04:17.656319+0000","last_clean":"2023-10-08T16:04:17.656319+0000","last_became_active":"2023-10-08T16:04:16.661907+0000","last_became_peered":"2023-10-08T16:04:16.661907+0000","last_unstale":"2023-10-08T16:04:17.656319+0000","last_undegraded":"2023-10-08T16:04:17.656319+0000","last_fullsized":"2023-10-08T16:04:17.656319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:04.030037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.634527+0000","last_change":"2023-10-08T16:04:17.627855+0000","last_active":"2023-10-08T16:04:17.634527+0000","last_peered":"2023-10-08T16:04:17.634527+0000","last_clean":"2023-10-08T16:04:17.634527+0000","last_became_active":"2023-10-08T16:04:17.627562+0000","last_became_peered":"2023-10-08T16:04:17.627562+0000","last_unstale":"2023-10-08T16:04:17.634527+0000","last_undegraded":"2023-10-08T16:04:17.634527+0000","last_fullsized":"2023-10-08T16:04:17.634527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:08.121055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.659812+0000","last_change":"2023-10-08T16:04:16.663088+0000","last_active":"2023-10-08T16:04:17.659812+0000","last_peered":"2023-10-08T16:04:17.659812+0000","last_clean":"2023-10-08T16:04:17.659812+0000","last_became_active":"2023-10-08T16:04:16.662714+0000","last_became_peered":"2023-10-08T16:04:16.662714+0000","last_unstale":"2023-10-08T16:04:17.659812+0000","last_undegraded":"2023-10-08T16:04:17.659812+0000","last_fullsized":"2023-10-08T16:04:17.659812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:54.682083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":661576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":70654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5049999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298076,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073764,"statfs":{"total":96636764160,"available":96331534336,"internally_reserved":0,"allocated":806912,"data_stored":660721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:04:24.549 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:04:24.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.643+0000 7fbcfa5c0700 1 Processor -- start 2023-10-08T16:04:24.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.643+0000 7fbcfa5c0700 1 -- start start 2023-10-08T16:04:24.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.643+0000 7fbcfa5c0700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcf4145dd0 0x7fbcf4146220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:24.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.643+0000 7fbcfa5c0700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbcf413bcc0 0x7fbcf413c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:24.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.643+0000 7fbcfa5c0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf4146760 con 0x7fbcf40634e0 2023-10-08T16:04:24.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.643+0000 7fbcfa5c0700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf40b1d00 con 0x7fbcf413bcc0 2023-10-08T16:04:24.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.643+0000 7fbcfa5c0700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf40b2cd0 con 0x7fbcf4145dd0 2023-10-08T16:04:24.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.643+0000 7fbcf95be700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbcf40634e0 0x7fbcf40b2470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49466/0 (socket says 172.21.15.133:49466) 2023-10-08T16:04:24.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.643+0000 7fbcf95be700 1 -- 172.21.15.133:0/2954654279 learned_addr learned my addr 172.21.15.133:0/2954654279 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:24.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcf9dbf700 1 --2- 172.21.15.133:0/2954654279 >> v2:172.21.15.190:3300/0 conn(0x7fbcf413bcc0 0x7fbcf413c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:24.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcf8dbd700 1 --2- 172.21.15.133:0/2954654279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcf4145dd0 0x7fbcf4146220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:24.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcebfff700 1 -- 172.21.15.133:0/2954654279 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 848673931 0 0) 0x7fbcf4146760 con 0x7fbcf40634e0 2023-10-08T16:04:24.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcebfff700 1 -- 172.21.15.133:0/2954654279 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbce0003570 con 0x7fbcf40634e0 2023-10-08T16:04:24.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcebfff700 1 -- 172.21.15.133:0/2954654279 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3848348750 0 0) 0x7fbce0003570 con 0x7fbcf40634e0 2023-10-08T16:04:24.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcebfff700 1 -- 172.21.15.133:0/2954654279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcf4145dd0 msgr2=0x7fbcf4146220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:24.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcebfff700 1 --2- 172.21.15.133:0/2954654279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcf4145dd0 0x7fbcf4146220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcebfff700 1 -- 172.21.15.133:0/2954654279 >> v2:172.21.15.190:3300/0 conn(0x7fbcf413bcc0 msgr2=0x7fbcf413c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:24.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcebfff700 1 --2- 172.21.15.133:0/2954654279 >> v2:172.21.15.190:3300/0 conn(0x7fbcf413bcc0 0x7fbcf413c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcebfff700 1 -- 172.21.15.133:0/2954654279 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf40b2fb0 con 0x7fbcf40634e0 2023-10-08T16:04:24.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcebfff700 1 -- 172.21.15.133:0/2954654279 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2883817959 0 0) 0x7fbcf0001470 con 0x7fbcf40634e0 2023-10-08T16:04:24.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcebfff700 1 -- 172.21.15.133:0/2954654279 >> v1:172.21.15.133:6789/0 conn(0x7fbcf40634e0 legacy=0x7fbcf40b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcebfff700 1 --2- 172.21.15.133:0/2954654279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcf4145dd0 0x7fbce0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:24.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcebfff700 1 --2- 172.21.15.133:0/2954654279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbce0003fa0 0x7fbce0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:24.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcebfff700 1 --2- 172.21.15.133:0/2954654279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbce0004d50 0x7fbce00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:24.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcebfff700 1 -- 172.21.15.133:0/2954654279 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf40b1d00 con 0x7fbce0003fa0 2023-10-08T16:04:24.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcebfff700 1 -- 172.21.15.133:0/2954654279 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf40b2cd0 con 0x7fbce0004d50 2023-10-08T16:04:24.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcebfff700 1 -- 172.21.15.133:0/2954654279 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce0014270 con 0x7fbcf4145dd0 2023-10-08T16:04:24.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcf8dbd700 1 --2- 172.21.15.133:0/2954654279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbce0003fa0 0x7fbce0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:24.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcf95be700 1 --2- 172.21.15.133:0/2954654279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcf4145dd0 0x7fbce0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:24.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcf9dbf700 1 --2- 172.21.15.133:0/2954654279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbce0004d50 0x7fbce00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:24.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcf8dbd700 1 -- 172.21.15.133:0/2954654279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcf4145dd0 msgr2=0x7fbce0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:24.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcf8dbd700 1 --2- 172.21.15.133:0/2954654279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcf4145dd0 0x7fbce0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcf8dbd700 1 -- 172.21.15.133:0/2954654279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbce0004d50 msgr2=0x7fbce00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:24.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcf8dbd700 1 --2- 172.21.15.133:0/2954654279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbce0004d50 0x7fbce00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcf8dbd700 1 -- 172.21.15.133:0/2954654279 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce0003570 con 0x7fbce0003fa0 2023-10-08T16:04:24.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcf8dbd700 1 --2- 172.21.15.133:0/2954654279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbce0003fa0 0x7fbce0004810 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbce4009c00 tx=0x7fbce40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8eff3a33f0ce93f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:24.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcebfff700 1 -- 172.21.15.133:0/2954654279 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce400e710 con 0x7fbce0003fa0 2023-10-08T16:04:24.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcebfff700 1 -- 172.21.15.133:0/2954654279 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce400e870 con 0x7fbce0003fa0 2023-10-08T16:04:24.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcebfff700 1 -- 172.21.15.133:0/2954654279 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce400ec30 con 0x7fbce0003fa0 2023-10-08T16:04:24.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcfa5c0700 1 -- 172.21.15.133:0/2954654279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbce0003fa0 msgr2=0x7fbce0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcfa5c0700 1 --2- 172.21.15.133:0/2954654279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbce0003fa0 0x7fbce0004810 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbce4009c00 tx=0x7fbce40091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcf9dbf700 1 -- 172.21.15.133:0/2954654279 reap_dead start 2023-10-08T16:04:24.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcfa5c0700 1 -- 172.21.15.133:0/2954654279 shutdown_connections 2023-10-08T16:04:24.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcfa5c0700 1 -- 172.21.15.133:0/2954654279 >> 172.21.15.133:0/2954654279 conn(0x7fbcf4067de0 msgr2=0x7fbcf4062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:24.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcfa5c0700 1 -- 172.21.15.133:0/2954654279 shutdown_connections 2023-10-08T16:04:24.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.647+0000 7fbcfa5c0700 1 -- 172.21.15.133:0/2954654279 wait complete. 2023-10-08T16:04:24.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.651+0000 7fbcfa5c0700 1 Processor -- start 2023-10-08T16:04:24.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.651+0000 7fbcfa5c0700 1 -- start start 2023-10-08T16:04:24.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.651+0000 7fbcfa5c0700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbce0003fa0 0x7fbcf406ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:24.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.651+0000 7fbcfa5c0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbcf406a4a0 0x7fbcf4150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:24.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.651+0000 7fbcfa5c0700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcf413ac20 0x7fbcf413b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:24.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.651+0000 7fbcfa5c0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf406b910 con 0x7fbcf406a4a0 2023-10-08T16:04:24.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.651+0000 7fbcfa5c0700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf40b97d0 con 0x7fbcf413ac20 2023-10-08T16:04:24.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.651+0000 7fbcfa5c0700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf406c9d0 con 0x7fbce0003fa0 2023-10-08T16:04:24.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.651+0000 7fbcf8dbd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbcf406a4a0 0x7fbcf4150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:24.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.651+0000 7fbcf8dbd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbcf406a4a0 0x7fbcf4150af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43096/0 (socket says 172.21.15.133:43096) 2023-10-08T16:04:24.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.651+0000 7fbcf8dbd700 1 -- 172.21.15.133:0/4134113612 learned_addr learned my addr 172.21.15.133:0/4134113612 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:24.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.651+0000 7fbcf95be700 1 --2- 172.21.15.133:0/4134113612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbce0003fa0 0x7fbcf406ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:24.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.651+0000 7fbcf9dbf700 1 --2- 172.21.15.133:0/4134113612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcf413ac20 0x7fbcf413b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:24.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.651+0000 7fbcf8dbd700 1 -- 172.21.15.133:0/4134113612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbce0003fa0 msgr2=0x7fbcf406ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.651+0000 7fbcf8dbd700 1 --2- 172.21.15.133:0/4134113612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbce0003fa0 0x7fbcf406ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.651+0000 7fbcf8dbd700 1 -- 172.21.15.133:0/4134113612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcf413ac20 msgr2=0x7fbcf413b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.651+0000 7fbcf8dbd700 1 --2- 172.21.15.133:0/4134113612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcf413ac20 0x7fbcf413b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.651+0000 7fbcf8dbd700 1 -- 172.21.15.133:0/4134113612 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf406b3c0 con 0x7fbcf406a4a0 2023-10-08T16:04:24.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.651+0000 7fbcf9dbf700 1 --2- 172.21.15.133:0/4134113612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcf413ac20 0x7fbcf413b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:04:24.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.651+0000 7fbcf8dbd700 1 --2- 172.21.15.133:0/4134113612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbcf406a4a0 0x7fbcf4150af0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbce00046a0 tx=0x7fbce401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:24.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.651+0000 7fbce97fa700 1 -- 172.21.15.133:0/4134113612 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce4022070 con 0x7fbcf406a4a0 2023-10-08T16:04:24.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.651+0000 7fbce97fa700 1 -- 172.21.15.133:0/4134113612 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce400ebf0 con 0x7fbcf406a4a0 2023-10-08T16:04:24.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.651+0000 7fbcfa5c0700 1 -- 172.21.15.133:0/4134113612 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf406b630 con 0x7fbcf406a4a0 2023-10-08T16:04:24.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.651+0000 7fbce97fa700 1 -- 172.21.15.133:0/4134113612 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce401c680 con 0x7fbcf406a4a0 2023-10-08T16:04:24.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.651+0000 7fbcfa5c0700 1 -- 172.21.15.133:0/4134113612 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf413f060 con 0x7fbcf406a4a0 2023-10-08T16:04:24.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.655+0000 7fbcfa5c0700 1 -- 172.21.15.133:0/4134113612 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf40b9940 con 0x7fbcf406a4a0 2023-10-08T16:04:24.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.655+0000 7fbce97fa700 1 -- 172.21.15.133:0/4134113612 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbce401c9f0 con 0x7fbcf406a4a0 2023-10-08T16:04:24.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.655+0000 7fbce97fa700 1 --2- 172.21.15.133:0/4134113612 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fbcd8060550 0x7fbcd8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:24.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.655+0000 7fbce97fa700 1 -- 172.21.15.133:0/4134113612 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbce407de60 con 0x7fbcf406a4a0 2023-10-08T16:04:24.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.655+0000 7fbcf95be700 1 --2- 172.21.15.133:0/4134113612 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fbcd8060550 0x7fbcd8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:24.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.655+0000 7fbcf95be700 1 --2- 172.21.15.133:0/4134113612 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fbcd8060550 0x7fbcd8062a00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0000fd0 tx=0x7fbcf000a040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:24.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.663+0000 7fbce97fa700 1 -- 172.21.15.133:0/4134113612 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbce404e450 con 0x7fbcf406a4a0 2023-10-08T16:04:24.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.807+0000 7fbcfa5c0700 1 -- 172.21.15.133:0/4134113612 --> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbcf404be40 con 0x7fbcd8060550 2023-10-08T16:04:24.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.815+0000 7fbce97fa700 1 -- 172.21.15.133:0/4134113612 <== mgr.4104 v2:172.21.15.133:6832/33362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264481 (secure 0 0 0) 0x7fbcf404be40 con 0x7fbcd8060550 2023-10-08T16:04:24.821 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:04:24.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.819+0000 7fbcfa5c0700 1 -- 172.21.15.133:0/4134113612 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fbcd8060550 msgr2=0x7fbcd8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.819+0000 7fbcfa5c0700 1 --2- 172.21.15.133:0/4134113612 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fbcd8060550 0x7fbcd8062a00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0000fd0 tx=0x7fbcf000a040 comp rx=0 tx=0).stop 2023-10-08T16:04:24.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.819+0000 7fbcfa5c0700 1 -- 172.21.15.133:0/4134113612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbcf406a4a0 msgr2=0x7fbcf4150af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.819+0000 7fbcfa5c0700 1 --2- 172.21.15.133:0/4134113612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbcf406a4a0 0x7fbcf4150af0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbce00046a0 tx=0x7fbce401a000 comp rx=0 tx=0).stop 2023-10-08T16:04:24.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.819+0000 7fbcfa5c0700 1 -- 172.21.15.133:0/4134113612 shutdown_connections 2023-10-08T16:04:24.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.819+0000 7fbcfa5c0700 1 --2- 172.21.15.133:0/4134113612 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fbcd8060550 0x7fbcd8062a00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.819+0000 7fbcfa5c0700 1 --2- 172.21.15.133:0/4134113612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcf413ac20 0x7fbcf413b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.819+0000 7fbcfa5c0700 1 --2- 172.21.15.133:0/4134113612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbcf406a4a0 0x7fbcf4150af0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.819+0000 7fbcfa5c0700 1 --2- 172.21.15.133:0/4134113612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbce0003fa0 0x7fbcf406ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.819+0000 7fbcfa5c0700 1 -- 172.21.15.133:0/4134113612 >> 172.21.15.133:0/4134113612 conn(0x7fbcf4067de0 msgr2=0x7fbcf406fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:24.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.819+0000 7fbcfa5c0700 1 -- 172.21.15.133:0/4134113612 shutdown_connections 2023-10-08T16:04:24.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.819+0000 7fbcfa5c0700 1 -- 172.21.15.133:0/4134113612 wait complete. 2023-10-08T16:04:24.825 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-10-08T16:04:24.836 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T16:04:22.839320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381124,"kb_used_data":2820,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593596,"statfs":{"total":773094113280,"available":770655842304,"internally_reserved":0,"allocated":2887680,"data_stored":1749669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.204100"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.632077+0000","last_change":"2023-10-08T16:04:17.626888+0000","last_active":"2023-10-08T16:04:17.632077+0000","last_peered":"2023-10-08T16:04:17.632077+0000","last_clean":"2023-10-08T16:04:17.632077+0000","last_became_active":"2023-10-08T16:04:17.626468+0000","last_became_peered":"2023-10-08T16:04:17.626468+0000","last_unstale":"2023-10-08T16:04:17.632077+0000","last_undegraded":"2023-10-08T16:04:17.632077+0000","last_fullsized":"2023-10-08T16:04:17.632077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:37.040973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.627185+0000","last_change":"2023-10-08T16:04:17.624301+0000","last_active":"2023-10-08T16:04:17.627185+0000","last_peered":"2023-10-08T16:04:17.627185+0000","last_clean":"2023-10-08T16:04:17.627185+0000","last_became_active":"2023-10-08T16:04:17.623968+0000","last_became_peered":"2023-10-08T16:04:17.623968+0000","last_unstale":"2023-10-08T16:04:17.627185+0000","last_undegraded":"2023-10-08T16:04:17.627185+0000","last_fullsized":"2023-10-08T16:04:17.627185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635485+0000","last_change":"2023-10-08T16:04:17.624529+0000","last_active":"2023-10-08T16:04:17.635485+0000","last_peered":"2023-10-08T16:04:17.635485+0000","last_clean":"2023-10-08T16:04:17.635485+0000","last_became_active":"2023-10-08T16:04:17.624219+0000","last_became_peered":"2023-10-08T16:04:17.624219+0000","last_unstale":"2023-10-08T16:04:17.635485+0000","last_undegraded":"2023-10-08T16:04:17.635485+0000","last_fullsized":"2023-10-08T16:04:17.635485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:07.785877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.636047+0000","last_change":"2023-10-08T16:04:17.628602+0000","last_active":"2023-10-08T16:04:17.636047+0000","last_peered":"2023-10-08T16:04:17.636047+0000","last_clean":"2023-10-08T16:04:17.636047+0000","last_became_active":"2023-10-08T16:04:17.628308+0000","last_became_peered":"2023-10-08T16:04:17.628308+0000","last_unstale":"2023-10-08T16:04:17.636047+0000","last_undegraded":"2023-10-08T16:04:17.636047+0000","last_fullsized":"2023-10-08T16:04:17.636047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:48.519448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.628109+0000","last_change":"2023-10-08T16:04:17.626035+0000","last_active":"2023-10-08T16:04:17.628109+0000","last_peered":"2023-10-08T16:04:17.628109+0000","last_clean":"2023-10-08T16:04:17.628109+0000","last_became_active":"2023-10-08T16:04:17.625650+0000","last_became_peered":"2023-10-08T16:04:17.625650+0000","last_unstale":"2023-10-08T16:04:17.628109+0000","last_undegraded":"2023-10-08T16:04:17.628109+0000","last_fullsized":"2023-10-08T16:04:17.628109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:42.972904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.632991+0000","last_change":"2023-10-08T16:04:17.619829+0000","last_active":"2023-10-08T16:04:17.632991+0000","last_peered":"2023-10-08T16:04:17.632991+0000","last_clean":"2023-10-08T16:04:17.632991+0000","last_became_active":"2023-10-08T16:04:17.619494+0000","last_became_peered":"2023-10-08T16:04:17.619494+0000","last_unstale":"2023-10-08T16:04:17.632991+0000","last_undegraded":"2023-10-08T16:04:17.632991+0000","last_fullsized":"2023-10-08T16:04:17.632991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:02:45.593266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635803+0000","last_change":"2023-10-08T16:04:17.632040+0000","last_active":"2023-10-08T16:04:17.635803+0000","last_peered":"2023-10-08T16:04:17.635803+0000","last_clean":"2023-10-08T16:04:17.635803+0000","last_became_active":"2023-10-08T16:04:17.631722+0000","last_became_peered":"2023-10-08T16:04:17.631722+0000","last_unstale":"2023-10-08T16:04:17.635803+0000","last_undegraded":"2023-10-08T16:04:17.635803+0000","last_fullsized":"2023-10-08T16:04:17.635803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:52.670934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.634619+0000","last_change":"2023-10-08T16:04:17.629400+0000","last_active":"2023-10-08T16:04:17.634619+0000","last_peered":"2023-10-08T16:04:17.634619+0000","last_clean":"2023-10-08T16:04:17.634619+0000","last_became_active":"2023-10-08T16:04:17.628987+0000","last_became_peered":"2023-10-08T16:04:17.628987+0000","last_unstale":"2023-10-08T16:04:17.634619+0000","last_undegraded":"2023-10-08T16:04:17.634619+0000","last_fullsized":"2023-10-08T16:04:17.634619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:26.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.638924+0000","last_change":"2023-10-08T16:04:17.636654+0000","last_active":"2023-10-08T16:04:17.638924+0000","last_peered":"2023-10-08T16:04:17.638924+0000","last_clean":"2023-10-08T16:04:17.638924+0000","last_became_active":"2023-10-08T16:04:17.636350+0000","last_became_peered":"2023-10-08T16:04:17.636350+0000","last_unstale":"2023-10-08T16:04:17.638924+0000","last_undegraded":"2023-10-08T16:04:17.638924+0000","last_fullsized":"2023-10-08T16:04:17.638924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:38:37.066127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633210+0000","last_change":"2023-10-08T16:04:17.627620+0000","last_active":"2023-10-08T16:04:17.633210+0000","last_peered":"2023-10-08T16:04:17.633210+0000","last_clean":"2023-10-08T16:04:17.633210+0000","last_became_active":"2023-10-08T16:04:17.627074+0000","last_became_peered":"2023-10-08T16:04:17.627074+0000","last_unstale":"2023-10-08T16:04:17.633210+0000","last_undegraded":"2023-10-08T16:04:17.633210+0000","last_fullsized":"2023-10-08T16:04:17.633210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:15.965581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633228+0000","last_change":"2023-10-08T16:04:17.628765+0000","last_active":"2023-10-08T16:04:17.633228+0000","last_peered":"2023-10-08T16:04:17.633228+0000","last_clean":"2023-10-08T16:04:17.633228+0000","last_became_active":"2023-10-08T16:04:17.627965+0000","last_became_peered":"2023-10-08T16:04:17.627965+0000","last_unstale":"2023-10-08T16:04:17.633228+0000","last_undegraded":"2023-10-08T16:04:17.633228+0000","last_fullsized":"2023-10-08T16:04:17.633228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.628520+0000","last_change":"2023-10-08T16:04:17.617433+0000","last_active":"2023-10-08T16:04:17.628520+0000","last_peered":"2023-10-08T16:04:17.628520+0000","last_clean":"2023-10-08T16:04:17.628520+0000","last_became_active":"2023-10-08T16:04:17.616988+0000","last_became_peered":"2023-10-08T16:04:17.616988+0000","last_unstale":"2023-10-08T16:04:17.628520+0000","last_undegraded":"2023-10-08T16:04:17.628520+0000","last_fullsized":"2023-10-08T16:04:17.628520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:49.607853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.630551+0000","last_change":"2023-10-08T16:04:17.625824+0000","last_active":"2023-10-08T16:04:17.630551+0000","last_peered":"2023-10-08T16:04:17.630551+0000","last_clean":"2023-10-08T16:04:17.630551+0000","last_became_active":"2023-10-08T16:04:17.625529+0000","last_became_peered":"2023-10-08T16:04:17.625529+0000","last_unstale":"2023-10-08T16:04:17.630551+0000","last_undegraded":"2023-10-08T16:04:17.630551+0000","last_fullsized":"2023-10-08T16:04:17.630551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:07.051965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635548+0000","last_change":"2023-10-08T16:04:17.624728+0000","last_active":"2023-10-08T16:04:17.635548+0000","last_peered":"2023-10-08T16:04:17.635548+0000","last_clean":"2023-10-08T16:04:17.635548+0000","last_became_active":"2023-10-08T16:04:17.624197+0000","last_became_peered":"2023-10-08T16:04:17.624197+0000","last_unstale":"2023-10-08T16:04:17.635548+0000","last_undegraded":"2023-10-08T16:04:17.635548+0000","last_fullsized":"2023-10-08T16:04:17.635548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:08.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.625903+0000","last_change":"2023-10-08T16:04:17.621076+0000","last_active":"2023-10-08T16:04:17.625903+0000","last_peered":"2023-10-08T16:04:17.625903+0000","last_clean":"2023-10-08T16:04:17.625903+0000","last_became_active":"2023-10-08T16:04:17.620391+0000","last_became_peered":"2023-10-08T16:04:17.620391+0000","last_unstale":"2023-10-08T16:04:17.625903+0000","last_undegraded":"2023-10-08T16:04:17.625903+0000","last_fullsized":"2023-10-08T16:04:17.625903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:08.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633034+0000","last_change":"2023-10-08T16:04:17.620158+0000","last_active":"2023-10-08T16:04:17.633034+0000","last_peered":"2023-10-08T16:04:17.633034+0000","last_clean":"2023-10-08T16:04:17.633034+0000","last_became_active":"2023-10-08T16:04:17.619843+0000","last_became_peered":"2023-10-08T16:04:17.619843+0000","last_unstale":"2023-10-08T16:04:17.633034+0000","last_undegraded":"2023-10-08T16:04:17.633034+0000","last_fullsized":"2023-10-08T16:04:17.633034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.599406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633425+0000","last_change":"2023-10-08T16:04:17.625859+0000","last_active":"2023-10-08T16:04:17.633425+0000","last_peered":"2023-10-08T16:04:17.633425+0000","last_clean":"2023-10-08T16:04:17.633425+0000","last_became_active":"2023-10-08T16:04:17.625580+0000","last_became_peered":"2023-10-08T16:04:17.625580+0000","last_unstale":"2023-10-08T16:04:17.633425+0000","last_undegraded":"2023-10-08T16:04:17.633425+0000","last_fullsized":"2023-10-08T16:04:17.633425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:46.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635366+0000","last_change":"2023-10-08T16:04:17.627483+0000","last_active":"2023-10-08T16:04:17.635366+0000","last_peered":"2023-10-08T16:04:17.635366+0000","last_clean":"2023-10-08T16:04:17.635366+0000","last_became_active":"2023-10-08T16:04:17.627197+0000","last_became_peered":"2023-10-08T16:04:17.627197+0000","last_unstale":"2023-10-08T16:04:17.635366+0000","last_undegraded":"2023-10-08T16:04:17.635366+0000","last_fullsized":"2023-10-08T16:04:17.635366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:09.387194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.628134+0000","last_change":"2023-10-08T16:04:17.625900+0000","last_active":"2023-10-08T16:04:17.628134+0000","last_peered":"2023-10-08T16:04:17.628134+0000","last_clean":"2023-10-08T16:04:17.628134+0000","last_became_active":"2023-10-08T16:04:17.625586+0000","last_became_peered":"2023-10-08T16:04:17.625586+0000","last_unstale":"2023-10-08T16:04:17.628134+0000","last_undegraded":"2023-10-08T16:04:17.628134+0000","last_fullsized":"2023-10-08T16:04:17.628134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.599406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.628567+0000","last_change":"2023-10-08T16:04:17.623493+0000","last_active":"2023-10-08T16:04:17.628567+0000","last_peered":"2023-10-08T16:04:17.628567+0000","last_clean":"2023-10-08T16:04:17.628567+0000","last_became_active":"2023-10-08T16:04:17.623200+0000","last_became_peered":"2023-10-08T16:04:17.623200+0000","last_unstale":"2023-10-08T16:04:17.628567+0000","last_undegraded":"2023-10-08T16:04:17.628567+0000","last_fullsized":"2023-10-08T16:04:17.628567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:36.869466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635670+0000","last_change":"2023-10-08T16:04:17.625908+0000","last_active":"2023-10-08T16:04:17.635670+0000","last_peered":"2023-10-08T16:04:17.635670+0000","last_clean":"2023-10-08T16:04:17.635670+0000","last_became_active":"2023-10-08T16:04:17.623945+0000","last_became_peered":"2023-10-08T16:04:17.623945+0000","last_unstale":"2023-10-08T16:04:17.635670+0000","last_undegraded":"2023-10-08T16:04:17.635670+0000","last_fullsized":"2023-10-08T16:04:17.635670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:15.965581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633364+0000","last_change":"2023-10-08T16:04:17.624219+0000","last_active":"2023-10-08T16:04:17.633364+0000","last_peered":"2023-10-08T16:04:17.633364+0000","last_clean":"2023-10-08T16:04:17.633364+0000","last_became_active":"2023-10-08T16:04:17.623904+0000","last_became_peered":"2023-10-08T16:04:17.623904+0000","last_unstale":"2023-10-08T16:04:17.633364+0000","last_undegraded":"2023-10-08T16:04:17.633364+0000","last_fullsized":"2023-10-08T16:04:17.633364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:52.670934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.629217+0000","last_change":"2023-10-08T16:04:17.618857+0000","last_active":"2023-10-08T16:04:17.629217+0000","last_peered":"2023-10-08T16:04:17.629217+0000","last_clean":"2023-10-08T16:04:17.629217+0000","last_became_active":"2023-10-08T16:04:17.618549+0000","last_became_peered":"2023-10-08T16:04:17.618549+0000","last_unstale":"2023-10-08T16:04:17.629217+0000","last_undegraded":"2023-10-08T16:04:17.629217+0000","last_fullsized":"2023-10-08T16:04:17.629217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635992+0000","last_change":"2023-10-08T16:04:17.627955+0000","last_active":"2023-10-08T16:04:17.635992+0000","last_peered":"2023-10-08T16:04:17.635992+0000","last_clean":"2023-10-08T16:04:17.635992+0000","last_became_active":"2023-10-08T16:04:17.627673+0000","last_became_peered":"2023-10-08T16:04:17.627673+0000","last_unstale":"2023-10-08T16:04:17.635992+0000","last_undegraded":"2023-10-08T16:04:17.635992+0000","last_fullsized":"2023-10-08T16:04:17.635992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:26.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.634578+0000","last_change":"2023-10-08T16:04:17.629101+0000","last_active":"2023-10-08T16:04:17.634578+0000","last_peered":"2023-10-08T16:04:17.634578+0000","last_clean":"2023-10-08T16:04:17.634578+0000","last_became_active":"2023-10-08T16:04:17.628793+0000","last_became_peered":"2023-10-08T16:04:17.628793+0000","last_unstale":"2023-10-08T16:04:17.634578+0000","last_undegraded":"2023-10-08T16:04:17.634578+0000","last_fullsized":"2023-10-08T16:04:17.634578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:15.965581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633189+0000","last_change":"2023-10-08T16:04:17.625790+0000","last_active":"2023-10-08T16:04:17.633189+0000","last_peered":"2023-10-08T16:04:17.633189+0000","last_clean":"2023-10-08T16:04:17.633189+0000","last_became_active":"2023-10-08T16:04:17.625220+0000","last_became_peered":"2023-10-08T16:04:17.625220+0000","last_unstale":"2023-10-08T16:04:17.633189+0000","last_undegraded":"2023-10-08T16:04:17.633189+0000","last_fullsized":"2023-10-08T16:04:17.633189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:08.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.634632+0000","last_change":"2023-10-08T16:04:17.629988+0000","last_active":"2023-10-08T16:04:17.634632+0000","last_peered":"2023-10-08T16:04:17.634632+0000","last_clean":"2023-10-08T16:04:17.634632+0000","last_became_active":"2023-10-08T16:04:17.629574+0000","last_became_peered":"2023-10-08T16:04:17.629574+0000","last_unstale":"2023-10-08T16:04:17.634632+0000","last_undegraded":"2023-10-08T16:04:17.634632+0000","last_fullsized":"2023-10-08T16:04:17.634632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:26.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.631112+0000","last_change":"2023-10-08T16:04:17.626698+0000","last_active":"2023-10-08T16:04:17.631112+0000","last_peered":"2023-10-08T16:04:17.631112+0000","last_clean":"2023-10-08T16:04:17.631112+0000","last_became_active":"2023-10-08T16:04:17.626420+0000","last_became_peered":"2023-10-08T16:04:17.626420+0000","last_unstale":"2023-10-08T16:04:17.631112+0000","last_undegraded":"2023-10-08T16:04:17.631112+0000","last_fullsized":"2023-10-08T16:04:17.631112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.625706+0000","last_change":"2023-10-08T16:04:17.618551+0000","last_active":"2023-10-08T16:04:17.625706+0000","last_peered":"2023-10-08T16:04:17.625706+0000","last_clean":"2023-10-08T16:04:17.625706+0000","last_became_active":"2023-10-08T16:04:17.618207+0000","last_became_peered":"2023-10-08T16:04:17.618207+0000","last_unstale":"2023-10-08T16:04:17.625706+0000","last_undegraded":"2023-10-08T16:04:17.625706+0000","last_fullsized":"2023-10-08T16:04:17.625706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:16:31.009207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.636007+0000","last_change":"2023-10-08T16:04:17.627381+0000","last_active":"2023-10-08T16:04:17.636007+0000","last_peered":"2023-10-08T16:04:17.636007+0000","last_clean":"2023-10-08T16:04:17.636007+0000","last_became_active":"2023-10-08T16:04:17.627093+0000","last_became_peered":"2023-10-08T16:04:17.627093+0000","last_unstale":"2023-10-08T16:04:17.636007+0000","last_undegraded":"2023-10-08T16:04:17.636007+0000","last_fullsized":"2023-10-08T16:04:17.636007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:45.664795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635627+0000","last_change":"2023-10-08T16:04:17.629351+0000","last_active":"2023-10-08T16:04:17.635627+0000","last_peered":"2023-10-08T16:04:17.635627+0000","last_clean":"2023-10-08T16:04:17.635627+0000","last_became_active":"2023-10-08T16:04:17.629049+0000","last_became_peered":"2023-10-08T16:04:17.629049+0000","last_unstale":"2023-10-08T16:04:17.635627+0000","last_undegraded":"2023-10-08T16:04:17.635627+0000","last_fullsized":"2023-10-08T16:04:17.635627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:07.785877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635822+0000","last_change":"2023-10-08T16:04:17.632342+0000","last_active":"2023-10-08T16:04:17.635822+0000","last_peered":"2023-10-08T16:04:17.635822+0000","last_clean":"2023-10-08T16:04:17.635822+0000","last_became_active":"2023-10-08T16:04:17.632012+0000","last_became_peered":"2023-10-08T16:04:17.632012+0000","last_unstale":"2023-10-08T16:04:17.635822+0000","last_undegraded":"2023-10-08T16:04:17.635822+0000","last_fullsized":"2023-10-08T16:04:17.635822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633065+0000","last_change":"2023-10-08T16:04:17.623570+0000","last_active":"2023-10-08T16:04:17.633065+0000","last_peered":"2023-10-08T16:04:17.633065+0000","last_clean":"2023-10-08T16:04:17.633065+0000","last_became_active":"2023-10-08T16:04:17.623220+0000","last_became_peered":"2023-10-08T16:04:17.623220+0000","last_unstale":"2023-10-08T16:04:17.633065+0000","last_undegraded":"2023-10-08T16:04:17.633065+0000","last_fullsized":"2023-10-08T16:04:17.633065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:07.785877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.654725+0000","last_change":"2023-10-08T16:04:16.660492+0000","last_active":"2023-10-08T16:04:17.654725+0000","last_peered":"2023-10-08T16:04:17.654725+0000","last_clean":"2023-10-08T16:04:17.654725+0000","last_became_active":"2023-10-08T16:04:16.660183+0000","last_became_peered":"2023-10-08T16:04:16.660183+0000","last_unstale":"2023-10-08T16:04:17.654725+0000","last_undegraded":"2023-10-08T16:04:17.654725+0000","last_fullsized":"2023-10-08T16:04:17.654725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:08.532886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.632702+0000","last_change":"2023-10-08T16:04:17.621094+0000","last_active":"2023-10-08T16:04:17.632702+0000","last_peered":"2023-10-08T16:04:17.632702+0000","last_clean":"2023-10-08T16:04:17.632702+0000","last_became_active":"2023-10-08T16:04:17.620532+0000","last_became_peered":"2023-10-08T16:04:17.620532+0000","last_unstale":"2023-10-08T16:04:17.632702+0000","last_undegraded":"2023-10-08T16:04:17.632702+0000","last_fullsized":"2023-10-08T16:04:17.632702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:48:25.093009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.652629+0000","last_change":"2023-10-08T16:04:16.654209+0000","last_active":"2023-10-08T16:04:17.652629+0000","last_peered":"2023-10-08T16:04:17.652629+0000","last_clean":"2023-10-08T16:04:17.652629+0000","last_became_active":"2023-10-08T16:04:16.653936+0000","last_became_peered":"2023-10-08T16:04:16.653936+0000","last_unstale":"2023-10-08T16:04:17.652629+0000","last_undegraded":"2023-10-08T16:04:17.652629+0000","last_fullsized":"2023-10-08T16:04:17.652629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:39:19.429906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.617151+0000","last_change":"2023-10-08T16:04:16.656953+0000","last_active":"2023-10-08T16:04:17.617151+0000","last_peered":"2023-10-08T16:04:17.617151+0000","last_clean":"2023-10-08T16:04:17.617151+0000","last_became_active":"2023-10-08T16:04:16.656642+0000","last_became_peered":"2023-10-08T16:04:16.656642+0000","last_unstale":"2023-10-08T16:04:17.617151+0000","last_undegraded":"2023-10-08T16:04:17.617151+0000","last_fullsized":"2023-10-08T16:04:17.617151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:04.157234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.631064+0000","last_change":"2023-10-08T16:04:17.625387+0000","last_active":"2023-10-08T16:04:17.631064+0000","last_peered":"2023-10-08T16:04:17.631064+0000","last_clean":"2023-10-08T16:04:17.631064+0000","last_became_active":"2023-10-08T16:04:17.625086+0000","last_became_peered":"2023-10-08T16:04:17.625086+0000","last_unstale":"2023-10-08T16:04:17.631064+0000","last_undegraded":"2023-10-08T16:04:17.631064+0000","last_fullsized":"2023-10-08T16:04:17.631064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:08.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.610846+0000","last_change":"2023-10-08T16:04:16.651645+0000","last_active":"2023-10-08T16:04:17.610846+0000","last_peered":"2023-10-08T16:04:17.610846+0000","last_clean":"2023-10-08T16:04:17.610846+0000","last_became_active":"2023-10-08T16:04:16.651258+0000","last_became_peered":"2023-10-08T16:04:16.651258+0000","last_unstale":"2023-10-08T16:04:17.610846+0000","last_undegraded":"2023-10-08T16:04:17.610846+0000","last_fullsized":"2023-10-08T16:04:17.610846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:48.596542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.634676+0000","last_change":"2023-10-08T16:04:17.630066+0000","last_active":"2023-10-08T16:04:17.634676+0000","last_peered":"2023-10-08T16:04:17.634676+0000","last_clean":"2023-10-08T16:04:17.634676+0000","last_became_active":"2023-10-08T16:04:17.629765+0000","last_became_peered":"2023-10-08T16:04:17.629765+0000","last_unstale":"2023-10-08T16:04:17.634676+0000","last_undegraded":"2023-10-08T16:04:17.634676+0000","last_fullsized":"2023-10-08T16:04:17.634676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.617478+0000","last_change":"2023-10-08T16:04:16.655712+0000","last_active":"2023-10-08T16:04:17.617478+0000","last_peered":"2023-10-08T16:04:17.617478+0000","last_clean":"2023-10-08T16:04:17.617478+0000","last_became_active":"2023-10-08T16:04:16.654002+0000","last_became_peered":"2023-10-08T16:04:16.654002+0000","last_unstale":"2023-10-08T16:04:17.617478+0000","last_undegraded":"2023-10-08T16:04:17.617478+0000","last_fullsized":"2023-10-08T16:04:17.617478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633381+0000","last_change":"2023-10-08T16:04:17.624387+0000","last_active":"2023-10-08T16:04:17.633381+0000","last_peered":"2023-10-08T16:04:17.633381+0000","last_clean":"2023-10-08T16:04:17.633381+0000","last_became_active":"2023-10-08T16:04:17.624071+0000","last_became_peered":"2023-10-08T16:04:17.624071+0000","last_unstale":"2023-10-08T16:04:17.633381+0000","last_undegraded":"2023-10-08T16:04:17.633381+0000","last_fullsized":"2023-10-08T16:04:17.633381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:42.972904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.612317+0000","last_change":"2023-10-08T16:04:16.657245+0000","last_active":"2023-10-08T16:04:17.612317+0000","last_peered":"2023-10-08T16:04:17.612317+0000","last_clean":"2023-10-08T16:04:17.612317+0000","last_became_active":"2023-10-08T16:04:16.656992+0000","last_became_peered":"2023-10-08T16:04:16.656992+0000","last_unstale":"2023-10-08T16:04:17.612317+0000","last_undegraded":"2023-10-08T16:04:17.612317+0000","last_fullsized":"2023-10-08T16:04:17.612317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.632890+0000","last_change":"2023-10-08T16:04:17.622197+0000","last_active":"2023-10-08T16:04:17.632890+0000","last_peered":"2023-10-08T16:04:17.632890+0000","last_clean":"2023-10-08T16:04:17.632890+0000","last_became_active":"2023-10-08T16:04:17.621862+0000","last_became_peered":"2023-10-08T16:04:17.621862+0000","last_unstale":"2023-10-08T16:04:17.632890+0000","last_undegraded":"2023-10-08T16:04:17.632890+0000","last_fullsized":"2023-10-08T16:04:17.632890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:36.869466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.662519+0000","last_change":"2023-10-08T16:04:16.656378+0000","last_active":"2023-10-08T16:04:17.662519+0000","last_peered":"2023-10-08T16:04:17.662519+0000","last_clean":"2023-10-08T16:04:17.662519+0000","last_became_active":"2023-10-08T16:04:16.656041+0000","last_became_peered":"2023-10-08T16:04:16.656041+0000","last_unstale":"2023-10-08T16:04:17.662519+0000","last_undegraded":"2023-10-08T16:04:17.662519+0000","last_fullsized":"2023-10-08T16:04:17.662519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:08.375883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.628540+0000","last_change":"2023-10-08T16:04:17.621021+0000","last_active":"2023-10-08T16:04:17.628540+0000","last_peered":"2023-10-08T16:04:17.628540+0000","last_clean":"2023-10-08T16:04:17.628540+0000","last_became_active":"2023-10-08T16:04:17.620654+0000","last_became_peered":"2023-10-08T16:04:17.620654+0000","last_unstale":"2023-10-08T16:04:17.628540+0000","last_undegraded":"2023-10-08T16:04:17.628540+0000","last_fullsized":"2023-10-08T16:04:17.628540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:09.387194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.661504+0000","last_change":"2023-10-08T16:04:16.653310+0000","last_active":"2023-10-08T16:04:17.661504+0000","last_peered":"2023-10-08T16:04:17.661504+0000","last_clean":"2023-10-08T16:04:17.661504+0000","last_became_active":"2023-10-08T16:04:16.653001+0000","last_became_peered":"2023-10-08T16:04:16.653001+0000","last_unstale":"2023-10-08T16:04:17.661504+0000","last_undegraded":"2023-10-08T16:04:17.661504+0000","last_fullsized":"2023-10-08T16:04:17.661504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:48.596542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633485+0000","last_change":"2023-10-08T16:04:17.631423+0000","last_active":"2023-10-08T16:04:17.633485+0000","last_peered":"2023-10-08T16:04:17.633485+0000","last_clean":"2023-10-08T16:04:17.633485+0000","last_became_active":"2023-10-08T16:04:17.631130+0000","last_became_peered":"2023-10-08T16:04:17.631130+0000","last_unstale":"2023-10-08T16:04:17.633485+0000","last_undegraded":"2023-10-08T16:04:17.633485+0000","last_fullsized":"2023-10-08T16:04:17.633485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:35.211718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.657652+0000","last_change":"2023-10-08T16:04:16.661085+0000","last_active":"2023-10-08T16:04:17.657652+0000","last_peered":"2023-10-08T16:04:17.657652+0000","last_clean":"2023-10-08T16:04:17.657652+0000","last_became_active":"2023-10-08T16:04:16.660830+0000","last_became_peered":"2023-10-08T16:04:16.660830+0000","last_unstale":"2023-10-08T16:04:17.657652+0000","last_undegraded":"2023-10-08T16:04:17.657652+0000","last_fullsized":"2023-10-08T16:04:17.657652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:18.465207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635520+0000","last_change":"2023-10-08T16:04:17.623375+0000","last_active":"2023-10-08T16:04:17.635520+0000","last_peered":"2023-10-08T16:04:17.635520+0000","last_clean":"2023-10-08T16:04:17.635520+0000","last_became_active":"2023-10-08T16:04:17.623038+0000","last_became_peered":"2023-10-08T16:04:17.623038+0000","last_unstale":"2023-10-08T16:04:17.635520+0000","last_undegraded":"2023-10-08T16:04:17.635520+0000","last_fullsized":"2023-10-08T16:04:17.635520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.610515+0000","last_change":"2023-10-08T16:04:16.650083+0000","last_active":"2023-10-08T16:04:17.610515+0000","last_peered":"2023-10-08T16:04:17.610515+0000","last_clean":"2023-10-08T16:04:17.610515+0000","last_became_active":"2023-10-08T16:04:16.649675+0000","last_became_peered":"2023-10-08T16:04:16.649675+0000","last_unstale":"2023-10-08T16:04:17.610515+0000","last_undegraded":"2023-10-08T16:04:17.610515+0000","last_fullsized":"2023-10-08T16:04:17.610515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:04.030037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633354+0000","last_change":"2023-10-08T16:04:17.630525+0000","last_active":"2023-10-08T16:04:17.633354+0000","last_peered":"2023-10-08T16:04:17.633354+0000","last_clean":"2023-10-08T16:04:17.633354+0000","last_became_active":"2023-10-08T16:04:17.628865+0000","last_became_peered":"2023-10-08T16:04:17.628865+0000","last_unstale":"2023-10-08T16:04:17.633354+0000","last_undegraded":"2023-10-08T16:04:17.633354+0000","last_fullsized":"2023-10-08T16:04:17.633354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:46.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.615069+0000","last_change":"2023-10-08T16:04:16.655486+0000","last_active":"2023-10-08T16:04:17.615069+0000","last_peered":"2023-10-08T16:04:17.615069+0000","last_clean":"2023-10-08T16:04:17.615069+0000","last_became_active":"2023-10-08T16:04:16.653342+0000","last_became_peered":"2023-10-08T16:04:16.653342+0000","last_unstale":"2023-10-08T16:04:17.615069+0000","last_undegraded":"2023-10-08T16:04:17.615069+0000","last_fullsized":"2023-10-08T16:04:17.615069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:04.157234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.628618+0000","last_change":"2023-10-08T16:04:17.624815+0000","last_active":"2023-10-08T16:04:17.628618+0000","last_peered":"2023-10-08T16:04:17.628618+0000","last_clean":"2023-10-08T16:04:17.628618+0000","last_became_active":"2023-10-08T16:04:17.624454+0000","last_became_peered":"2023-10-08T16:04:17.624454+0000","last_unstale":"2023-10-08T16:04:17.628618+0000","last_undegraded":"2023-10-08T16:04:17.628618+0000","last_fullsized":"2023-10-08T16:04:17.628618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.662991+0000","last_change":"2023-10-08T16:04:16.659433+0000","last_active":"2023-10-08T16:04:17.662991+0000","last_peered":"2023-10-08T16:04:17.662991+0000","last_clean":"2023-10-08T16:04:17.662991+0000","last_became_active":"2023-10-08T16:04:16.658886+0000","last_became_peered":"2023-10-08T16:04:16.658886+0000","last_unstale":"2023-10-08T16:04:17.662991+0000","last_undegraded":"2023-10-08T16:04:17.662991+0000","last_fullsized":"2023-10-08T16:04:17.662991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:08.532886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633401+0000","last_change":"2023-10-08T16:04:17.628917+0000","last_active":"2023-10-08T16:04:17.633401+0000","last_peered":"2023-10-08T16:04:17.633401+0000","last_clean":"2023-10-08T16:04:17.633401+0000","last_became_active":"2023-10-08T16:04:17.628605+0000","last_became_peered":"2023-10-08T16:04:17.628605+0000","last_unstale":"2023-10-08T16:04:17.633401+0000","last_undegraded":"2023-10-08T16:04:17.633401+0000","last_fullsized":"2023-10-08T16:04:17.633401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:02:45.593266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.655682+0000","last_change":"2023-10-08T16:04:16.660881+0000","last_active":"2023-10-08T16:04:17.655682+0000","last_peered":"2023-10-08T16:04:17.655682+0000","last_clean":"2023-10-08T16:04:17.655682+0000","last_became_active":"2023-10-08T16:04:16.660651+0000","last_became_peered":"2023-10-08T16:04:16.660651+0000","last_unstale":"2023-10-08T16:04:17.655682+0000","last_undegraded":"2023-10-08T16:04:17.655682+0000","last_fullsized":"2023-10-08T16:04:17.655682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:54.682083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633460+0000","last_change":"2023-10-08T16:04:17.629002+0000","last_active":"2023-10-08T16:04:17.633460+0000","last_peered":"2023-10-08T16:04:17.633460+0000","last_clean":"2023-10-08T16:04:17.633460+0000","last_became_active":"2023-10-08T16:04:17.628701+0000","last_became_peered":"2023-10-08T16:04:17.628701+0000","last_unstale":"2023-10-08T16:04:17.633460+0000","last_undegraded":"2023-10-08T16:04:17.633460+0000","last_fullsized":"2023-10-08T16:04:17.633460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:45.664795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.659999+0000","last_change":"2023-10-08T16:04:16.652447+0000","last_active":"2023-10-08T16:04:17.659999+0000","last_peered":"2023-10-08T16:04:17.659999+0000","last_clean":"2023-10-08T16:04:17.659999+0000","last_became_active":"2023-10-08T16:04:16.651709+0000","last_became_peered":"2023-10-08T16:04:16.651709+0000","last_unstale":"2023-10-08T16:04:17.659999+0000","last_undegraded":"2023-10-08T16:04:17.659999+0000","last_fullsized":"2023-10-08T16:04:17.659999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:04.157234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.633417+0000","last_change":"2023-10-08T16:04:17.631176+0000","last_active":"2023-10-08T16:04:17.633417+0000","last_peered":"2023-10-08T16:04:17.633417+0000","last_clean":"2023-10-08T16:04:17.633417+0000","last_became_active":"2023-10-08T16:04:17.630908+0000","last_became_peered":"2023-10-08T16:04:17.630908+0000","last_unstale":"2023-10-08T16:04:17.633417+0000","last_undegraded":"2023-10-08T16:04:17.633417+0000","last_fullsized":"2023-10-08T16:04:17.633417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:48.519448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.662439+0000","last_change":"2023-10-08T16:04:16.655771+0000","last_active":"2023-10-08T16:04:17.662439+0000","last_peered":"2023-10-08T16:04:17.662439+0000","last_clean":"2023-10-08T16:04:17.662439+0000","last_became_active":"2023-10-08T16:04:16.655245+0000","last_became_peered":"2023-10-08T16:04:16.655245+0000","last_unstale":"2023-10-08T16:04:17.662439+0000","last_undegraded":"2023-10-08T16:04:17.662439+0000","last_fullsized":"2023-10-08T16:04:17.662439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:48.596542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635952+0000","last_change":"2023-10-08T16:04:17.627726+0000","last_active":"2023-10-08T16:04:17.635952+0000","last_peered":"2023-10-08T16:04:17.635952+0000","last_clean":"2023-10-08T16:04:17.635952+0000","last_became_active":"2023-10-08T16:04:17.627369+0000","last_became_peered":"2023-10-08T16:04:17.627369+0000","last_unstale":"2023-10-08T16:04:17.635952+0000","last_undegraded":"2023-10-08T16:04:17.635952+0000","last_fullsized":"2023-10-08T16:04:17.635952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.619290+0000","last_change":"2023-10-08T16:04:16.654597+0000","last_active":"2023-10-08T16:04:17.619290+0000","last_peered":"2023-10-08T16:04:17.619290+0000","last_clean":"2023-10-08T16:04:17.619290+0000","last_became_active":"2023-10-08T16:04:16.654124+0000","last_became_peered":"2023-10-08T16:04:16.654124+0000","last_unstale":"2023-10-08T16:04:17.619290+0000","last_undegraded":"2023-10-08T16:04:17.619290+0000","last_fullsized":"2023-10-08T16:04:17.619290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.638582+0000","last_change":"2023-10-08T16:04:17.634090+0000","last_active":"2023-10-08T16:04:17.638582+0000","last_peered":"2023-10-08T16:04:17.638582+0000","last_clean":"2023-10-08T16:04:17.638582+0000","last_became_active":"2023-10-08T16:04:17.633811+0000","last_became_peered":"2023-10-08T16:04:17.633811+0000","last_unstale":"2023-10-08T16:04:17.638582+0000","last_undegraded":"2023-10-08T16:04:17.638582+0000","last_fullsized":"2023-10-08T16:04:17.638582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:08.121055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.613242+0000","last_change":"2023-10-08T16:04:06.370834+0000","last_active":"2023-10-08T16:04:17.613242+0000","last_peered":"2023-10-08T16:04:17.613242+0000","last_clean":"2023-10-08T16:04:17.613242+0000","last_became_active":"2023-10-08T16:04:06.368022+0000","last_became_peered":"2023-10-08T16:04:06.368022+0000","last_unstale":"2023-10-08T16:04:17.613242+0000","last_undegraded":"2023-10-08T16:04:17.613242+0000","last_fullsized":"2023-10-08T16:04:17.613242+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:05.034115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:05.034115+0000","last_clean_scrub_stamp":"2023-10-08T16:04:05.034115+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:37.338076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.610284+0000","last_change":"2023-10-08T16:04:16.646681+0000","last_active":"2023-10-08T16:04:17.610284+0000","last_peered":"2023-10-08T16:04:17.610284+0000","last_clean":"2023-10-08T16:04:17.610284+0000","last_became_active":"2023-10-08T16:04:16.646086+0000","last_became_peered":"2023-10-08T16:04:16.646086+0000","last_unstale":"2023-10-08T16:04:17.610284+0000","last_undegraded":"2023-10-08T16:04:17.610284+0000","last_fullsized":"2023-10-08T16:04:17.610284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:24.778540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.634986+0000","last_change":"2023-10-08T16:04:17.629806+0000","last_active":"2023-10-08T16:04:17.634986+0000","last_peered":"2023-10-08T16:04:17.634986+0000","last_clean":"2023-10-08T16:04:17.634986+0000","last_became_active":"2023-10-08T16:04:17.629127+0000","last_became_peered":"2023-10-08T16:04:17.629127+0000","last_unstale":"2023-10-08T16:04:17.634986+0000","last_undegraded":"2023-10-08T16:04:17.634986+0000","last_fullsized":"2023-10-08T16:04:17.634986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:33.720945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.613218+0000","last_change":"2023-10-08T16:04:16.661382+0000","last_active":"2023-10-08T16:04:17.613218+0000","last_peered":"2023-10-08T16:04:17.613218+0000","last_clean":"2023-10-08T16:04:17.613218+0000","last_became_active":"2023-10-08T16:04:16.661186+0000","last_became_peered":"2023-10-08T16:04:16.661186+0000","last_unstale":"2023-10-08T16:04:17.613218+0000","last_undegraded":"2023-10-08T16:04:17.613218+0000","last_fullsized":"2023-10-08T16:04:17.613218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:06.774566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.621479+0000","last_change":"2023-10-08T16:04:17.616018+0000","last_active":"2023-10-08T16:04:17.621479+0000","last_peered":"2023-10-08T16:04:17.621479+0000","last_clean":"2023-10-08T16:04:17.621479+0000","last_became_active":"2023-10-08T16:04:17.615671+0000","last_became_peered":"2023-10-08T16:04:17.615671+0000","last_unstale":"2023-10-08T16:04:17.621479+0000","last_undegraded":"2023-10-08T16:04:17.621479+0000","last_fullsized":"2023-10-08T16:04:17.621479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:05.041349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.619582+0000","last_change":"2023-10-08T16:04:16.654721+0000","last_active":"2023-10-08T16:04:17.619582+0000","last_peered":"2023-10-08T16:04:17.619582+0000","last_clean":"2023-10-08T16:04:17.619582+0000","last_became_active":"2023-10-08T16:04:16.654359+0000","last_became_peered":"2023-10-08T16:04:16.654359+0000","last_unstale":"2023-10-08T16:04:17.619582+0000","last_undegraded":"2023-10-08T16:04:17.619582+0000","last_fullsized":"2023-10-08T16:04:17.619582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:04.030037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.627610+0000","last_change":"2023-10-08T16:04:17.626207+0000","last_active":"2023-10-08T16:04:17.627610+0000","last_peered":"2023-10-08T16:04:17.627610+0000","last_clean":"2023-10-08T16:04:17.627610+0000","last_became_active":"2023-10-08T16:04:17.624876+0000","last_became_peered":"2023-10-08T16:04:17.624876+0000","last_unstale":"2023-10-08T16:04:17.627610+0000","last_undegraded":"2023-10-08T16:04:17.627610+0000","last_fullsized":"2023-10-08T16:04:17.627610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:15.965581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.610643+0000","last_change":"2023-10-08T16:04:16.654812+0000","last_active":"2023-10-08T16:04:17.610643+0000","last_peered":"2023-10-08T16:04:17.610643+0000","last_clean":"2023-10-08T16:04:17.610643+0000","last_became_active":"2023-10-08T16:04:16.654454+0000","last_became_peered":"2023-10-08T16:04:16.654454+0000","last_unstale":"2023-10-08T16:04:17.610643+0000","last_undegraded":"2023-10-08T16:04:17.610643+0000","last_fullsized":"2023-10-08T16:04:17.610643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.627862+0000","last_change":"2023-10-08T16:04:17.619617+0000","last_active":"2023-10-08T16:04:17.627862+0000","last_peered":"2023-10-08T16:04:17.627862+0000","last_clean":"2023-10-08T16:04:17.627862+0000","last_became_active":"2023-10-08T16:04:17.619294+0000","last_became_peered":"2023-10-08T16:04:17.619294+0000","last_unstale":"2023-10-08T16:04:17.627862+0000","last_undegraded":"2023-10-08T16:04:17.627862+0000","last_fullsized":"2023-10-08T16:04:17.627862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:25.789851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.612619+0000","last_change":"2023-10-08T16:04:16.662004+0000","last_active":"2023-10-08T16:04:17.612619+0000","last_peered":"2023-10-08T16:04:17.612619+0000","last_clean":"2023-10-08T16:04:17.612619+0000","last_became_active":"2023-10-08T16:04:16.661756+0000","last_became_peered":"2023-10-08T16:04:16.661756+0000","last_unstale":"2023-10-08T16:04:17.612619+0000","last_undegraded":"2023-10-08T16:04:17.612619+0000","last_fullsized":"2023-10-08T16:04:17.612619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:06.774566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.626656+0000","last_change":"2023-10-08T16:04:17.616691+0000","last_active":"2023-10-08T16:04:17.626656+0000","last_peered":"2023-10-08T16:04:17.626656+0000","last_clean":"2023-10-08T16:04:17.626656+0000","last_became_active":"2023-10-08T16:04:17.616348+0000","last_became_peered":"2023-10-08T16:04:17.616348+0000","last_unstale":"2023-10-08T16:04:17.626656+0000","last_undegraded":"2023-10-08T16:04:17.626656+0000","last_fullsized":"2023-10-08T16:04:17.626656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:08.121055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.614807+0000","last_change":"2023-10-08T16:04:16.662731+0000","last_active":"2023-10-08T16:04:17.614807+0000","last_peered":"2023-10-08T16:04:17.614807+0000","last_clean":"2023-10-08T16:04:17.614807+0000","last_became_active":"2023-10-08T16:04:16.662446+0000","last_became_peered":"2023-10-08T16:04:16.662446+0000","last_unstale":"2023-10-08T16:04:17.614807+0000","last_undegraded":"2023-10-08T16:04:17.614807+0000","last_fullsized":"2023-10-08T16:04:17.614807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:59.297962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.628102+0000","last_change":"2023-10-08T16:04:17.624687+0000","last_active":"2023-10-08T16:04:17.628102+0000","last_peered":"2023-10-08T16:04:17.628102+0000","last_clean":"2023-10-08T16:04:17.628102+0000","last_became_active":"2023-10-08T16:04:17.624319+0000","last_became_peered":"2023-10-08T16:04:17.624319+0000","last_unstale":"2023-10-08T16:04:17.628102+0000","last_undegraded":"2023-10-08T16:04:17.628102+0000","last_fullsized":"2023-10-08T16:04:17.628102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:04:18.608728+0000","last_change":"2023-10-08T16:04:16.661076+0000","last_active":"2023-10-08T16:04:18.608728+0000","last_peered":"2023-10-08T16:04:18.608728+0000","last_clean":"2023-10-08T16:04:18.608728+0000","last_became_active":"2023-10-08T16:04:16.660704+0000","last_became_peered":"2023-10-08T16:04:16.660704+0000","last_unstale":"2023-10-08T16:04:18.608728+0000","last_undegraded":"2023-10-08T16:04:18.608728+0000","last_fullsized":"2023-10-08T16:04:18.608728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.637441+0000","last_change":"2023-10-08T16:04:17.631960+0000","last_active":"2023-10-08T16:04:17.637441+0000","last_peered":"2023-10-08T16:04:17.637441+0000","last_clean":"2023-10-08T16:04:17.637441+0000","last_became_active":"2023-10-08T16:04:17.631615+0000","last_became_peered":"2023-10-08T16:04:17.631615+0000","last_unstale":"2023-10-08T16:04:17.637441+0000","last_undegraded":"2023-10-08T16:04:17.637441+0000","last_fullsized":"2023-10-08T16:04:17.637441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.599406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.654680+0000","last_change":"2023-10-08T16:04:16.659489+0000","last_active":"2023-10-08T16:04:17.654680+0000","last_peered":"2023-10-08T16:04:17.654680+0000","last_clean":"2023-10-08T16:04:17.654680+0000","last_became_active":"2023-10-08T16:04:16.659148+0000","last_became_peered":"2023-10-08T16:04:16.659148+0000","last_unstale":"2023-10-08T16:04:17.654680+0000","last_undegraded":"2023-10-08T16:04:17.654680+0000","last_fullsized":"2023-10-08T16:04:17.654680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.635587+0000","last_change":"2023-10-08T16:04:17.624766+0000","last_active":"2023-10-08T16:04:17.635587+0000","last_peered":"2023-10-08T16:04:17.635587+0000","last_clean":"2023-10-08T16:04:17.635587+0000","last_became_active":"2023-10-08T16:04:17.624385+0000","last_became_peered":"2023-10-08T16:04:17.624385+0000","last_unstale":"2023-10-08T16:04:17.635587+0000","last_undegraded":"2023-10-08T16:04:17.635587+0000","last_fullsized":"2023-10-08T16:04:17.635587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.613137+0000","last_change":"2023-10-08T16:04:16.662618+0000","last_active":"2023-10-08T16:04:17.613137+0000","last_peered":"2023-10-08T16:04:17.613137+0000","last_clean":"2023-10-08T16:04:17.613137+0000","last_became_active":"2023-10-08T16:04:16.662327+0000","last_became_peered":"2023-10-08T16:04:16.662327+0000","last_unstale":"2023-10-08T16:04:17.613137+0000","last_undegraded":"2023-10-08T16:04:17.613137+0000","last_fullsized":"2023-10-08T16:04:17.613137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:06:41.062441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.632994+0000","last_change":"2023-10-08T16:04:17.623221+0000","last_active":"2023-10-08T16:04:17.632994+0000","last_peered":"2023-10-08T16:04:17.632994+0000","last_clean":"2023-10-08T16:04:17.632994+0000","last_became_active":"2023-10-08T16:04:17.622898+0000","last_became_peered":"2023-10-08T16:04:17.622898+0000","last_unstale":"2023-10-08T16:04:17.632994+0000","last_undegraded":"2023-10-08T16:04:17.632994+0000","last_fullsized":"2023-10-08T16:04:17.632994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:47.130200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.612371+0000","last_change":"2023-10-08T16:04:16.661483+0000","last_active":"2023-10-08T16:04:17.612371+0000","last_peered":"2023-10-08T16:04:17.612371+0000","last_clean":"2023-10-08T16:04:17.612371+0000","last_became_active":"2023-10-08T16:04:16.661055+0000","last_became_peered":"2023-10-08T16:04:16.661055+0000","last_unstale":"2023-10-08T16:04:17.612371+0000","last_undegraded":"2023-10-08T16:04:17.612371+0000","last_fullsized":"2023-10-08T16:04:17.612371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.631082+0000","last_change":"2023-10-08T16:04:17.627259+0000","last_active":"2023-10-08T16:04:17.631082+0000","last_peered":"2023-10-08T16:04:17.631082+0000","last_clean":"2023-10-08T16:04:17.631082+0000","last_became_active":"2023-10-08T16:04:17.626991+0000","last_became_peered":"2023-10-08T16:04:17.626991+0000","last_unstale":"2023-10-08T16:04:17.631082+0000","last_undegraded":"2023-10-08T16:04:17.631082+0000","last_fullsized":"2023-10-08T16:04:17.631082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:56.205550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.616711+0000","last_change":"2023-10-08T16:04:16.657613+0000","last_active":"2023-10-08T16:04:17.616711+0000","last_peered":"2023-10-08T16:04:17.616711+0000","last_clean":"2023-10-08T16:04:17.616711+0000","last_became_active":"2023-10-08T16:04:16.657299+0000","last_became_peered":"2023-10-08T16:04:16.657299+0000","last_unstale":"2023-10-08T16:04:17.616711+0000","last_undegraded":"2023-10-08T16:04:17.616711+0000","last_fullsized":"2023-10-08T16:04:17.616711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:24.778540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.630041+0000","last_change":"2023-10-08T16:04:17.621069+0000","last_active":"2023-10-08T16:04:17.630041+0000","last_peered":"2023-10-08T16:04:17.630041+0000","last_clean":"2023-10-08T16:04:17.630041+0000","last_became_active":"2023-10-08T16:04:17.620693+0000","last_became_peered":"2023-10-08T16:04:17.620693+0000","last_unstale":"2023-10-08T16:04:17.630041+0000","last_undegraded":"2023-10-08T16:04:17.630041+0000","last_fullsized":"2023-10-08T16:04:17.630041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.655542+0000","last_change":"2023-10-08T16:04:16.663488+0000","last_active":"2023-10-08T16:04:17.655542+0000","last_peered":"2023-10-08T16:04:17.655542+0000","last_clean":"2023-10-08T16:04:17.655542+0000","last_became_active":"2023-10-08T16:04:16.663184+0000","last_became_peered":"2023-10-08T16:04:16.663184+0000","last_unstale":"2023-10-08T16:04:17.655542+0000","last_undegraded":"2023-10-08T16:04:17.655542+0000","last_fullsized":"2023-10-08T16:04:17.655542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:26.863386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.628021+0000","last_change":"2023-10-08T16:04:17.623763+0000","last_active":"2023-10-08T16:04:17.628021+0000","last_peered":"2023-10-08T16:04:17.628021+0000","last_clean":"2023-10-08T16:04:17.628021+0000","last_became_active":"2023-10-08T16:04:17.622898+0000","last_became_peered":"2023-10-08T16:04:17.622898+0000","last_unstale":"2023-10-08T16:04:17.628021+0000","last_undegraded":"2023-10-08T16:04:17.628021+0000","last_fullsized":"2023-10-08T16:04:17.628021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:33.720945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.626676+0000","last_change":"2023-10-08T16:04:17.617498+0000","last_active":"2023-10-08T16:04:17.626676+0000","last_peered":"2023-10-08T16:04:17.626676+0000","last_clean":"2023-10-08T16:04:17.626676+0000","last_became_active":"2023-10-08T16:04:17.617179+0000","last_became_peered":"2023-10-08T16:04:17.617179+0000","last_unstale":"2023-10-08T16:04:17.626676+0000","last_undegraded":"2023-10-08T16:04:17.626676+0000","last_fullsized":"2023-10-08T16:04:17.626676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:56.205550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.654787+0000","last_change":"2023-10-08T16:04:16.661467+0000","last_active":"2023-10-08T16:04:17.654787+0000","last_peered":"2023-10-08T16:04:17.654787+0000","last_clean":"2023-10-08T16:04:17.654787+0000","last_became_active":"2023-10-08T16:04:16.661215+0000","last_became_peered":"2023-10-08T16:04:16.661215+0000","last_unstale":"2023-10-08T16:04:17.654787+0000","last_undegraded":"2023-10-08T16:04:17.654787+0000","last_fullsized":"2023-10-08T16:04:17.654787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.626550+0000","last_change":"2023-10-08T16:04:17.618169+0000","last_active":"2023-10-08T16:04:17.626550+0000","last_peered":"2023-10-08T16:04:17.626550+0000","last_clean":"2023-10-08T16:04:17.626550+0000","last_became_active":"2023-10-08T16:04:17.617216+0000","last_became_peered":"2023-10-08T16:04:17.617216+0000","last_unstale":"2023-10-08T16:04:17.626550+0000","last_undegraded":"2023-10-08T16:04:17.626550+0000","last_fullsized":"2023-10-08T16:04:17.626550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:07.051965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.655102+0000","last_change":"2023-10-08T16:04:16.661825+0000","last_active":"2023-10-08T16:04:17.655102+0000","last_peered":"2023-10-08T16:04:17.655102+0000","last_clean":"2023-10-08T16:04:17.655102+0000","last_became_active":"2023-10-08T16:04:16.661224+0000","last_became_peered":"2023-10-08T16:04:16.661224+0000","last_unstale":"2023-10-08T16:04:17.655102+0000","last_undegraded":"2023-10-08T16:04:17.655102+0000","last_fullsized":"2023-10-08T16:04:17.655102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:08.375883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.632594+0000","last_change":"2023-10-08T16:04:17.621807+0000","last_active":"2023-10-08T16:04:17.632594+0000","last_peered":"2023-10-08T16:04:17.632594+0000","last_clean":"2023-10-08T16:04:17.632594+0000","last_became_active":"2023-10-08T16:04:17.621550+0000","last_became_peered":"2023-10-08T16:04:17.621550+0000","last_unstale":"2023-10-08T16:04:17.632594+0000","last_undegraded":"2023-10-08T16:04:17.632594+0000","last_fullsized":"2023-10-08T16:04:17.632594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:33.720945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.656319+0000","last_change":"2023-10-08T16:04:16.662223+0000","last_active":"2023-10-08T16:04:17.656319+0000","last_peered":"2023-10-08T16:04:17.656319+0000","last_clean":"2023-10-08T16:04:17.656319+0000","last_became_active":"2023-10-08T16:04:16.661907+0000","last_became_peered":"2023-10-08T16:04:16.661907+0000","last_unstale":"2023-10-08T16:04:17.656319+0000","last_undegraded":"2023-10-08T16:04:17.656319+0000","last_fullsized":"2023-10-08T16:04:17.656319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:04.030037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.634527+0000","last_change":"2023-10-08T16:04:17.627855+0000","last_active":"2023-10-08T16:04:17.634527+0000","last_peered":"2023-10-08T16:04:17.634527+0000","last_clean":"2023-10-08T16:04:17.634527+0000","last_became_active":"2023-10-08T16:04:17.627562+0000","last_became_peered":"2023-10-08T16:04:17.627562+0000","last_unstale":"2023-10-08T16:04:17.634527+0000","last_undegraded":"2023-10-08T16:04:17.634527+0000","last_fullsized":"2023-10-08T16:04:17.634527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:08.121055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T16:04:17.659812+0000","last_change":"2023-10-08T16:04:16.663088+0000","last_active":"2023-10-08T16:04:17.659812+0000","last_peered":"2023-10-08T16:04:17.659812+0000","last_clean":"2023-10-08T16:04:17.659812+0000","last_became_active":"2023-10-08T16:04:16.662714+0000","last_became_peered":"2023-10-08T16:04:16.662714+0000","last_unstale":"2023-10-08T16:04:17.659812+0000","last_undegraded":"2023-10-08T16:04:17.659812+0000","last_fullsized":"2023-10-08T16:04:17.659812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:54.682083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":661576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":70654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5049999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298076,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073764,"statfs":{"total":96636764160,"available":96331534336,"internally_reserved":0,"allocated":806912,"data_stored":660721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:04:24.841 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-08T16:04:24.841 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-08T16:04:24.841 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-08T16:04:24.841 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-08T16:04:24.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afed74700 1 Processor -- start 2023-10-08T16:04:24.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afed74700 1 -- start start 2023-10-08T16:04:24.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afed74700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4af80ad070 0x7f4af80ad440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:24.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afed74700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4af813b7d0 0x7f4af813bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:24.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afed74700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af80ad980 con 0x7f4af80af820 2023-10-08T16:04:24.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afed74700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af80ae800 con 0x7f4af813b7d0 2023-10-08T16:04:24.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afed74700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af80b1180 con 0x7f4af80ad070 2023-10-08T16:04:24.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afe573700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4af813b7d0 0x7f4af813bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:24.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afd571700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4af80af820 0x7f4af80afc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49480/0 (socket says 172.21.15.133:49480) 2023-10-08T16:04:24.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afe573700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4af813b7d0 0x7f4af813bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43108/0 (socket says 172.21.15.133:43108) 2023-10-08T16:04:24.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afd571700 1 -- 172.21.15.133:0/4036310712 learned_addr learned my addr 172.21.15.133:0/4036310712 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:24.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afdd72700 1 --2- 172.21.15.133:0/4036310712 >> v2:172.21.15.190:3300/0 conn(0x7f4af80ad070 0x7f4af80ad440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:24.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afe573700 1 -- 172.21.15.133:0/4036310712 >> v2:172.21.15.190:3300/0 conn(0x7f4af80ad070 msgr2=0x7f4af80ad440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:24.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afe573700 1 --2- 172.21.15.133:0/4036310712 >> v2:172.21.15.190:3300/0 conn(0x7f4af80ad070 0x7f4af80ad440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afe573700 1 -- 172.21.15.133:0/4036310712 >> v1:172.21.15.133:6789/0 conn(0x7f4af80af820 legacy=0x7f4af80afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afcd70700 1 -- 172.21.15.133:0/4036310712 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038842302 0 0) 0x7f4aec001110 con 0x7f4af80af820 2023-10-08T16:04:24.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afe573700 1 -- 172.21.15.133:0/4036310712 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af80ac660 con 0x7f4af813b7d0 2023-10-08T16:04:24.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afe573700 1 --2- 172.21.15.133:0/4036310712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af813b7d0 0x7f4af813bc50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4af80b0c90 tx=0x7f4af0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f915a36012e17a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:24.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afcd70700 1 -- 172.21.15.133:0/4036310712 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af000e070 con 0x7f4af813b7d0 2023-10-08T16:04:24.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afcd70700 1 -- 172.21.15.133:0/4036310712 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af000bb60 con 0x7f4af813b7d0 2023-10-08T16:04:24.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afcd70700 1 -- 172.21.15.133:0/4036310712 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af0012430 con 0x7f4af813b7d0 2023-10-08T16:04:24.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afed74700 1 -- 172.21.15.133:0/4036310712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af813b7d0 msgr2=0x7f4af813bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afed74700 1 --2- 172.21.15.133:0/4036310712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af813b7d0 0x7f4af813bc50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4af80b0c90 tx=0x7f4af0009780 comp rx=0 tx=0).stop 2023-10-08T16:04:24.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afed74700 1 -- 172.21.15.133:0/4036310712 shutdown_connections 2023-10-08T16:04:24.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afed74700 1 --2- 172.21.15.133:0/4036310712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af813b7d0 0x7f4af813bc50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afed74700 1 --2- 172.21.15.133:0/4036310712 >> v2:172.21.15.190:3300/0 conn(0x7f4af80ad070 0x7f4af80ad440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afed74700 1 -- 172.21.15.133:0/4036310712 >> 172.21.15.133:0/4036310712 conn(0x7f4af8062ba0 msgr2=0x7f4af8062fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:24.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afed74700 1 -- 172.21.15.133:0/4036310712 shutdown_connections 2023-10-08T16:04:24.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.939+0000 7f4afed74700 1 -- 172.21.15.133:0/4036310712 wait complete. 2023-10-08T16:04:24.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.943+0000 7f4afed74700 1 Processor -- start 2023-10-08T16:04:24.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.943+0000 7f4afed74700 1 -- start start 2023-10-08T16:04:24.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.943+0000 7f4afed74700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af80ad070 0x7f4af814dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:24.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.943+0000 7f4afed74700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4af80af820 0x7f4af814e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.943+0000 7f4afed74700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4af813b7d0 0x7f4af806e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.943+0000 7f4afed74700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af81378b0 con 0x7f4af80ad070 2023-10-08T16:04:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.943+0000 7f4afed74700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af814dba0 con 0x7f4af80af820 2023-10-08T16:04:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.943+0000 7f4afed74700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af81370a0 con 0x7f4af813b7d0 2023-10-08T16:04:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.943+0000 7f4afdd72700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af80ad070 0x7f4af814dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.943+0000 7f4afdd72700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af80ad070 0x7f4af814dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43110/0 (socket says 172.21.15.133:43110) 2023-10-08T16:04:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.943+0000 7f4afdd72700 1 -- 172.21.15.133:0/4241669744 learned_addr learned my addr 172.21.15.133:0/4241669744 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.943+0000 7f4afd571700 1 --2- 172.21.15.133:0/4241669744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4af80af820 0x7f4af814e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.943+0000 7f4afdd72700 1 -- 172.21.15.133:0/4241669744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4af813b7d0 msgr2=0x7f4af806e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.943+0000 7f4afe573700 1 --2- 172.21.15.133:0/4241669744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4af813b7d0 0x7f4af806e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.943+0000 7f4afdd72700 1 --2- 172.21.15.133:0/4241669744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4af813b7d0 0x7f4af806e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.943+0000 7f4afdd72700 1 -- 172.21.15.133:0/4241669744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4af80af820 msgr2=0x7f4af814e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:24.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.943+0000 7f4afdd72700 1 --2- 172.21.15.133:0/4241669744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4af80af820 0x7f4af814e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:24.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.943+0000 7f4afdd72700 1 -- 172.21.15.133:0/4241669744 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af0009a20 con 0x7f4af80ad070 2023-10-08T16:04:24.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.943+0000 7f4afd571700 1 --2- 172.21.15.133:0/4241669744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4af80af820 0x7f4af814e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:04:24.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.943+0000 7f4afe573700 1 --2- 172.21.15.133:0/4241669744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4af813b7d0 0x7f4af806e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:04:24.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.943+0000 7f4afdd72700 1 --2- 172.21.15.133:0/4241669744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af80ad070 0x7f4af814dff0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4af400ec80 tx=0x7f4af40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:24.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.943+0000 7f4ae9ffb700 1 -- 172.21.15.133:0/4241669744 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af400c9d0 con 0x7f4af80ad070 2023-10-08T16:04:24.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.943+0000 7f4ae9ffb700 1 -- 172.21.15.133:0/4241669744 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af400cb30 con 0x7f4af80ad070 2023-10-08T16:04:24.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.943+0000 7f4afed74700 1 -- 172.21.15.133:0/4241669744 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af806cc10 con 0x7f4af80ad070 2023-10-08T16:04:24.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.943+0000 7f4ae9ffb700 1 -- 172.21.15.133:0/4241669744 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af4013470 con 0x7f4af80ad070 2023-10-08T16:04:24.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.943+0000 7f4afed74700 1 -- 172.21.15.133:0/4241669744 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af806c730 con 0x7f4af80ad070 2023-10-08T16:04:24.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.947+0000 7f4afed74700 1 -- 172.21.15.133:0/4241669744 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af8137400 con 0x7f4af80ad070 2023-10-08T16:04:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.947+0000 7f4ae9ffb700 1 -- 172.21.15.133:0/4241669744 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4af4013820 con 0x7f4af80ad070 2023-10-08T16:04:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.947+0000 7f4ae9ffb700 1 --2- 172.21.15.133:0/4241669744 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f4adc060550 0x7f4adc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.947+0000 7f4ae9ffb700 1 -- 172.21.15.133:0/4241669744 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4af407ca90 con 0x7f4af80ad070 2023-10-08T16:04:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.947+0000 7f4afd571700 1 --2- 172.21.15.133:0/4241669744 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f4adc060550 0x7f4adc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.947+0000 7f4afd571700 1 --2- 172.21.15.133:0/4241669744 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f4adc060550 0x7f4adc062a00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4af813ebd0 tx=0x7f4aec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:24.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:24.955+0000 7f4ae9ffb700 1 -- 172.21.15.133:0/4241669744 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4af404d080 con 0x7f4af80ad070 2023-10-08T16:04:25.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.131+0000 7f4afed74700 1 -- 172.21.15.133:0/4241669744 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4af81371e0 con 0x7f4af80ad070 2023-10-08T16:04:25.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.135+0000 7f4ae9ffb700 1 -- 172.21.15.133:0/4241669744 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4af40506a0 con 0x7f4af80ad070 2023-10-08T16:04:25.137 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:04:25.137 INFO:teuthology.orchestra.run.smithi133.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-08T16:04:25.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.139+0000 7f4afed74700 1 -- 172.21.15.133:0/4241669744 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f4adc060550 msgr2=0x7f4adc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:25.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.139+0000 7f4afed74700 1 --2- 172.21.15.133:0/4241669744 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f4adc060550 0x7f4adc062a00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4af813ebd0 tx=0x7f4aec009040 comp rx=0 tx=0).stop 2023-10-08T16:04:25.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.139+0000 7f4afed74700 1 -- 172.21.15.133:0/4241669744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af80ad070 msgr2=0x7f4af814dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:25.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.139+0000 7f4afed74700 1 --2- 172.21.15.133:0/4241669744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af80ad070 0x7f4af814dff0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4af400ec80 tx=0x7f4af40091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.139+0000 7f4afed74700 1 -- 172.21.15.133:0/4241669744 shutdown_connections 2023-10-08T16:04:25.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.139+0000 7f4afed74700 1 --2- 172.21.15.133:0/4241669744 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f4adc060550 0x7f4adc062a00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.139+0000 7f4afed74700 1 --2- 172.21.15.133:0/4241669744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4af813b7d0 0x7f4af806e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.139+0000 7f4afed74700 1 --2- 172.21.15.133:0/4241669744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4af80af820 0x7f4af814e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.139+0000 7f4afed74700 1 --2- 172.21.15.133:0/4241669744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af80ad070 0x7f4af814dff0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.139+0000 7f4afed74700 1 -- 172.21.15.133:0/4241669744 >> 172.21.15.133:0/4241669744 conn(0x7f4af8062ba0 msgr2=0x7f4af8139ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:25.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.139+0000 7f4afed74700 1 -- 172.21.15.133:0/4241669744 shutdown_connections 2023-10-08T16:04:25.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.139+0000 7f4afed74700 1 -- 172.21.15.133:0/4241669744 wait complete. 2023-10-08T16:04:25.155 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-08T16:04:25.155 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:04:25.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffabe2c7700 1 Processor -- start 2023-10-08T16:04:25.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffabe2c7700 1 -- start start 2023-10-08T16:04:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffabe2c7700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffab80ae180 0x7ffab81524f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffabe2c7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab8068a90 con 0x7ffab80b0030 2023-10-08T16:04:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffabe2c7700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab80b0ec0 con 0x7ffab80b1dc0 2023-10-08T16:04:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffabe2c7700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab80ad4f0 con 0x7ffab80ae180 2023-10-08T16:04:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffabcac4700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ffab80b0030 0x7ffab8068380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49488/0 (socket says 172.21.15.133:49488) 2023-10-08T16:04:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffabcac4700 1 -- 172.21.15.133:0/2036323479 learned_addr learned my addr 172.21.15.133:0/2036323479 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffabdac6700 1 --2- 172.21.15.133:0/2036323479 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffab80ae180 0x7ffab81524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffaaffff700 1 -- 172.21.15.133:0/2036323479 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 111561105 0 0) 0x7ffab8068a90 con 0x7ffab80b0030 2023-10-08T16:04:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffaaffff700 1 -- 172.21.15.133:0/2036323479 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffaa4003570 con 0x7ffab80b0030 2023-10-08T16:04:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffaaffff700 1 -- 172.21.15.133:0/2036323479 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1222800056 0 0) 0x7ffaa4003570 con 0x7ffab80b0030 2023-10-08T16:04:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffaaffff700 1 -- 172.21.15.133:0/2036323479 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffab80ae180 msgr2=0x7ffab81524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffaaffff700 1 --2- 172.21.15.133:0/2036323479 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffab80ae180 0x7ffab81524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffaaffff700 1 -- 172.21.15.133:0/2036323479 >> v1:172.21.15.190:6789/0 conn(0x7ffab80b1dc0 legacy=0x7ffab8067c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffaaffff700 1 -- 172.21.15.133:0/2036323479 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab80ac250 con 0x7ffab80b0030 2023-10-08T16:04:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffaaffff700 1 -- 172.21.15.133:0/2036323479 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2883817959 0 0) 0x7ffab00017f0 con 0x7ffab80b0030 2023-10-08T16:04:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffaaffff700 1 -- 172.21.15.133:0/2036323479 >> v1:172.21.15.133:6789/0 conn(0x7ffab80b0030 legacy=0x7ffab8068380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffaaffff700 1 --2- 172.21.15.133:0/2036323479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffaa4003a90 0x7ffaa4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffaaffff700 1 --2- 172.21.15.133:0/2036323479 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffab80ae180 0x7ffaa4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffaaffff700 1 --2- 172.21.15.133:0/2036323479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffaa4004d50 0x7ffaa40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffaaffff700 1 -- 172.21.15.133:0/2036323479 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab80ad4f0 con 0x7ffaa4004d50 2023-10-08T16:04:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffaaffff700 1 -- 172.21.15.133:0/2036323479 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa400bba0 con 0x7ffaa4003a90 2023-10-08T16:04:25.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffaaffff700 1 -- 172.21.15.133:0/2036323479 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa400bd60 con 0x7ffab80ae180 2023-10-08T16:04:25.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffabdac6700 1 --2- 172.21.15.133:0/2036323479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffaa4004d50 0x7ffaa40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:25.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffabcac4700 1 --2- 172.21.15.133:0/2036323479 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffab80ae180 0x7ffaa4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:25.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffabd2c5700 1 --2- 172.21.15.133:0/2036323479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffaa4003a90 0x7ffaa4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:25.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffabdac6700 1 -- 172.21.15.133:0/2036323479 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffab80ae180 msgr2=0x7ffaa4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:25.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffabdac6700 1 --2- 172.21.15.133:0/2036323479 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffab80ae180 0x7ffaa4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffabdac6700 1 -- 172.21.15.133:0/2036323479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffaa4003a90 msgr2=0x7ffaa4003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:25.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffabdac6700 1 --2- 172.21.15.133:0/2036323479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffaa4003a90 0x7ffaa4003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffabdac6700 1 -- 172.21.15.133:0/2036323479 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa4003570 con 0x7ffaa4004d50 2023-10-08T16:04:25.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffabd2c5700 1 --2- 172.21.15.133:0/2036323479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffaa4003a90 0x7ffaa4003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:25.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffabdac6700 1 --2- 172.21.15.133:0/2036323479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffaa4004d50 0x7ffaa40051c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8009c00 tx=0x7ffaa80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403dd3a1352bd808 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:25.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffaaffff700 1 -- 172.21.15.133:0/2036323479 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa800e710 con 0x7ffaa4004d50 2023-10-08T16:04:25.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffaaffff700 1 -- 172.21.15.133:0/2036323479 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa800e870 con 0x7ffaa4004d50 2023-10-08T16:04:25.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffaaffff700 1 -- 172.21.15.133:0/2036323479 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa800ec30 con 0x7ffaa4004d50 2023-10-08T16:04:25.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.255+0000 7ffabe2c7700 1 -- 172.21.15.133:0/2036323479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffaa4004d50 msgr2=0x7ffaa40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:25.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabe2c7700 1 --2- 172.21.15.133:0/2036323479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffaa4004d50 0x7ffaa40051c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8009c00 tx=0x7ffaa80091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabdac6700 1 -- 172.21.15.133:0/2036323479 reap_dead start 2023-10-08T16:04:25.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabe2c7700 1 -- 172.21.15.133:0/2036323479 shutdown_connections 2023-10-08T16:04:25.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabe2c7700 1 -- 172.21.15.133:0/2036323479 >> 172.21.15.133:0/2036323479 conn(0x7ffab8063670 msgr2=0x7ffab80b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:25.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabe2c7700 1 -- 172.21.15.133:0/2036323479 shutdown_connections 2023-10-08T16:04:25.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabe2c7700 1 -- 172.21.15.133:0/2036323479 wait complete. 2023-10-08T16:04:25.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabe2c7700 1 Processor -- start 2023-10-08T16:04:25.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabe2c7700 1 -- start start 2023-10-08T16:04:25.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabe2c7700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffab80b4d80 0x7ffab81417f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:25.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabe2c7700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffab80b3e00 0x7ffab8141d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:25.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabe2c7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffab8139670 0x7ffab8139b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:25.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabe2c7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab8141360 con 0x7ffab8139670 2023-10-08T16:04:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabe2c7700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab80b4350 con 0x7ffab80b3e00 2023-10-08T16:04:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabe2c7700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab813eae0 con 0x7ffab80b4d80 2023-10-08T16:04:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabdac6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffab8139670 0x7ffab8139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabdac6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffab8139670 0x7ffab8139b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43132/0 (socket says 172.21.15.133:43132) 2023-10-08T16:04:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabdac6700 1 -- 172.21.15.133:0/4100564289 learned_addr learned my addr 172.21.15.133:0/4100564289 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabd2c5700 1 --2- 172.21.15.133:0/4100564289 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffab80b4d80 0x7ffab81417f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabcac4700 1 --2- 172.21.15.133:0/4100564289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffab80b3e00 0x7ffab8141d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabdac6700 1 -- 172.21.15.133:0/4100564289 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffab80b4d80 msgr2=0x7ffab81417f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabdac6700 1 --2- 172.21.15.133:0/4100564289 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffab80b4d80 0x7ffab81417f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabdac6700 1 -- 172.21.15.133:0/4100564289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffab80b3e00 msgr2=0x7ffab8141d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabdac6700 1 --2- 172.21.15.133:0/4100564289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffab80b3e00 0x7ffab8141d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabdac6700 1 -- 172.21.15.133:0/4100564289 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab80b5150 con 0x7ffab8139670 2023-10-08T16:04:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabdac6700 1 --2- 172.21.15.133:0/4100564289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffab8139670 0x7ffab8139b10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8001eb0 tx=0x7ffaa801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffaad7fa700 1 -- 172.21.15.133:0/4100564289 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8022070 con 0x7ffab8139670 2023-10-08T16:04:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffaad7fa700 1 -- 172.21.15.133:0/4100564289 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa800ebf0 con 0x7ffab8139670 2023-10-08T16:04:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabe2c7700 1 -- 172.21.15.133:0/4100564289 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab813a050 con 0x7ffab8139670 2023-10-08T16:04:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffaad7fa700 1 -- 172.21.15.133:0/4100564289 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa800e710 con 0x7ffab8139670 2023-10-08T16:04:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabe2c7700 1 -- 172.21.15.133:0/4100564289 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab813dc80 con 0x7ffab8139670 2023-10-08T16:04:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.259+0000 7ffabe2c7700 1 -- 172.21.15.133:0/4100564289 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab813de70 con 0x7ffab8139670 2023-10-08T16:04:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.263+0000 7ffaad7fa700 1 -- 172.21.15.133:0/4100564289 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ffaa801c930 con 0x7ffab8139670 2023-10-08T16:04:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.263+0000 7ffaad7fa700 1 --2- 172.21.15.133:0/4100564289 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ffa9c060550 0x7ffa9c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.263+0000 7ffabd2c5700 1 --2- 172.21.15.133:0/4100564289 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ffa9c060550 0x7ffa9c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.263+0000 7ffaad7fa700 1 -- 172.21.15.133:0/4100564289 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffaa807de10 con 0x7ffab8139670 2023-10-08T16:04:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.263+0000 7ffabd2c5700 1 --2- 172.21.15.133:0/4100564289 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ffa9c060550 0x7ffa9c062a00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffab4003a00 tx=0x7ffab400c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:25.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.267+0000 7ffaad7fa700 1 -- 172.21.15.133:0/4100564289 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ffaa804e400 con 0x7ffab8139670 2023-10-08T16:04:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.427+0000 7ffabe2c7700 1 -- 172.21.15.133:0/4100564289 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffab813e940 con 0x7ffab8139670 2023-10-08T16:04:25.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.427+0000 7ffaad7fa700 1 -- 172.21.15.133:0/4100564289 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7ffab813e940 con 0x7ffab8139670 2023-10-08T16:04:25.432 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:04:25.432 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"f2546191-d59e-4805-8e1b-3d8d3d1dad86","created":"2023-10-08T16:03:52.631855+0000","modified":"2023-10-08T16:04:18.600728+0000","last_up_change":"2023-10-08T16:04:04.030581+0000","last_in_change":"2023-10-08T16:03:54.835293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:04.898316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:14.869859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:15.983795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8c5deadf-a203-4d30-aa7f-6e2e492b6ffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6809","nonce":33493},{"type":"v1","addr":"172.21.15.133:6811","nonce":33493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":33493},{"type":"v1","addr":"172.21.15.133:6815","nonce":33493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":33493},{"type":"v1","addr":"172.21.15.133:6822","nonce":33493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":33493},{"type":"v1","addr":"172.21.15.133:6818","nonce":33493}]},"public_addr":"172.21.15.133:6811/33493","cluster_addr":"172.21.15.133:6815/33493","heartbeat_back_addr":"172.21.15.133:6822/33493","heartbeat_front_addr":"172.21.15.133:6818/33493","state":["exists","up"]},{"osd":1,"uuid":"9b081c42-c915-48c3-a1ad-410f09a78576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":33490},{"type":"v1","addr":"172.21.15.133:6801","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":33490},{"type":"v1","addr":"172.21.15.133:6803","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":33490},{"type":"v1","addr":"172.21.15.133:6807","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":33490},{"type":"v1","addr":"172.21.15.133:6805","nonce":33490}]},"public_addr":"172.21.15.133:6801/33490","cluster_addr":"172.21.15.133:6803/33490","heartbeat_back_addr":"172.21.15.133:6807/33490","heartbeat_front_addr":"172.21.15.133:6805/33490","state":["exists","up"]},{"osd":2,"uuid":"88ecda43-01cd-4644-ab0c-92c91fd38966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":33492},{"type":"v1","addr":"172.21.15.133:6825","nonce":33492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":33492},{"type":"v1","addr":"172.21.15.133:6827","nonce":33492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":33492},{"type":"v1","addr":"172.21.15.133:6831","nonce":33492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":33492},{"type":"v1","addr":"172.21.15.133:6829","nonce":33492}]},"public_addr":"172.21.15.133:6825/33492","cluster_addr":"172.21.15.133:6827/33492","heartbeat_back_addr":"172.21.15.133:6831/33492","heartbeat_front_addr":"172.21.15.133:6829/33492","state":["exists","up"]},{"osd":3,"uuid":"39faf38d-b8e2-4e11-9b3b-84dc834c977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":33491},{"type":"v1","addr":"172.21.15.133:6810","nonce":33491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":33491},{"type":"v1","addr":"172.21.15.133:6814","nonce":33491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":33491},{"type":"v1","addr":"172.21.15.133:6823","nonce":33491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":33491},{"type":"v1","addr":"172.21.15.133:6819","nonce":33491}]},"public_addr":"172.21.15.133:6810/33491","cluster_addr":"172.21.15.133:6814/33491","heartbeat_back_addr":"172.21.15.133:6823/33491","heartbeat_front_addr":"172.21.15.133:6819/33491","state":["exists","up"]},{"osd":4,"uuid":"4c097e61-1cad-4b61-9183-4e7bc486bd32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":33678},{"type":"v1","addr":"172.21.15.190:6810","nonce":33678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":33678},{"type":"v1","addr":"172.21.15.190:6814","nonce":33678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":33678},{"type":"v1","addr":"172.21.15.190:6822","nonce":33678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":33678},{"type":"v1","addr":"172.21.15.190:6818","nonce":33678}]},"public_addr":"172.21.15.190:6810/33678","cluster_addr":"172.21.15.190:6814/33678","heartbeat_back_addr":"172.21.15.190:6822/33678","heartbeat_front_addr":"172.21.15.190:6818/33678","state":["exists","up"]},{"osd":5,"uuid":"05f072e0-7bc0-40f0-8cb6-8e322c82d6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":33676},{"type":"v1","addr":"172.21.15.190:6811","nonce":33676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":33676},{"type":"v1","addr":"172.21.15.190:6815","nonce":33676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":33676},{"type":"v1","addr":"172.21.15.190:6823","nonce":33676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":33676},{"type":"v1","addr":"172.21.15.190:6819","nonce":33676}]},"public_addr":"172.21.15.190:6811/33676","cluster_addr":"172.21.15.190:6815/33676","heartbeat_back_addr":"172.21.15.190:6823/33676","heartbeat_front_addr":"172.21.15.190:6819/33676","state":["exists","up"]},{"osd":6,"uuid":"1bcce8d7-14f3-442d-b135-68c7d66cdedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":33677},{"type":"v1","addr":"172.21.15.190:6801","nonce":33677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":33677},{"type":"v1","addr":"172.21.15.190:6803","nonce":33677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":33677},{"type":"v1","addr":"172.21.15.190:6807","nonce":33677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":33677},{"type":"v1","addr":"172.21.15.190:6805","nonce":33677}]},"public_addr":"172.21.15.190:6801/33677","cluster_addr":"172.21.15.190:6803/33677","heartbeat_back_addr":"172.21.15.190:6807/33677","heartbeat_front_addr":"172.21.15.190:6805/33677","state":["exists","up"]},{"osd":7,"uuid":"9157dbf7-2bf9-43d7-a89a-a8e3dae7514c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":33686},{"type":"v1","addr":"172.21.15.190:6825","nonce":33686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":33686},{"type":"v1","addr":"172.21.15.190:6827","nonce":33686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":33686},{"type":"v1","addr":"172.21.15.190:6831","nonce":33686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":33686},{"type":"v1","addr":"172.21.15.190:6829","nonce":33686}]},"public_addr":"172.21.15.190:6825/33686","cluster_addr":"172.21.15.190:6827/33686","heartbeat_back_addr":"172.21.15.190:6831/33686","heartbeat_front_addr":"172.21.15.190:6829/33686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.886742+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.199618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.871695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.115926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.069650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.841448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.132320+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.315132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:04:25.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.431+0000 7ffabe2c7700 1 -- 172.21.15.133:0/4100564289 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ffa9c060550 msgr2=0x7ffa9c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:25.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.431+0000 7ffabe2c7700 1 --2- 172.21.15.133:0/4100564289 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ffa9c060550 0x7ffa9c062a00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffab4003a00 tx=0x7ffab400c040 comp rx=0 tx=0).stop 2023-10-08T16:04:25.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.431+0000 7ffabe2c7700 1 -- 172.21.15.133:0/4100564289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffab8139670 msgr2=0x7ffab8139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:25.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.431+0000 7ffabe2c7700 1 --2- 172.21.15.133:0/4100564289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffab8139670 0x7ffab8139b10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8001eb0 tx=0x7ffaa801a000 comp rx=0 tx=0).stop 2023-10-08T16:04:25.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.431+0000 7ffabe2c7700 1 -- 172.21.15.133:0/4100564289 shutdown_connections 2023-10-08T16:04:25.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.431+0000 7ffabe2c7700 1 --2- 172.21.15.133:0/4100564289 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ffa9c060550 0x7ffa9c062a00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.431+0000 7ffabe2c7700 1 --2- 172.21.15.133:0/4100564289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffab8139670 0x7ffab8139b10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.431+0000 7ffabe2c7700 1 --2- 172.21.15.133:0/4100564289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffab80b3e00 0x7ffab8141d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.431+0000 7ffabe2c7700 1 --2- 172.21.15.133:0/4100564289 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffab80b4d80 0x7ffab81417f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.431+0000 7ffabe2c7700 1 -- 172.21.15.133:0/4100564289 >> 172.21.15.133:0/4100564289 conn(0x7ffab8063670 msgr2=0x7ffab806fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:25.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.431+0000 7ffabe2c7700 1 -- 172.21.15.133:0/4100564289 shutdown_connections 2023-10-08T16:04:25.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.431+0000 7ffabe2c7700 1 -- 172.21.15.133:0/4100564289 wait complete. 2023-10-08T16:04:25.446 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:04.898316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:04:14.869859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:04:15.983795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:04:25.446 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:04:25.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.555+0000 7ff89bfff700 1 Processor -- start 2023-10-08T16:04:25.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.555+0000 7ff89bfff700 1 -- start start 2023-10-08T16:04:25.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.555+0000 7ff89bfff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff89c0b51a0 0x7ff89c143e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:25.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.555+0000 7ff89bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff89c0ab830 0x7ff89c140900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:25.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.555+0000 7ff89bfff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff89c1412c0 con 0x7ff89c140e40 2023-10-08T16:04:25.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.555+0000 7ff89bfff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff89c06b540 con 0x7ff89c0ab830 2023-10-08T16:04:25.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.555+0000 7ff89bfff700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c144460 con 0x7ff89c0b51a0 2023-10-08T16:04:25.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.555+0000 7ff89b7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff89c140e40 0x7ff89c06e020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49500/0 (socket says 172.21.15.133:49500) 2023-10-08T16:04:25.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.555+0000 7ff89a7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff89c0ab830 0x7ff89c140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:25.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.555+0000 7ff89b7fe700 1 -- 172.21.15.133:0/1948121274 learned_addr learned my addr 172.21.15.133:0/1948121274 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:25.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.555+0000 7ff89affd700 1 --2- 172.21.15.133:0/1948121274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff89c0b51a0 0x7ff89c143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:25.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.555+0000 7ff89a7fc700 1 -- 172.21.15.133:0/1948121274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff89c0b51a0 msgr2=0x7ff89c143e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:25.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.555+0000 7ff89a7fc700 1 --2- 172.21.15.133:0/1948121274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff89c0b51a0 0x7ff89c143e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.555+0000 7ff89a7fc700 1 -- 172.21.15.133:0/1948121274 >> v1:172.21.15.133:6789/0 conn(0x7ff89c140e40 legacy=0x7ff89c06e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:25.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.555+0000 7ff89a7fc700 1 -- 172.21.15.133:0/1948121274 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff89c144740 con 0x7ff89c0ab830 2023-10-08T16:04:25.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.555+0000 7ff89a7fc700 1 --2- 172.21.15.133:0/1948121274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff89c0ab830 0x7ff89c140900 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff8840098e0 tx=0x7ff8840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33e37bb06848849 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:25.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.555+0000 7ff899ffb700 1 -- 172.21.15.133:0/1948121274 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88400b640 con 0x7ff89c0ab830 2023-10-08T16:04:25.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.555+0000 7ff899ffb700 1 -- 172.21.15.133:0/1948121274 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88400b7a0 con 0x7ff89c0ab830 2023-10-08T16:04:25.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.555+0000 7ff899ffb700 1 -- 172.21.15.133:0/1948121274 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88400bb40 con 0x7ff89c0ab830 2023-10-08T16:04:25.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89bfff700 1 -- 172.21.15.133:0/1948121274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff89c0ab830 msgr2=0x7ff89c140900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:25.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89bfff700 1 --2- 172.21.15.133:0/1948121274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff89c0ab830 0x7ff89c140900 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff8840098e0 tx=0x7ff8840091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89bfff700 1 -- 172.21.15.133:0/1948121274 shutdown_connections 2023-10-08T16:04:25.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89bfff700 1 --2- 172.21.15.133:0/1948121274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff89c0ab830 0x7ff89c140900 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89bfff700 1 --2- 172.21.15.133:0/1948121274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff89c0b51a0 0x7ff89c143e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89bfff700 1 -- 172.21.15.133:0/1948121274 >> 172.21.15.133:0/1948121274 conn(0x7ff89c068420 msgr2=0x7ff89c070830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:25.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89bfff700 1 -- 172.21.15.133:0/1948121274 shutdown_connections 2023-10-08T16:04:25.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89bfff700 1 -- 172.21.15.133:0/1948121274 wait complete. 2023-10-08T16:04:25.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89bfff700 1 Processor -- start 2023-10-08T16:04:25.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89bfff700 1 -- start start 2023-10-08T16:04:25.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89bfff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff89c0ab830 0x7ff89c0b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:25.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff89c0b51a0 0x7ff89c142f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:25.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89bfff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff89c140e40 0x7ff89c1387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:25.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89bfff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c13ce70 con 0x7ff89c0b51a0 2023-10-08T16:04:25.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89bfff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c0b40f0 con 0x7ff89c140e40 2023-10-08T16:04:25.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89bfff700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c1561c0 con 0x7ff89c0ab830 2023-10-08T16:04:25.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89a7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff89c0b51a0 0x7ff89c142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:25.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89a7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff89c0b51a0 0x7ff89c142f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43162/0 (socket says 172.21.15.133:43162) 2023-10-08T16:04:25.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89a7fc700 1 -- 172.21.15.133:0/772482913 learned_addr learned my addr 172.21.15.133:0/772482913 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:25.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89affd700 1 --2- 172.21.15.133:0/772482913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff89c0ab830 0x7ff89c0b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:25.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89b7fe700 1 --2- 172.21.15.133:0/772482913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff89c140e40 0x7ff89c1387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:25.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89a7fc700 1 -- 172.21.15.133:0/772482913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff89c0ab830 msgr2=0x7ff89c0b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:25.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89a7fc700 1 --2- 172.21.15.133:0/772482913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff89c0ab830 0x7ff89c0b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89a7fc700 1 -- 172.21.15.133:0/772482913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff89c140e40 msgr2=0x7ff89c1387d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:25.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89a7fc700 1 --2- 172.21.15.133:0/772482913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff89c140e40 0x7ff89c1387d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89a7fc700 1 -- 172.21.15.133:0/772482913 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff884009420 con 0x7ff89c0b51a0 2023-10-08T16:04:25.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.559+0000 7ff89b7fe700 1 --2- 172.21.15.133:0/772482913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff89c140e40 0x7ff89c1387d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:25.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.563+0000 7ff89a7fc700 1 --2- 172.21.15.133:0/772482913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff89c0b51a0 0x7ff89c142f20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff884009f80 tx=0x7ff884017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:25.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.563+0000 7ff892ffd700 1 -- 172.21.15.133:0/772482913 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88401bc10 con 0x7ff89c0b51a0 2023-10-08T16:04:25.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.563+0000 7ff892ffd700 1 -- 172.21.15.133:0/772482913 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88401bd70 con 0x7ff89c0b51a0 2023-10-08T16:04:25.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.563+0000 7ff89bfff700 1 -- 172.21.15.133:0/772482913 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff89c13b710 con 0x7ff89c0b51a0 2023-10-08T16:04:25.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.563+0000 7ff892ffd700 1 -- 172.21.15.133:0/772482913 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff884011670 con 0x7ff89c0b51a0 2023-10-08T16:04:25.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.563+0000 7ff89bfff700 1 -- 172.21.15.133:0/772482913 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89c13baa0 con 0x7ff89c0b51a0 2023-10-08T16:04:25.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.563+0000 7ff89bfff700 1 -- 172.21.15.133:0/772482913 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff89c0af190 con 0x7ff89c0b51a0 2023-10-08T16:04:25.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.563+0000 7ff892ffd700 1 -- 172.21.15.133:0/772482913 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff884011a20 con 0x7ff89c0b51a0 2023-10-08T16:04:25.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.563+0000 7ff892ffd700 1 --2- 172.21.15.133:0/772482913 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff87c060550 0x7ff87c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:25.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.563+0000 7ff89affd700 1 --2- 172.21.15.133:0/772482913 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff87c060550 0x7ff87c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:25.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.563+0000 7ff892ffd700 1 -- 172.21.15.133:0/772482913 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff88407dcc0 con 0x7ff89c0b51a0 2023-10-08T16:04:25.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.567+0000 7ff89affd700 1 --2- 172.21.15.133:0/772482913 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff87c060550 0x7ff87c062a00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff89c142870 tx=0x7ff8940091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:25.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.571+0000 7ff892ffd700 1 -- 172.21.15.133:0/772482913 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff89c0af190 con 0x7ff89c0b51a0 2023-10-08T16:04:25.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.739+0000 7ff89bfff700 1 -- 172.21.15.133:0/772482913 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff89c142c40 con 0x7ff89c0b51a0 2023-10-08T16:04:25.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.739+0000 7ff892ffd700 1 -- 172.21.15.133:0/772482913 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff89c142c40 con 0x7ff89c0b51a0 2023-10-08T16:04:25.742 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-10-08T16:04:25.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.739+0000 7ff89bfff700 1 -- 172.21.15.133:0/772482913 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff87c060550 msgr2=0x7ff87c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:25.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.739+0000 7ff89bfff700 1 --2- 172.21.15.133:0/772482913 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff87c060550 0x7ff87c062a00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff89c142870 tx=0x7ff8940091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.739+0000 7ff89bfff700 1 -- 172.21.15.133:0/772482913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff89c0b51a0 msgr2=0x7ff89c142f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:25.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.739+0000 7ff89bfff700 1 --2- 172.21.15.133:0/772482913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff89c0b51a0 0x7ff89c142f20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff884009f80 tx=0x7ff884017000 comp rx=0 tx=0).stop 2023-10-08T16:04:25.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.739+0000 7ff89bfff700 1 -- 172.21.15.133:0/772482913 shutdown_connections 2023-10-08T16:04:25.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.739+0000 7ff89bfff700 1 --2- 172.21.15.133:0/772482913 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff87c060550 0x7ff87c062a00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.739+0000 7ff89bfff700 1 --2- 172.21.15.133:0/772482913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff89c140e40 0x7ff89c1387d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.739+0000 7ff89bfff700 1 --2- 172.21.15.133:0/772482913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff89c0b51a0 0x7ff89c142f20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.739+0000 7ff89bfff700 1 --2- 172.21.15.133:0/772482913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff89c0ab830 0x7ff89c0b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.739+0000 7ff89bfff700 1 -- 172.21.15.133:0/772482913 >> 172.21.15.133:0/772482913 conn(0x7ff89c068420 msgr2=0x7ff89c062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:25.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.739+0000 7ff89bfff700 1 -- 172.21.15.133:0/772482913 shutdown_connections 2023-10-08T16:04:25.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.743+0000 7ff89bfff700 1 -- 172.21.15.133:0/772482913 wait complete. 2023-10-08T16:04:25.756 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:04:25.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.867+0000 7f789ac7e700 1 Processor -- start 2023-10-08T16:04:25.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.867+0000 7f789ac7e700 1 -- start start 2023-10-08T16:04:25.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.867+0000 7f789ac7e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7894070a60 0x7f78940b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:25.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.867+0000 7f789ac7e700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f78940b14e0 0x7f78940acd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:25.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.867+0000 7f789ac7e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78940ae320 con 0x7f78940ad840 2023-10-08T16:04:25.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.867+0000 7f789ac7e700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78940ae040 con 0x7f78940b14e0 2023-10-08T16:04:25.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.867+0000 7f789ac7e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78940af100 con 0x7f7894070a60 2023-10-08T16:04:25.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.867+0000 7f789947b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f78940ad840 0x7f78940ac620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49508/0 (socket says 172.21.15.133:49508) 2023-10-08T16:04:25.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.867+0000 7f789947b700 1 -- 172.21.15.133:0/2574632955 learned_addr learned my addr 172.21.15.133:0/2574632955 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:25.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f789a47d700 1 --2- 172.21.15.133:0/2574632955 >> v2:172.21.15.190:3300/0 conn(0x7f78940b14e0 0x7f78940acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:25.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f7899c7c700 1 --2- 172.21.15.133:0/2574632955 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7894070a60 0x7f78940b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:25.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f7898c7a700 1 -- 172.21.15.133:0/2574632955 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2239604677 0 0) 0x7f78940ae320 con 0x7f78940ad840 2023-10-08T16:04:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f7898c7a700 1 -- 172.21.15.133:0/2574632955 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7880003570 con 0x7f78940ad840 2023-10-08T16:04:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f789a47d700 1 -- 172.21.15.133:0/2574632955 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7894070a60 msgr2=0x7f78940b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f789a47d700 1 --2- 172.21.15.133:0/2574632955 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7894070a60 0x7f78940b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f789a47d700 1 -- 172.21.15.133:0/2574632955 >> v1:172.21.15.133:6789/0 conn(0x7f78940ad840 legacy=0x7f78940ac620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f789a47d700 1 -- 172.21.15.133:0/2574632955 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78940b1940 con 0x7f78940b14e0 2023-10-08T16:04:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f789a47d700 1 --2- 172.21.15.133:0/2574632955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78940b14e0 0x7f78940acd30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f788c009e60 tx=0x7f788c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31c0295a36b5b858 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f7898c7a700 1 -- 172.21.15.133:0/2574632955 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c00e070 con 0x7f78940b14e0 2023-10-08T16:04:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f7898c7a700 1 -- 172.21.15.133:0/2574632955 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788c00bb40 con 0x7f78940b14e0 2023-10-08T16:04:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f7898c7a700 1 -- 172.21.15.133:0/2574632955 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c012430 con 0x7f78940b14e0 2023-10-08T16:04:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f789ac7e700 1 -- 172.21.15.133:0/2574632955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78940b14e0 msgr2=0x7f78940acd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f789ac7e700 1 --2- 172.21.15.133:0/2574632955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78940b14e0 0x7f78940acd30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f788c009e60 tx=0x7f788c009780 comp rx=0 tx=0).stop 2023-10-08T16:04:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f789ac7e700 1 -- 172.21.15.133:0/2574632955 shutdown_connections 2023-10-08T16:04:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f789ac7e700 1 --2- 172.21.15.133:0/2574632955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78940b14e0 0x7f78940acd30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f789ac7e700 1 --2- 172.21.15.133:0/2574632955 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7894070a60 0x7f78940b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f789ac7e700 1 -- 172.21.15.133:0/2574632955 >> 172.21.15.133:0/2574632955 conn(0x7f7894067a60 msgr2=0x7f78940b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f789ac7e700 1 -- 172.21.15.133:0/2574632955 shutdown_connections 2023-10-08T16:04:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f789ac7e700 1 -- 172.21.15.133:0/2574632955 wait complete. 2023-10-08T16:04:25.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f789ac7e700 1 Processor -- start 2023-10-08T16:04:25.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f789ac7e700 1 -- start start 2023-10-08T16:04:25.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f789ac7e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7894070a60 0x7f78940a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:25.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f789ac7e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78940ad840 0x7f78941516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:25.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f789ac7e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78940b14e0 0x7f7894151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:25.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f789ac7e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78940aa3d0 con 0x7f7894070a60 2023-10-08T16:04:25.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f789ac7e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7894142e70 con 0x7f78940ad840 2023-10-08T16:04:25.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.871+0000 7f789ac7e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7894143070 con 0x7f78940b14e0 2023-10-08T16:04:25.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.875+0000 7f7899c7c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7894070a60 0x7f78940a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:25.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.875+0000 7f7899c7c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7894070a60 0x7f78940a9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43174/0 (socket says 172.21.15.133:43174) 2023-10-08T16:04:25.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.875+0000 7f7899c7c700 1 -- 172.21.15.133:0/4119412612 learned_addr learned my addr 172.21.15.133:0/4119412612 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:25.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.875+0000 7f789a47d700 1 --2- 172.21.15.133:0/4119412612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78940b14e0 0x7f7894151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:25.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.875+0000 7f789947b700 1 --2- 172.21.15.133:0/4119412612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78940ad840 0x7f78941516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:25.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.875+0000 7f7899c7c700 1 -- 172.21.15.133:0/4119412612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78940b14e0 msgr2=0x7f7894151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:25.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.875+0000 7f7899c7c700 1 --2- 172.21.15.133:0/4119412612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78940b14e0 0x7f7894151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.875+0000 7f7899c7c700 1 -- 172.21.15.133:0/4119412612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78940ad840 msgr2=0x7f78941516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:25.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.875+0000 7f7899c7c700 1 --2- 172.21.15.133:0/4119412612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78940ad840 0x7f78941516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:25.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.875+0000 7f7899c7c700 1 -- 172.21.15.133:0/4119412612 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788c009a20 con 0x7f7894070a60 2023-10-08T16:04:25.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.875+0000 7f7899c7c700 1 --2- 172.21.15.133:0/4119412612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7894070a60 0x7f78940a9b00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f789000ec80 tx=0x7f78900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:25.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.875+0000 7f7889ffb700 1 -- 172.21.15.133:0/4119412612 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789000c850 con 0x7f7894070a60 2023-10-08T16:04:25.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.875+0000 7f7889ffb700 1 -- 172.21.15.133:0/4119412612 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789000c9b0 con 0x7f7894070a60 2023-10-08T16:04:25.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.875+0000 7f789ac7e700 1 -- 172.21.15.133:0/4119412612 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78940ab130 con 0x7f7894070a60 2023-10-08T16:04:25.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.875+0000 7f7889ffb700 1 -- 172.21.15.133:0/4119412612 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789000cd50 con 0x7f7894070a60 2023-10-08T16:04:25.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.875+0000 7f789ac7e700 1 -- 172.21.15.133:0/4119412612 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78940aa040 con 0x7f7894070a60 2023-10-08T16:04:25.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.875+0000 7f789ac7e700 1 -- 172.21.15.133:0/4119412612 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78940ab5b0 con 0x7f7894070a60 2023-10-08T16:04:25.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.879+0000 7f7889ffb700 1 -- 172.21.15.133:0/4119412612 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7890013680 con 0x7f7894070a60 2023-10-08T16:04:25.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.879+0000 7f7889ffb700 1 --2- 172.21.15.133:0/4119412612 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f7878060550 0x7f7878062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:25.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.879+0000 7f789947b700 1 --2- 172.21.15.133:0/4119412612 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f7878060550 0x7f7878062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:25.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.879+0000 7f7889ffb700 1 -- 172.21.15.133:0/4119412612 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f789007c9c0 con 0x7f7894070a60 2023-10-08T16:04:25.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.879+0000 7f789947b700 1 --2- 172.21.15.133:0/4119412612 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f7878060550 0x7f7878062a00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f789406f040 tx=0x7f7884009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:25.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:25.883+0000 7f7889ffb700 1 -- 172.21.15.133:0/4119412612 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f789004cfb0 con 0x7f7894070a60 2023-10-08T16:04:26.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.031+0000 7f789ac7e700 1 -- 172.21.15.133:0/4119412612 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f789404be40 con 0x7f7894070a60 2023-10-08T16:04:26.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.031+0000 7f7889ffb700 1 -- 172.21.15.133:0/4119412612 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f78900505d0 con 0x7f7894070a60 2023-10-08T16:04:26.035 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-10-08T16:04:26.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.035+0000 7f789ac7e700 1 -- 172.21.15.133:0/4119412612 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f7878060550 msgr2=0x7f7878062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:26.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.035+0000 7f789ac7e700 1 --2- 172.21.15.133:0/4119412612 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f7878060550 0x7f7878062a00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f789406f040 tx=0x7f7884009040 comp rx=0 tx=0).stop 2023-10-08T16:04:26.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.035+0000 7f789ac7e700 1 -- 172.21.15.133:0/4119412612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7894070a60 msgr2=0x7f78940a9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:26.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.035+0000 7f789ac7e700 1 --2- 172.21.15.133:0/4119412612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7894070a60 0x7f78940a9b00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f789000ec80 tx=0x7f78900091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.035+0000 7f789ac7e700 1 -- 172.21.15.133:0/4119412612 shutdown_connections 2023-10-08T16:04:26.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.035+0000 7f789ac7e700 1 --2- 172.21.15.133:0/4119412612 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f7878060550 0x7f7878062a00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.035+0000 7f789ac7e700 1 --2- 172.21.15.133:0/4119412612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78940b14e0 0x7f7894151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.035+0000 7f789ac7e700 1 --2- 172.21.15.133:0/4119412612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78940ad840 0x7f78941516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.035+0000 7f789ac7e700 1 --2- 172.21.15.133:0/4119412612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7894070a60 0x7f78940a9b00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.035+0000 7f789ac7e700 1 -- 172.21.15.133:0/4119412612 >> 172.21.15.133:0/4119412612 conn(0x7f7894067a60 msgr2=0x7f78940b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:26.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.035+0000 7f789ac7e700 1 -- 172.21.15.133:0/4119412612 shutdown_connections 2023-10-08T16:04:26.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.035+0000 7f789ac7e700 1 -- 172.21.15.133:0/4119412612 wait complete. 2023-10-08T16:04:26.048 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:04:26.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.155+0000 7eff5ab7a700 1 Processor -- start 2023-10-08T16:04:26.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.155+0000 7eff5ab7a700 1 -- start start 2023-10-08T16:04:26.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.155+0000 7eff5ab7a700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff54070830 0x7eff540aa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:26.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.155+0000 7eff5ab7a700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7eff540b1740 0x7eff54142510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:26.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.155+0000 7eff5ab7a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff540ac150 con 0x7eff54070c00 2023-10-08T16:04:26.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.155+0000 7eff5ab7a700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff540aa930 con 0x7eff540b1740 2023-10-08T16:04:26.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.155+0000 7eff5ab7a700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff540ab580 con 0x7eff54070830 2023-10-08T16:04:26.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.155+0000 7eff59377700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7eff54070c00 0x7eff5413c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49516/0 (socket says 172.21.15.133:49516) 2023-10-08T16:04:26.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.155+0000 7eff59377700 1 -- 172.21.15.133:0/3606600003 learned_addr learned my addr 172.21.15.133:0/3606600003 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:26.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.155+0000 7eff5a379700 1 --2- 172.21.15.133:0/3606600003 >> v2:172.21.15.190:3300/0 conn(0x7eff540b1740 0x7eff54142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:26.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.155+0000 7eff59b78700 1 --2- 172.21.15.133:0/3606600003 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff54070830 0x7eff540aa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:26.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff58b76700 1 -- 172.21.15.133:0/3606600003 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 23012252 0 0) 0x7eff540ac150 con 0x7eff54070c00 2023-10-08T16:04:26.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff58b76700 1 -- 172.21.15.133:0/3606600003 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff40003570 con 0x7eff54070c00 2023-10-08T16:04:26.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff5a379700 1 -- 172.21.15.133:0/3606600003 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff54070830 msgr2=0x7eff540aa1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:26.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff5a379700 1 --2- 172.21.15.133:0/3606600003 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff54070830 0x7eff540aa1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff5a379700 1 -- 172.21.15.133:0/3606600003 >> v1:172.21.15.133:6789/0 conn(0x7eff54070c00 legacy=0x7eff5413c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:26.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff5a379700 1 -- 172.21.15.133:0/3606600003 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff540abb40 con 0x7eff540b1740 2023-10-08T16:04:26.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff59b78700 1 --2- 172.21.15.133:0/3606600003 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff54070830 0x7eff540aa1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:04:26.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff5a379700 1 --2- 172.21.15.133:0/3606600003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff540b1740 0x7eff54142510 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7eff4c009e60 tx=0x7eff4c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8b32a66f27fb102 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:26.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff58b76700 1 -- 172.21.15.133:0/3606600003 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c00e070 con 0x7eff540b1740 2023-10-08T16:04:26.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff58b76700 1 -- 172.21.15.133:0/3606600003 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4c00bab0 con 0x7eff540b1740 2023-10-08T16:04:26.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff58b76700 1 -- 172.21.15.133:0/3606600003 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c00be50 con 0x7eff540b1740 2023-10-08T16:04:26.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff5ab7a700 1 -- 172.21.15.133:0/3606600003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff540b1740 msgr2=0x7eff54142510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:26.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff5ab7a700 1 --2- 172.21.15.133:0/3606600003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff540b1740 0x7eff54142510 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7eff4c009e60 tx=0x7eff4c009780 comp rx=0 tx=0).stop 2023-10-08T16:04:26.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff5ab7a700 1 -- 172.21.15.133:0/3606600003 shutdown_connections 2023-10-08T16:04:26.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff5ab7a700 1 --2- 172.21.15.133:0/3606600003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff540b1740 0x7eff54142510 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff5ab7a700 1 --2- 172.21.15.133:0/3606600003 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff54070830 0x7eff540aa1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff5ab7a700 1 -- 172.21.15.133:0/3606600003 >> 172.21.15.133:0/3606600003 conn(0x7eff54067a60 msgr2=0x7eff540b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:26.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff5ab7a700 1 -- 172.21.15.133:0/3606600003 shutdown_connections 2023-10-08T16:04:26.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff5ab7a700 1 -- 172.21.15.133:0/3606600003 wait complete. 2023-10-08T16:04:26.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff5ab7a700 1 Processor -- start 2023-10-08T16:04:26.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff5ab7a700 1 -- start start 2023-10-08T16:04:26.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff5ab7a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff54070830 0x7eff54144750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:26.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff5ab7a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff54070c00 0x7eff5413a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:26.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff5ab7a700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff540b1740 0x7eff5413a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:26.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff5ab7a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff540ad190 con 0x7eff54070830 2023-10-08T16:04:26.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff5ab7a700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff540ad400 con 0x7eff54070c00 2023-10-08T16:04:26.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff5ab7a700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff54155880 con 0x7eff540b1740 2023-10-08T16:04:26.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff59b78700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff54070830 0x7eff54144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:26.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff59b78700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff54070830 0x7eff54144750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43180/0 (socket says 172.21.15.133:43180) 2023-10-08T16:04:26.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.159+0000 7eff59b78700 1 -- 172.21.15.133:0/2064468319 learned_addr learned my addr 172.21.15.133:0/2064468319 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:26.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.163+0000 7eff59377700 1 --2- 172.21.15.133:0/2064468319 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff54070c00 0x7eff5413a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:26.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.163+0000 7eff5a379700 1 --2- 172.21.15.133:0/2064468319 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff540b1740 0x7eff5413a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:26.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.163+0000 7eff59b78700 1 -- 172.21.15.133:0/2064468319 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff540b1740 msgr2=0x7eff5413a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:26.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.163+0000 7eff59b78700 1 --2- 172.21.15.133:0/2064468319 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff540b1740 0x7eff5413a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.163+0000 7eff59b78700 1 -- 172.21.15.133:0/2064468319 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff54070c00 msgr2=0x7eff5413a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:26.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.163+0000 7eff59b78700 1 --2- 172.21.15.133:0/2064468319 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff54070c00 0x7eff5413a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.163+0000 7eff59b78700 1 -- 172.21.15.133:0/2064468319 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff50009420 con 0x7eff54070830 2023-10-08T16:04:26.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.163+0000 7eff59377700 1 --2- 172.21.15.133:0/2064468319 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff54070c00 0x7eff5413a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:04:26.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.163+0000 7eff59b78700 1 --2- 172.21.15.133:0/2064468319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff54070830 0x7eff54144750 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7eff5000ec80 tx=0x7eff500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:26.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.163+0000 7eff45ffb700 1 -- 172.21.15.133:0/2064468319 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5000c9d0 con 0x7eff54070830 2023-10-08T16:04:26.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.163+0000 7eff45ffb700 1 -- 172.21.15.133:0/2064468319 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5000cb30 con 0x7eff54070830 2023-10-08T16:04:26.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.163+0000 7eff5ab7a700 1 -- 172.21.15.133:0/2064468319 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff4c009a20 con 0x7eff54070830 2023-10-08T16:04:26.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.163+0000 7eff45ffb700 1 -- 172.21.15.133:0/2064468319 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5000ceb0 con 0x7eff54070830 2023-10-08T16:04:26.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.163+0000 7eff5ab7a700 1 -- 172.21.15.133:0/2064468319 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff540b4b10 con 0x7eff54070830 2023-10-08T16:04:26.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.163+0000 7eff5ab7a700 1 -- 172.21.15.133:0/2064468319 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff5404be40 con 0x7eff54070830 2023-10-08T16:04:26.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.163+0000 7eff45ffb700 1 -- 172.21.15.133:0/2064468319 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7eff50013680 con 0x7eff54070830 2023-10-08T16:04:26.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.163+0000 7eff45ffb700 1 --2- 172.21.15.133:0/2064468319 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7eff38060550 0x7eff38062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:26.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.163+0000 7eff45ffb700 1 -- 172.21.15.133:0/2064468319 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7eff5007d370 con 0x7eff54070830 2023-10-08T16:04:26.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.163+0000 7eff59377700 1 --2- 172.21.15.133:0/2064468319 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7eff38060550 0x7eff38062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:26.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.167+0000 7eff59377700 1 --2- 172.21.15.133:0/2064468319 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7eff38060550 0x7eff38062a00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7eff48007fd0 tx=0x7eff48009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:26.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.171+0000 7eff45ffb700 1 -- 172.21.15.133:0/2064468319 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7eff5004d9e0 con 0x7eff54070830 2023-10-08T16:04:26.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.331+0000 7eff5ab7a700 1 -- 172.21.15.133:0/2064468319 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff54145940 con 0x7eff54070830 2023-10-08T16:04:26.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.331+0000 7eff45ffb700 1 -- 172.21.15.133:0/2064468319 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7eff50051000 con 0x7eff54070830 2023-10-08T16:04:26.335 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-10-08T16:04:26.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.335+0000 7eff5ab7a700 1 -- 172.21.15.133:0/2064468319 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7eff38060550 msgr2=0x7eff38062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:26.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.335+0000 7eff5ab7a700 1 --2- 172.21.15.133:0/2064468319 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7eff38060550 0x7eff38062a00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7eff48007fd0 tx=0x7eff48009040 comp rx=0 tx=0).stop 2023-10-08T16:04:26.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.335+0000 7eff5ab7a700 1 -- 172.21.15.133:0/2064468319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff54070830 msgr2=0x7eff54144750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:26.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.335+0000 7eff5ab7a700 1 --2- 172.21.15.133:0/2064468319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff54070830 0x7eff54144750 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7eff5000ec80 tx=0x7eff500091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.335+0000 7eff5ab7a700 1 -- 172.21.15.133:0/2064468319 shutdown_connections 2023-10-08T16:04:26.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.335+0000 7eff5ab7a700 1 --2- 172.21.15.133:0/2064468319 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7eff38060550 0x7eff38062a00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.335+0000 7eff5ab7a700 1 --2- 172.21.15.133:0/2064468319 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff540b1740 0x7eff5413a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.335+0000 7eff5ab7a700 1 --2- 172.21.15.133:0/2064468319 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff54070c00 0x7eff5413a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.335+0000 7eff5ab7a700 1 --2- 172.21.15.133:0/2064468319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff54070830 0x7eff54144750 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.335+0000 7eff5ab7a700 1 -- 172.21.15.133:0/2064468319 >> 172.21.15.133:0/2064468319 conn(0x7eff54067a60 msgr2=0x7eff5406fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:26.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.335+0000 7eff5ab7a700 1 -- 172.21.15.133:0/2064468319 shutdown_connections 2023-10-08T16:04:26.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.335+0000 7eff5ab7a700 1 -- 172.21.15.133:0/2064468319 wait complete. 2023-10-08T16:04:26.349 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:04:26.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.459+0000 7ff43e9c8700 1 Processor -- start 2023-10-08T16:04:26.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.459+0000 7ff43e9c8700 1 -- start start 2023-10-08T16:04:26.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.459+0000 7ff43e9c8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff4380acf30 0x7ff4380ae940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:26.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.459+0000 7ff43e9c8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff43813fca0 con 0x7ff4380acb60 2023-10-08T16:04:26.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.459+0000 7ff43e9c8700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4380af5c0 con 0x7ff438141170 2023-10-08T16:04:26.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.459+0000 7ff43e9c8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff438141ce0 con 0x7ff4380acf30 2023-10-08T16:04:26.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.459+0000 7ff43d9c6700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff4380acb60 0x7ff4381423f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49524/0 (socket says 172.21.15.133:49524) 2023-10-08T16:04:26.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.459+0000 7ff43d9c6700 1 -- 172.21.15.133:0/1463922469 learned_addr learned my addr 172.21.15.133:0/1463922469 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:26.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.459+0000 7ff43d1c5700 1 --2- 172.21.15.133:0/1463922469 >> v2:172.21.15.133:3300/0 conn(0x7ff4380acf30 0x7ff4380ae940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:26.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.459+0000 7ff43c9c4700 1 -- 172.21.15.133:0/1463922469 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538784738 0 0) 0x7ff43813fca0 con 0x7ff4380acb60 2023-10-08T16:04:26.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.459+0000 7ff43c9c4700 1 -- 172.21.15.133:0/1463922469 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff424003570 con 0x7ff4380acb60 2023-10-08T16:04:26.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.459+0000 7ff43d1c5700 1 -- 172.21.15.133:0/1463922469 >> v1:172.21.15.190:6789/0 conn(0x7ff438141170 legacy=0x7ff4381415d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:26.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.459+0000 7ff43c9c4700 1 -- 172.21.15.133:0/1463922469 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2611768588 0 0) 0x7ff424003570 con 0x7ff4380acb60 2023-10-08T16:04:26.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.459+0000 7ff43d1c5700 1 -- 172.21.15.133:0/1463922469 >> v1:172.21.15.133:6789/0 conn(0x7ff4380acb60 legacy=0x7ff4381423f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:26.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.459+0000 7ff43d1c5700 1 -- 172.21.15.133:0/1463922469 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff438142b00 con 0x7ff4380acf30 2023-10-08T16:04:26.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.459+0000 7ff43d1c5700 1 --2- 172.21.15.133:0/1463922469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4380acf30 0x7ff4380ae940 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff428009910 tx=0x7ff4280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7436f340b65e533e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:26.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.459+0000 7ff43c9c4700 1 -- 172.21.15.133:0/1463922469 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff434001490 con 0x7ff4380acf30 2023-10-08T16:04:26.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.459+0000 7ff43c9c4700 1 -- 172.21.15.133:0/1463922469 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff428011420 con 0x7ff4380acf30 2023-10-08T16:04:26.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.463+0000 7ff43c9c4700 1 -- 172.21.15.133:0/1463922469 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4280117c0 con 0x7ff4380acf30 2023-10-08T16:04:26.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.463+0000 7ff43e9c8700 1 -- 172.21.15.133:0/1463922469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4380acf30 msgr2=0x7ff4380ae940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:26.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.463+0000 7ff43e9c8700 1 --2- 172.21.15.133:0/1463922469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4380acf30 0x7ff4380ae940 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff428009910 tx=0x7ff4280091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.463+0000 7ff43e9c8700 1 -- 172.21.15.133:0/1463922469 shutdown_connections 2023-10-08T16:04:26.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.463+0000 7ff43e9c8700 1 --2- 172.21.15.133:0/1463922469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4380acf30 0x7ff4380ae940 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.463+0000 7ff43e9c8700 1 -- 172.21.15.133:0/1463922469 >> 172.21.15.133:0/1463922469 conn(0x7ff438066f90 msgr2=0x7ff438067390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:26.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.463+0000 7ff43e9c8700 1 -- 172.21.15.133:0/1463922469 shutdown_connections 2023-10-08T16:04:26.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.463+0000 7ff43e9c8700 1 -- 172.21.15.133:0/1463922469 wait complete. 2023-10-08T16:04:26.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.463+0000 7ff43e9c8700 1 Processor -- start 2023-10-08T16:04:26.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.463+0000 7ff43e9c8700 1 -- start start 2023-10-08T16:04:26.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.463+0000 7ff43e9c8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4380acb60 0x7ff43813e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:26.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.467+0000 7ff43e9c8700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff438141170 0x7ff4380ab450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:26.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.467+0000 7ff43e9c8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4380ab990 0x7ff4380aa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:26.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.467+0000 7ff43e9c8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43813eba0 con 0x7ff4380ab990 2023-10-08T16:04:26.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.467+0000 7ff43e9c8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43813b1f0 con 0x7ff4380acb60 2023-10-08T16:04:26.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.467+0000 7ff43e9c8700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4380a9920 con 0x7ff438141170 2023-10-08T16:04:26.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.467+0000 7ff43e1c7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4380ab990 0x7ff4380aa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:26.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.467+0000 7ff43e1c7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4380ab990 0x7ff4380aa3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43210/0 (socket says 172.21.15.133:43210) 2023-10-08T16:04:26.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.467+0000 7ff43e1c7700 1 -- 172.21.15.133:0/1123592893 learned_addr learned my addr 172.21.15.133:0/1123592893 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:26.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.467+0000 7ff43d9c6700 1 --2- 172.21.15.133:0/1123592893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4380acb60 0x7ff43813e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:26.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.467+0000 7ff43d1c5700 1 --2- 172.21.15.133:0/1123592893 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff438141170 0x7ff4380ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:26.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.467+0000 7ff43e1c7700 1 -- 172.21.15.133:0/1123592893 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff438141170 msgr2=0x7ff4380ab450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:26.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.467+0000 7ff43e1c7700 1 --2- 172.21.15.133:0/1123592893 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff438141170 0x7ff4380ab450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.467+0000 7ff43e1c7700 1 -- 172.21.15.133:0/1123592893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4380acb60 msgr2=0x7ff43813e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:26.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.467+0000 7ff43e1c7700 1 --2- 172.21.15.133:0/1123592893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4380acb60 0x7ff43813e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.467+0000 7ff43e1c7700 1 -- 172.21.15.133:0/1123592893 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff428009420 con 0x7ff4380ab990 2023-10-08T16:04:26.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.467+0000 7ff43d1c5700 1 --2- 172.21.15.133:0/1123592893 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff438141170 0x7ff4380ab450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:26.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.467+0000 7ff43e1c7700 1 --2- 172.21.15.133:0/1123592893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4380ab990 0x7ff4380aa3c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff43000c8e0 tx=0x7ff430001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:26.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.467+0000 7ff42dffb700 1 -- 172.21.15.133:0/1123592893 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff430012630 con 0x7ff4380ab990 2023-10-08T16:04:26.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.467+0000 7ff42dffb700 1 -- 172.21.15.133:0/1123592893 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4300127b0 con 0x7ff4380ab990 2023-10-08T16:04:26.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.467+0000 7ff43e9c8700 1 -- 172.21.15.133:0/1123592893 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff438153170 con 0x7ff4380ab990 2023-10-08T16:04:26.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.467+0000 7ff42dffb700 1 -- 172.21.15.133:0/1123592893 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff430012b70 con 0x7ff4380ab990 2023-10-08T16:04:26.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.467+0000 7ff43e9c8700 1 -- 172.21.15.133:0/1123592893 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff438152e00 con 0x7ff4380ab990 2023-10-08T16:04:26.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.467+0000 7ff43e9c8700 1 -- 172.21.15.133:0/1123592893 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff43804be40 con 0x7ff4380ab990 2023-10-08T16:04:26.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.471+0000 7ff42dffb700 1 -- 172.21.15.133:0/1123592893 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff430003030 con 0x7ff4380ab990 2023-10-08T16:04:26.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.471+0000 7ff42dffb700 1 --2- 172.21.15.133:0/1123592893 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff41c060550 0x7ff41c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:26.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.471+0000 7ff43d9c6700 1 --2- 172.21.15.133:0/1123592893 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff41c060550 0x7ff41c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:26.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.471+0000 7ff42dffb700 1 -- 172.21.15.133:0/1123592893 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff43007cf20 con 0x7ff4380ab990 2023-10-08T16:04:26.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.471+0000 7ff43d9c6700 1 --2- 172.21.15.133:0/1123592893 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff41c060550 0x7ff41c062a00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff434001200 tx=0x7ff434000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:26.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.475+0000 7ff42dffb700 1 -- 172.21.15.133:0/1123592893 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff43004d4f0 con 0x7ff4380ab990 2023-10-08T16:04:26.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.667+0000 7ff43e9c8700 1 -- 172.21.15.133:0/1123592893 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4380af2e0 con 0x7ff4380ab990 2023-10-08T16:04:26.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.667+0000 7ff42dffb700 1 -- 172.21.15.133:0/1123592893 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3082 (secure 0 0 0) 0x7ff430050b10 con 0x7ff4380ab990 2023-10-08T16:04:26.672 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:04:26.672 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3690493804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3690493804},{"type":"v1","addr":"172.21.15.190:6833","nonce":3690493804}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:04:16.997946+0000","modified":"2023-10-08T16:04:19.656961+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/443398897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":443398897},{"type":"v1","addr":"172.21.15.133:6835","nonce":443398897}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:04:26.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.671+0000 7ff43e9c8700 1 -- 172.21.15.133:0/1123592893 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff41c060550 msgr2=0x7ff41c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:26.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.671+0000 7ff43e9c8700 1 --2- 172.21.15.133:0/1123592893 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff41c060550 0x7ff41c062a00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff434001200 tx=0x7ff434000bc0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.671+0000 7ff43e9c8700 1 -- 172.21.15.133:0/1123592893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4380ab990 msgr2=0x7ff4380aa3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:26.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.671+0000 7ff43e9c8700 1 --2- 172.21.15.133:0/1123592893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4380ab990 0x7ff4380aa3c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff43000c8e0 tx=0x7ff430001710 comp rx=0 tx=0).stop 2023-10-08T16:04:26.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.671+0000 7ff43e9c8700 1 -- 172.21.15.133:0/1123592893 shutdown_connections 2023-10-08T16:04:26.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.671+0000 7ff43e9c8700 1 --2- 172.21.15.133:0/1123592893 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff41c060550 0x7ff41c062a00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.671+0000 7ff43e9c8700 1 --2- 172.21.15.133:0/1123592893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4380ab990 0x7ff4380aa3c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.671+0000 7ff43e9c8700 1 --2- 172.21.15.133:0/1123592893 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff438141170 0x7ff4380ab450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.671+0000 7ff43e9c8700 1 --2- 172.21.15.133:0/1123592893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4380acb60 0x7ff43813e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.671+0000 7ff43e9c8700 1 -- 172.21.15.133:0/1123592893 >> 172.21.15.133:0/1123592893 conn(0x7ff438066f90 msgr2=0x7ff438070830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:26.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.671+0000 7ff43e9c8700 1 -- 172.21.15.133:0/1123592893 shutdown_connections 2023-10-08T16:04:26.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.671+0000 7ff43e9c8700 1 -- 172.21.15.133:0/1123592893 wait complete. 2023-10-08T16:04:26.675 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 6 2023-10-08T16:04:26.686 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:04:26.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.783+0000 7f314f59e700 1 Processor -- start 2023-10-08T16:04:26.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.783+0000 7f314f59e700 1 -- start start 2023-10-08T16:04:26.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.783+0000 7f314f59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f31500ad4a0 0x7f3150138e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:26.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.783+0000 7f314f59e700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3150139340 0x7f3150149a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:26.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.783+0000 7f314f59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31500ae860 con 0x7f31500b1dc0 2023-10-08T16:04:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.783+0000 7f314f59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31500ae5f0 con 0x7f31500ad4a0 2023-10-08T16:04:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.783+0000 7f314f59e700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31500ac1e0 con 0x7f3150139340 2023-10-08T16:04:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.783+0000 7f314dd9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f31500ad4a0 0x7f3150138e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.783+0000 7f314e59c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f31500b1dc0 0x7f31500acd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49528/0 (socket says 172.21.15.133:49528) 2023-10-08T16:04:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.783+0000 7f314e59c700 1 -- 172.21.15.133:0/142109508 learned_addr learned my addr 172.21.15.133:0/142109508 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.783+0000 7f314ed9d700 1 --2- 172.21.15.133:0/142109508 >> v2:172.21.15.190:3300/0 conn(0x7f3150139340 0x7f3150149a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.783+0000 7f314dd9b700 1 -- 172.21.15.133:0/142109508 >> v2:172.21.15.190:3300/0 conn(0x7f3150139340 msgr2=0x7f3150149a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.783+0000 7f314dd9b700 1 --2- 172.21.15.133:0/142109508 >> v2:172.21.15.190:3300/0 conn(0x7f3150139340 0x7f3150149a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.783+0000 7f314dd9b700 1 -- 172.21.15.133:0/142109508 >> v1:172.21.15.133:6789/0 conn(0x7f31500b1dc0 legacy=0x7f31500acd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.783+0000 7f314dd9b700 1 -- 172.21.15.133:0/142109508 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31500ac4c0 con 0x7f31500ad4a0 2023-10-08T16:04:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.783+0000 7f314ed9d700 1 --2- 172.21.15.133:0/142109508 >> v2:172.21.15.190:3300/0 conn(0x7f3150139340 0x7f3150149a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:04:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.783+0000 7f314dd9b700 1 --2- 172.21.15.133:0/142109508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31500ad4a0 0x7f3150138e00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f31500ad8d0 tx=0x7f31380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab86ff7929c3811c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:26.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.783+0000 7f314d59a700 1 -- 172.21.15.133:0/142109508 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313800b6b0 con 0x7f31500ad4a0 2023-10-08T16:04:26.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.783+0000 7f314d59a700 1 -- 172.21.15.133:0/142109508 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313800b810 con 0x7f31500ad4a0 2023-10-08T16:04:26.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.783+0000 7f314d59a700 1 -- 172.21.15.133:0/142109508 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313800bbb0 con 0x7f31500ad4a0 2023-10-08T16:04:26.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.787+0000 7f314f59e700 1 -- 172.21.15.133:0/142109508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31500ad4a0 msgr2=0x7f3150138e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:26.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.787+0000 7f314f59e700 1 --2- 172.21.15.133:0/142109508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31500ad4a0 0x7f3150138e00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f31500ad8d0 tx=0x7f31380091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.787+0000 7f314f59e700 1 -- 172.21.15.133:0/142109508 shutdown_connections 2023-10-08T16:04:26.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.787+0000 7f314f59e700 1 --2- 172.21.15.133:0/142109508 >> v2:172.21.15.190:3300/0 conn(0x7f3150139340 0x7f3150149a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.787+0000 7f314f59e700 1 --2- 172.21.15.133:0/142109508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31500ad4a0 0x7f3150138e00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.787+0000 7f314f59e700 1 -- 172.21.15.133:0/142109508 >> 172.21.15.133:0/142109508 conn(0x7f3150063670 msgr2=0x7f31500b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:26.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.787+0000 7f314f59e700 1 -- 172.21.15.133:0/142109508 shutdown_connections 2023-10-08T16:04:26.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.787+0000 7f314f59e700 1 -- 172.21.15.133:0/142109508 wait complete. 2023-10-08T16:04:26.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.787+0000 7f314f59e700 1 Processor -- start 2023-10-08T16:04:26.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.787+0000 7f314f59e700 1 -- start start 2023-10-08T16:04:26.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.787+0000 7f314f59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31500ad4a0 0x7f3150067e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:26.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.787+0000 7f314f59e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f31500b1dc0 0x7f3150155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:26.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.787+0000 7f314f59e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3150139340 0x7f31500a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:26.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.787+0000 7f314f59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315011ccc0 con 0x7f31500ad4a0 2023-10-08T16:04:26.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.787+0000 7f314f59e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3150068350 con 0x7f31500b1dc0 2023-10-08T16:04:26.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.787+0000 7f314f59e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315013b050 con 0x7f3150139340 2023-10-08T16:04:26.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.787+0000 7f314e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31500ad4a0 0x7f3150067e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:26.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.787+0000 7f314e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31500ad4a0 0x7f3150067e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43218/0 (socket says 172.21.15.133:43218) 2023-10-08T16:04:26.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.787+0000 7f314e59c700 1 -- 172.21.15.133:0/1720759422 learned_addr learned my addr 172.21.15.133:0/1720759422 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:26.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.787+0000 7f314ed9d700 1 --2- 172.21.15.133:0/1720759422 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3150139340 0x7f31500a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:26.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.787+0000 7f314dd9b700 1 --2- 172.21.15.133:0/1720759422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f31500b1dc0 0x7f3150155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:26.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.791+0000 7f314e59c700 1 -- 172.21.15.133:0/1720759422 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3150139340 msgr2=0x7f31500a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:26.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.791+0000 7f314e59c700 1 --2- 172.21.15.133:0/1720759422 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3150139340 0x7f31500a98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.791+0000 7f314e59c700 1 -- 172.21.15.133:0/1720759422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f31500b1dc0 msgr2=0x7f3150155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:26.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.791+0000 7f314e59c700 1 --2- 172.21.15.133:0/1720759422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f31500b1dc0 0x7f3150155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.791+0000 7f314e59c700 1 -- 172.21.15.133:0/1720759422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3138009420 con 0x7f31500ad4a0 2023-10-08T16:04:26.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.791+0000 7f314e59c700 1 --2- 172.21.15.133:0/1720759422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31500ad4a0 0x7f3150067e10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f314800c7c0 tx=0x7f3148007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:26.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.791+0000 7f31467fc700 1 -- 172.21.15.133:0/1720759422 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3148005b30 con 0x7f31500ad4a0 2023-10-08T16:04:26.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.791+0000 7f31467fc700 1 -- 172.21.15.133:0/1720759422 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3148005c90 con 0x7f31500ad4a0 2023-10-08T16:04:26.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.791+0000 7f314f59e700 1 -- 172.21.15.133:0/1720759422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315013ad20 con 0x7f31500ad4a0 2023-10-08T16:04:26.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.791+0000 7f31467fc700 1 -- 172.21.15.133:0/1720759422 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3148004a80 con 0x7f31500ad4a0 2023-10-08T16:04:26.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.791+0000 7f314f59e700 1 -- 172.21.15.133:0/1720759422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315013c540 con 0x7f31500ad4a0 2023-10-08T16:04:26.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.791+0000 7f314f59e700 1 -- 172.21.15.133:0/1720759422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3150068b30 con 0x7f31500ad4a0 2023-10-08T16:04:26.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.791+0000 7f31467fc700 1 -- 172.21.15.133:0/1720759422 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f31480070d0 con 0x7f31500ad4a0 2023-10-08T16:04:26.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.791+0000 7f31467fc700 1 --2- 172.21.15.133:0/1720759422 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f3130060580 0x7f3130062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:26.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.791+0000 7f31467fc700 1 -- 172.21.15.133:0/1720759422 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f314807bad0 con 0x7f31500ad4a0 2023-10-08T16:04:26.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.791+0000 7f314dd9b700 1 --2- 172.21.15.133:0/1720759422 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f3130060580 0x7f3130062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:26.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.791+0000 7f314dd9b700 1 --2- 172.21.15.133:0/1720759422 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f3130060580 0x7f3130062a30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f31380093f0 tx=0x7f3138017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:26.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.799+0000 7f31467fc700 1 -- 172.21.15.133:0/1720759422 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3148049be0 con 0x7f31500ad4a0 2023-10-08T16:04:26.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.963+0000 7f314f59e700 1 -- 172.21.15.133:0/1720759422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f315004be40 con 0x7f31500ad4a0 2023-10-08T16:04:26.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.963+0000 7f31467fc700 1 -- 172.21.15.133:0/1720759422 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f314804c0c0 con 0x7f31500ad4a0 2023-10-08T16:04:26.968 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:04:26.968 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"f2546191-d59e-4805-8e1b-3d8d3d1dad86","created":"2023-10-08T16:03:52.631855+0000","modified":"2023-10-08T16:04:18.600728+0000","last_up_change":"2023-10-08T16:04:04.030581+0000","last_in_change":"2023-10-08T16:03:54.835293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:04.898316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:14.869859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:15.983795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8c5deadf-a203-4d30-aa7f-6e2e492b6ffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6809","nonce":33493},{"type":"v1","addr":"172.21.15.133:6811","nonce":33493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":33493},{"type":"v1","addr":"172.21.15.133:6815","nonce":33493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":33493},{"type":"v1","addr":"172.21.15.133:6822","nonce":33493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":33493},{"type":"v1","addr":"172.21.15.133:6818","nonce":33493}]},"public_addr":"172.21.15.133:6811/33493","cluster_addr":"172.21.15.133:6815/33493","heartbeat_back_addr":"172.21.15.133:6822/33493","heartbeat_front_addr":"172.21.15.133:6818/33493","state":["exists","up"]},{"osd":1,"uuid":"9b081c42-c915-48c3-a1ad-410f09a78576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":33490},{"type":"v1","addr":"172.21.15.133:6801","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":33490},{"type":"v1","addr":"172.21.15.133:6803","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":33490},{"type":"v1","addr":"172.21.15.133:6807","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":33490},{"type":"v1","addr":"172.21.15.133:6805","nonce":33490}]},"public_addr":"172.21.15.133:6801/33490","cluster_addr":"172.21.15.133:6803/33490","heartbeat_back_addr":"172.21.15.133:6807/33490","heartbeat_front_addr":"172.21.15.133:6805/33490","state":["exists","up"]},{"osd":2,"uuid":"88ecda43-01cd-4644-ab0c-92c91fd38966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":33492},{"type":"v1","addr":"172.21.15.133:6825","nonce":33492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":33492},{"type":"v1","addr":"172.21.15.133:6827","nonce":33492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":33492},{"type":"v1","addr":"172.21.15.133:6831","nonce":33492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":33492},{"type":"v1","addr":"172.21.15.133:6829","nonce":33492}]},"public_addr":"172.21.15.133:6825/33492","cluster_addr":"172.21.15.133:6827/33492","heartbeat_back_addr":"172.21.15.133:6831/33492","heartbeat_front_addr":"172.21.15.133:6829/33492","state":["exists","up"]},{"osd":3,"uuid":"39faf38d-b8e2-4e11-9b3b-84dc834c977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":33491},{"type":"v1","addr":"172.21.15.133:6810","nonce":33491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":33491},{"type":"v1","addr":"172.21.15.133:6814","nonce":33491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":33491},{"type":"v1","addr":"172.21.15.133:6823","nonce":33491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":33491},{"type":"v1","addr":"172.21.15.133:6819","nonce":33491}]},"public_addr":"172.21.15.133:6810/33491","cluster_addr":"172.21.15.133:6814/33491","heartbeat_back_addr":"172.21.15.133:6823/33491","heartbeat_front_addr":"172.21.15.133:6819/33491","state":["exists","up"]},{"osd":4,"uuid":"4c097e61-1cad-4b61-9183-4e7bc486bd32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":33678},{"type":"v1","addr":"172.21.15.190:6810","nonce":33678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":33678},{"type":"v1","addr":"172.21.15.190:6814","nonce":33678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":33678},{"type":"v1","addr":"172.21.15.190:6822","nonce":33678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":33678},{"type":"v1","addr":"172.21.15.190:6818","nonce":33678}]},"public_addr":"172.21.15.190:6810/33678","cluster_addr":"172.21.15.190:6814/33678","heartbeat_back_addr":"172.21.15.190:6822/33678","heartbeat_front_addr":"172.21.15.190:6818/33678","state":["exists","up"]},{"osd":5,"uuid":"05f072e0-7bc0-40f0-8cb6-8e322c82d6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":33676},{"type":"v1","addr":"172.21.15.190:6811","nonce":33676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":33676},{"type":"v1","addr":"172.21.15.190:6815","nonce":33676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":33676},{"type":"v1","addr":"172.21.15.190:6823","nonce":33676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":33676},{"type":"v1","addr":"172.21.15.190:6819","nonce":33676}]},"public_addr":"172.21.15.190:6811/33676","cluster_addr":"172.21.15.190:6815/33676","heartbeat_back_addr":"172.21.15.190:6823/33676","heartbeat_front_addr":"172.21.15.190:6819/33676","state":["exists","up"]},{"osd":6,"uuid":"1bcce8d7-14f3-442d-b135-68c7d66cdedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":33677},{"type":"v1","addr":"172.21.15.190:6801","nonce":33677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":33677},{"type":"v1","addr":"172.21.15.190:6803","nonce":33677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":33677},{"type":"v1","addr":"172.21.15.190:6807","nonce":33677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":33677},{"type":"v1","addr":"172.21.15.190:6805","nonce":33677}]},"public_addr":"172.21.15.190:6801/33677","cluster_addr":"172.21.15.190:6803/33677","heartbeat_back_addr":"172.21.15.190:6807/33677","heartbeat_front_addr":"172.21.15.190:6805/33677","state":["exists","up"]},{"osd":7,"uuid":"9157dbf7-2bf9-43d7-a89a-a8e3dae7514c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":33686},{"type":"v1","addr":"172.21.15.190:6825","nonce":33686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":33686},{"type":"v1","addr":"172.21.15.190:6827","nonce":33686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":33686},{"type":"v1","addr":"172.21.15.190:6831","nonce":33686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":33686},{"type":"v1","addr":"172.21.15.190:6829","nonce":33686}]},"public_addr":"172.21.15.190:6825/33686","cluster_addr":"172.21.15.190:6827/33686","heartbeat_back_addr":"172.21.15.190:6831/33686","heartbeat_front_addr":"172.21.15.190:6829/33686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.886742+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.199618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.871695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.115926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.069650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.841448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.132320+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.315132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:04:26.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.967+0000 7f314f59e700 1 -- 172.21.15.133:0/1720759422 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f3130060580 msgr2=0x7f3130062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:26.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.967+0000 7f314f59e700 1 --2- 172.21.15.133:0/1720759422 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f3130060580 0x7f3130062a30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f31380093f0 tx=0x7f3138017000 comp rx=0 tx=0).stop 2023-10-08T16:04:26.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.967+0000 7f314f59e700 1 -- 172.21.15.133:0/1720759422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31500ad4a0 msgr2=0x7f3150067e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:26.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.967+0000 7f314f59e700 1 --2- 172.21.15.133:0/1720759422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31500ad4a0 0x7f3150067e10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f314800c7c0 tx=0x7f3148007f70 comp rx=0 tx=0).stop 2023-10-08T16:04:26.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.967+0000 7f314f59e700 1 -- 172.21.15.133:0/1720759422 shutdown_connections 2023-10-08T16:04:26.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.967+0000 7f314f59e700 1 --2- 172.21.15.133:0/1720759422 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f3130060580 0x7f3130062a30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.967+0000 7f314f59e700 1 --2- 172.21.15.133:0/1720759422 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3150139340 0x7f31500a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.967+0000 7f314f59e700 1 --2- 172.21.15.133:0/1720759422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f31500b1dc0 0x7f3150155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.967+0000 7f314f59e700 1 --2- 172.21.15.133:0/1720759422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31500ad4a0 0x7f3150067e10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:26.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.967+0000 7f314f59e700 1 -- 172.21.15.133:0/1720759422 >> 172.21.15.133:0/1720759422 conn(0x7f3150063670 msgr2=0x7f315006fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:26.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.967+0000 7f314f59e700 1 -- 172.21.15.133:0/1720759422 shutdown_connections 2023-10-08T16:04:26.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:26.967+0000 7f314f59e700 1 -- 172.21.15.133:0/1720759422 wait complete. 2023-10-08T16:04:26.983 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:04.898316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:04:14.869859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:04:15.983795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:04:26.983 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:04:27.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.095+0000 7f578c965700 1 Processor -- start 2023-10-08T16:04:27.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.095+0000 7f578c965700 1 -- start start 2023-10-08T16:04:27.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.099+0000 7f578c965700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f578806de10 0x7f578806e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:27.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.099+0000 7f578c965700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5788142fd0 con 0x7f57880b52d0 2023-10-08T16:04:27.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.099+0000 7f578c965700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57880ae540 con 0x7f578813f710 2023-10-08T16:04:27.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.099+0000 7f578c965700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57881437f0 con 0x7f578806de10 2023-10-08T16:04:27.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.099+0000 7f5787fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f578806de10 0x7f578806e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:27.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.099+0000 7f57877fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f57880b52d0 0x7f57881428c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49544/0 (socket says 172.21.15.133:49544) 2023-10-08T16:04:27.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.099+0000 7f57877fe700 1 -- 172.21.15.133:0/2862107221 learned_addr learned my addr 172.21.15.133:0/2862107221 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:27.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.099+0000 7f57867fc700 1 -- 172.21.15.133:0/2862107221 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3598869322 0 0) 0x7f5788142fd0 con 0x7f57880b52d0 2023-10-08T16:04:27.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.099+0000 7f57867fc700 1 -- 172.21.15.133:0/2862107221 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5770003570 con 0x7f57880b52d0 2023-10-08T16:04:27.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.099+0000 7f57867fc700 1 -- 172.21.15.133:0/2862107221 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 901692945 0 0) 0x7f5770003570 con 0x7f57880b52d0 2023-10-08T16:04:27.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.099+0000 7f5787fff700 1 -- 172.21.15.133:0/2862107221 >> v1:172.21.15.190:6789/0 conn(0x7f578813f710 legacy=0x7f578813fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:27.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.099+0000 7f5787fff700 1 -- 172.21.15.133:0/2862107221 >> v1:172.21.15.133:6789/0 conn(0x7f57880b52d0 legacy=0x7f57881428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:27.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.099+0000 7f5787fff700 1 -- 172.21.15.133:0/2862107221 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5788143230 con 0x7f578806de10 2023-10-08T16:04:27.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.099+0000 7f5787fff700 1 --2- 172.21.15.133:0/2862107221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f578806de10 0x7f578806e210 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5780009e60 tx=0x7f5780009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1185c9db86f7ff93 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:27.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.099+0000 7f57867fc700 1 -- 172.21.15.133:0/2862107221 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578000e070 con 0x7f578806de10 2023-10-08T16:04:27.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.099+0000 7f57867fc700 1 -- 172.21.15.133:0/2862107221 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578000b850 con 0x7f578806de10 2023-10-08T16:04:27.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.099+0000 7f57867fc700 1 -- 172.21.15.133:0/2862107221 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5778001470 con 0x7f578806de10 2023-10-08T16:04:27.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.099+0000 7f578c965700 1 -- 172.21.15.133:0/2862107221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f578806de10 msgr2=0x7f578806e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:27.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.099+0000 7f578c965700 1 --2- 172.21.15.133:0/2862107221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f578806de10 0x7f578806e210 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5780009e60 tx=0x7f5780009780 comp rx=0 tx=0).stop 2023-10-08T16:04:27.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.099+0000 7f578c965700 1 -- 172.21.15.133:0/2862107221 shutdown_connections 2023-10-08T16:04:27.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.099+0000 7f578c965700 1 --2- 172.21.15.133:0/2862107221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f578806de10 0x7f578806e210 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.099+0000 7f578c965700 1 -- 172.21.15.133:0/2862107221 >> 172.21.15.133:0/2862107221 conn(0x7f5788068420 msgr2=0x7f5788070830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:27.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.099+0000 7f578c965700 1 -- 172.21.15.133:0/2862107221 shutdown_connections 2023-10-08T16:04:27.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.099+0000 7f578c965700 1 -- 172.21.15.133:0/2862107221 wait complete. 2023-10-08T16:04:27.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.103+0000 7f578c965700 1 Processor -- start 2023-10-08T16:04:27.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.103+0000 7f578c965700 1 -- start start 2023-10-08T16:04:27.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.103+0000 7f578c965700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f578806de10 0x7f578813b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:27.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.103+0000 7f578c965700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57880b52d0 0x7f5788153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:27.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.103+0000 7f578c965700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f578813f710 0x7f5788138c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:27.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.103+0000 7f578c965700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5788150890 con 0x7f57880b52d0 2023-10-08T16:04:27.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.103+0000 7f578c965700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57880a5660 con 0x7f578813f710 2023-10-08T16:04:27.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.103+0000 7f578c965700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578813c880 con 0x7f578806de10 2023-10-08T16:04:27.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.103+0000 7f5786ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57880b52d0 0x7f5788153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:27.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.103+0000 7f5786ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57880b52d0 0x7f5788153430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43244/0 (socket says 172.21.15.133:43244) 2023-10-08T16:04:27.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.103+0000 7f5786ffd700 1 -- 172.21.15.133:0/3368924312 learned_addr learned my addr 172.21.15.133:0/3368924312 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:27.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.103+0000 7f5787fff700 1 --2- 172.21.15.133:0/3368924312 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f578813f710 0x7f5788138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:27.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.103+0000 7f57877fe700 1 --2- 172.21.15.133:0/3368924312 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f578806de10 0x7f578813b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:27.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.103+0000 7f5786ffd700 1 -- 172.21.15.133:0/3368924312 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f578806de10 msgr2=0x7f578813b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:27.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.103+0000 7f5786ffd700 1 --2- 172.21.15.133:0/3368924312 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f578806de10 0x7f578813b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.103+0000 7f5786ffd700 1 -- 172.21.15.133:0/3368924312 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f578813f710 msgr2=0x7f5788138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:27.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.103+0000 7f5786ffd700 1 --2- 172.21.15.133:0/3368924312 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f578813f710 0x7f5788138c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.103+0000 7f5786ffd700 1 -- 172.21.15.133:0/3368924312 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5780009a20 con 0x7f57880b52d0 2023-10-08T16:04:27.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.103+0000 7f5786ffd700 1 --2- 172.21.15.133:0/3368924312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57880b52d0 0x7f5788153430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f577c00c4e0 tx=0x7f577c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:27.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.103+0000 7f576f7fe700 1 -- 172.21.15.133:0/3368924312 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c011590 con 0x7f57880b52d0 2023-10-08T16:04:27.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.103+0000 7f576f7fe700 1 -- 172.21.15.133:0/3368924312 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577c011710 con 0x7f57880b52d0 2023-10-08T16:04:27.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.103+0000 7f578c965700 1 -- 172.21.15.133:0/3368924312 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5788150560 con 0x7f57880b52d0 2023-10-08T16:04:27.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.103+0000 7f576f7fe700 1 -- 172.21.15.133:0/3368924312 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c011ad0 con 0x7f57880b52d0 2023-10-08T16:04:27.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.103+0000 7f578c965700 1 -- 172.21.15.133:0/3368924312 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f578813bf50 con 0x7f57880b52d0 2023-10-08T16:04:27.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.107+0000 7f578c965700 1 -- 172.21.15.133:0/3368924312 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5788150a00 con 0x7f57880b52d0 2023-10-08T16:04:27.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.107+0000 7f576f7fe700 1 -- 172.21.15.133:0/3368924312 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f577c001020 con 0x7f57880b52d0 2023-10-08T16:04:27.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.107+0000 7f576f7fe700 1 --2- 172.21.15.133:0/3368924312 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5774060650 0x7f5774062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:27.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.107+0000 7f576f7fe700 1 -- 172.21.15.133:0/3368924312 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f577c07ba60 con 0x7f57880b52d0 2023-10-08T16:04:27.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.107+0000 7f57877fe700 1 --2- 172.21.15.133:0/3368924312 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5774060650 0x7f5774062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:27.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.107+0000 7f57877fe700 1 --2- 172.21.15.133:0/3368924312 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5774060650 0x7f5774062b00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5778001620 tx=0x7f5778000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:27.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.115+0000 7f576f7fe700 1 -- 172.21.15.133:0/3368924312 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f577c04c0d0 con 0x7f57880b52d0 2023-10-08T16:04:27.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.267+0000 7f578c965700 1 -- 172.21.15.133:0/3368924312 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f578804be40 con 0x7f57880b52d0 2023-10-08T16:04:27.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.267+0000 7f576f7fe700 1 -- 172.21.15.133:0/3368924312 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f577c04f6f0 con 0x7f57880b52d0 2023-10-08T16:04:27.272 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-10-08T16:04:27.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.271+0000 7f578c965700 1 -- 172.21.15.133:0/3368924312 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5774060650 msgr2=0x7f5774062b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:27.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.271+0000 7f578c965700 1 --2- 172.21.15.133:0/3368924312 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5774060650 0x7f5774062b00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5778001620 tx=0x7f5778000bc0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.271+0000 7f578c965700 1 -- 172.21.15.133:0/3368924312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57880b52d0 msgr2=0x7f5788153430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:27.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.271+0000 7f578c965700 1 --2- 172.21.15.133:0/3368924312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57880b52d0 0x7f5788153430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f577c00c4e0 tx=0x7f577c00c7f0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.271+0000 7f578c965700 1 -- 172.21.15.133:0/3368924312 shutdown_connections 2023-10-08T16:04:27.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.271+0000 7f578c965700 1 --2- 172.21.15.133:0/3368924312 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5774060650 0x7f5774062b00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.271+0000 7f578c965700 1 --2- 172.21.15.133:0/3368924312 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f578813f710 0x7f5788138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.271+0000 7f578c965700 1 --2- 172.21.15.133:0/3368924312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57880b52d0 0x7f5788153430 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.271+0000 7f578c965700 1 --2- 172.21.15.133:0/3368924312 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f578806de10 0x7f578813b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.271+0000 7f578c965700 1 -- 172.21.15.133:0/3368924312 >> 172.21.15.133:0/3368924312 conn(0x7f5788068420 msgr2=0x7f57880b1010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:27.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.271+0000 7f578c965700 1 -- 172.21.15.133:0/3368924312 shutdown_connections 2023-10-08T16:04:27.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.271+0000 7f578c965700 1 -- 172.21.15.133:0/3368924312 wait complete. 2023-10-08T16:04:27.285 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:04:27.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.391+0000 7ff4e7fff700 1 Processor -- start 2023-10-08T16:04:27.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.391+0000 7ff4e7fff700 1 -- start start 2023-10-08T16:04:27.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e7fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff4e80b52d0 0x7ff4e81428c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:27.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e7fff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff4e806de10 0x7ff4e806e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:27.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e7fff700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4e80ae540 con 0x7ff4e813f710 2023-10-08T16:04:27.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e7fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e81437f0 con 0x7ff4e80b52d0 2023-10-08T16:04:27.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e7fff700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e813f2c0 con 0x7ff4e806de10 2023-10-08T16:04:27.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e6ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff4e80b52d0 0x7ff4e81428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:27.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e77fe700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff4e806de10 0x7ff4e806e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:27.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e67fc700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7ff4e813f710 0x7ff4e813fb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.133:42808/0 (socket says 172.21.15.133:42808) 2023-10-08T16:04:27.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e67fc700 1 -- 172.21.15.133:0/2234197668 learned_addr learned my addr 172.21.15.133:0/2234197668 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:27.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e6ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff4e80b52d0 0x7ff4e81428c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43252/0 (socket says 172.21.15.133:43252) 2023-10-08T16:04:27.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e5ffb700 1 -- 172.21.15.133:0/2234197668 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164473319 0 0) 0x7ff4e80ae540 con 0x7ff4e813f710 2023-10-08T16:04:27.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e5ffb700 1 -- 172.21.15.133:0/2234197668 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4d4003570 con 0x7ff4e813f710 2023-10-08T16:04:27.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e6ffd700 1 -- 172.21.15.133:0/2234197668 >> v2:172.21.15.190:3300/0 conn(0x7ff4e806de10 msgr2=0x7ff4e806e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:27.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e6ffd700 1 --2- 172.21.15.133:0/2234197668 >> v2:172.21.15.190:3300/0 conn(0x7ff4e806de10 0x7ff4e806e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e6ffd700 1 -- 172.21.15.133:0/2234197668 >> v1:172.21.15.190:6789/0 conn(0x7ff4e813f710 legacy=0x7ff4e813fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:27.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e6ffd700 1 -- 172.21.15.133:0/2234197668 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e8143230 con 0x7ff4e80b52d0 2023-10-08T16:04:27.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e77fe700 1 --2- 172.21.15.133:0/2234197668 >> v2:172.21.15.190:3300/0 conn(0x7ff4e806de10 0x7ff4e806e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:04:27.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e6ffd700 1 --2- 172.21.15.133:0/2234197668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4e80b52d0 0x7ff4e81428c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8140260 tx=0x7ff4d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2acb7a74fe7bf404 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:27.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e5ffb700 1 -- 172.21.15.133:0/2234197668 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0011630 con 0x7ff4e80b52d0 2023-10-08T16:04:27.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e5ffb700 1 -- 172.21.15.133:0/2234197668 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d0011790 con 0x7ff4e80b52d0 2023-10-08T16:04:27.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e5ffb700 1 -- 172.21.15.133:0/2234197668 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0011b30 con 0x7ff4e80b52d0 2023-10-08T16:04:27.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e7fff700 1 -- 172.21.15.133:0/2234197668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4e80b52d0 msgr2=0x7ff4e81428c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:27.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e7fff700 1 --2- 172.21.15.133:0/2234197668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4e80b52d0 0x7ff4e81428c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8140260 tx=0x7ff4d00091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e7fff700 1 -- 172.21.15.133:0/2234197668 shutdown_connections 2023-10-08T16:04:27.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e7fff700 1 --2- 172.21.15.133:0/2234197668 >> v2:172.21.15.190:3300/0 conn(0x7ff4e806de10 0x7ff4e806e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e7fff700 1 --2- 172.21.15.133:0/2234197668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4e80b52d0 0x7ff4e81428c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e7fff700 1 -- 172.21.15.133:0/2234197668 >> 172.21.15.133:0/2234197668 conn(0x7ff4e8068420 msgr2=0x7ff4e8070830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:27.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e7fff700 1 -- 172.21.15.133:0/2234197668 shutdown_connections 2023-10-08T16:04:27.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.395+0000 7ff4e7fff700 1 -- 172.21.15.133:0/2234197668 wait complete. 2023-10-08T16:04:27.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.399+0000 7ff4e7fff700 1 Processor -- start 2023-10-08T16:04:27.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.399+0000 7ff4e7fff700 1 -- start start 2023-10-08T16:04:27.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.399+0000 7ff4e7fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4e806de10 0x7ff4e81507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:27.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.399+0000 7ff4e7fff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4e80b52d0 0x7ff4e806d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:27.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.399+0000 7ff4e7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4e813f710 0x7ff4e806d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:27.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.399+0000 7ff4e7fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e806cbb0 con 0x7ff4e813f710 2023-10-08T16:04:27.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.399+0000 7ff4e7fff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e806c2c0 con 0x7ff4e806de10 2023-10-08T16:04:27.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.399+0000 7ff4e7fff700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e80ab730 con 0x7ff4e80b52d0 2023-10-08T16:04:27.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.399+0000 7ff4e77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4e813f710 0x7ff4e806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:27.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.399+0000 7ff4e77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4e813f710 0x7ff4e806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43254/0 (socket says 172.21.15.133:43254) 2023-10-08T16:04:27.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.399+0000 7ff4e77fe700 1 -- 172.21.15.133:0/3622475767 learned_addr learned my addr 172.21.15.133:0/3622475767 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:27.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.399+0000 7ff4e6ffd700 1 --2- 172.21.15.133:0/3622475767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4e806de10 0x7ff4e81507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:27.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.399+0000 7ff4e67fc700 1 --2- 172.21.15.133:0/3622475767 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4e80b52d0 0x7ff4e806d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:27.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.399+0000 7ff4e77fe700 1 -- 172.21.15.133:0/3622475767 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4e80b52d0 msgr2=0x7ff4e806d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:27.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.399+0000 7ff4e77fe700 1 --2- 172.21.15.133:0/3622475767 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4e80b52d0 0x7ff4e806d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.399+0000 7ff4e77fe700 1 -- 172.21.15.133:0/3622475767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4e806de10 msgr2=0x7ff4e81507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:27.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.399+0000 7ff4e77fe700 1 --2- 172.21.15.133:0/3622475767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4e806de10 0x7ff4e81507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.399+0000 7ff4e77fe700 1 -- 172.21.15.133:0/3622475767 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e0009420 con 0x7ff4e813f710 2023-10-08T16:04:27.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.399+0000 7ff4e77fe700 1 --2- 172.21.15.133:0/3622475767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4e813f710 0x7ff4e806d580 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000ec80 tx=0x7ff4e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:27.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.399+0000 7ff4deffd700 1 -- 172.21.15.133:0/3622475767 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e000c9d0 con 0x7ff4e813f710 2023-10-08T16:04:27.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.399+0000 7ff4deffd700 1 -- 172.21.15.133:0/3622475767 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e000cb50 con 0x7ff4e813f710 2023-10-08T16:04:27.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.399+0000 7ff4e7fff700 1 -- 172.21.15.133:0/3622475767 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d0009420 con 0x7ff4e813f710 2023-10-08T16:04:27.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.399+0000 7ff4deffd700 1 -- 172.21.15.133:0/3622475767 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0013470 con 0x7ff4e813f710 2023-10-08T16:04:27.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.399+0000 7ff4e7fff700 1 -- 172.21.15.133:0/3622475767 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e806c840 con 0x7ff4e813f710 2023-10-08T16:04:27.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.403+0000 7ff4e7fff700 1 -- 172.21.15.133:0/3622475767 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e804be40 con 0x7ff4e813f710 2023-10-08T16:04:27.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.403+0000 7ff4deffd700 1 -- 172.21.15.133:0/3622475767 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff4e0013860 con 0x7ff4e813f710 2023-10-08T16:04:27.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.403+0000 7ff4deffd700 1 --2- 172.21.15.133:0/3622475767 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff4c8060550 0x7ff4c8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:27.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.403+0000 7ff4deffd700 1 -- 172.21.15.133:0/3622475767 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff4e007c970 con 0x7ff4e813f710 2023-10-08T16:04:27.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.403+0000 7ff4e6ffd700 1 --2- 172.21.15.133:0/3622475767 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff4c8060550 0x7ff4c8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:27.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.403+0000 7ff4e6ffd700 1 --2- 172.21.15.133:0/3622475767 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff4c8060550 0x7ff4c8062a00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8140260 tx=0x7ff4d0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:27.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.411+0000 7ff4deffd700 1 -- 172.21.15.133:0/3622475767 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff4e004cf60 con 0x7ff4e813f710 2023-10-08T16:04:27.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.571+0000 7ff4e7fff700 1 -- 172.21.15.133:0/3622475767 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff4e8143510 con 0x7ff4e813f710 2023-10-08T16:04:27.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.571+0000 7ff4deffd700 1 -- 172.21.15.133:0/3622475767 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff4e0050580 con 0x7ff4e813f710 2023-10-08T16:04:27.574 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-10-08T16:04:27.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.571+0000 7ff4e7fff700 1 -- 172.21.15.133:0/3622475767 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff4c8060550 msgr2=0x7ff4c8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:27.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.571+0000 7ff4e7fff700 1 --2- 172.21.15.133:0/3622475767 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff4c8060550 0x7ff4c8062a00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8140260 tx=0x7ff4d0017000 comp rx=0 tx=0).stop 2023-10-08T16:04:27.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.571+0000 7ff4e7fff700 1 -- 172.21.15.133:0/3622475767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4e813f710 msgr2=0x7ff4e806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:27.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.571+0000 7ff4e7fff700 1 --2- 172.21.15.133:0/3622475767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4e813f710 0x7ff4e806d580 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000ec80 tx=0x7ff4e00091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.571+0000 7ff4e7fff700 1 -- 172.21.15.133:0/3622475767 shutdown_connections 2023-10-08T16:04:27.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.571+0000 7ff4e7fff700 1 --2- 172.21.15.133:0/3622475767 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff4c8060550 0x7ff4c8062a00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.571+0000 7ff4e7fff700 1 --2- 172.21.15.133:0/3622475767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4e813f710 0x7ff4e806d580 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.571+0000 7ff4e7fff700 1 --2- 172.21.15.133:0/3622475767 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4e80b52d0 0x7ff4e806d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.571+0000 7ff4e7fff700 1 --2- 172.21.15.133:0/3622475767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4e806de10 0x7ff4e81507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.571+0000 7ff4e7fff700 1 -- 172.21.15.133:0/3622475767 >> 172.21.15.133:0/3622475767 conn(0x7ff4e8068420 msgr2=0x7ff4e81428b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:27.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.571+0000 7ff4e7fff700 1 -- 172.21.15.133:0/3622475767 shutdown_connections 2023-10-08T16:04:27.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.575+0000 7ff4e7fff700 1 -- 172.21.15.133:0/3622475767 wait complete. 2023-10-08T16:04:27.588 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:04:27.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.699+0000 7f8ee8a5c700 1 Processor -- start 2023-10-08T16:04:27.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.699+0000 7f8ee8a5c700 1 -- start start 2023-10-08T16:04:27.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.699+0000 7f8ee8a5c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ee406a0d0 0x7f8ee406cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:27.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.699+0000 7f8ee8a5c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8ee406d510 0x7f8ee4143920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:27.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.699+0000 7f8ee8a5c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8ee4143e60 0x7f8ee4144280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:27.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.699+0000 7f8ee8a5c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee41447c0 con 0x7f8ee4143e60 2023-10-08T16:04:27.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.699+0000 7f8ee8a5c700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee4141250 con 0x7f8ee406d510 2023-10-08T16:04:27.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.699+0000 7f8ee8a5c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee4140dc0 con 0x7f8ee406a0d0 2023-10-08T16:04:27.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.699+0000 7f8ee359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8ee4143e60 0x7f8ee4144280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:27.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.699+0000 7f8ee359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8ee4143e60 0x7f8ee4144280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43266/0 (socket says 172.21.15.133:43266) 2023-10-08T16:04:27.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.699+0000 7f8ee359e700 1 -- 172.21.15.133:0/2190538360 learned_addr learned my addr 172.21.15.133:0/2190538360 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:27.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.699+0000 7f8ee2d9d700 1 --2- 172.21.15.133:0/2190538360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ee406a0d0 0x7f8ee406cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:27.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.699+0000 7f8ee259c700 1 --2- 172.21.15.133:0/2190538360 >> v2:172.21.15.190:3300/0 conn(0x7f8ee406d510 0x7f8ee4143920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:27.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.699+0000 7f8ee359e700 1 -- 172.21.15.133:0/2190538360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ee406a0d0 msgr2=0x7f8ee406cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:27.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.699+0000 7f8ee359e700 1 --2- 172.21.15.133:0/2190538360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ee406a0d0 0x7f8ee406cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.699+0000 7f8ee359e700 1 -- 172.21.15.133:0/2190538360 >> v2:172.21.15.190:3300/0 conn(0x7f8ee406d510 msgr2=0x7f8ee4143920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:27.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.699+0000 7f8ee359e700 1 --2- 172.21.15.133:0/2190538360 >> v2:172.21.15.190:3300/0 conn(0x7f8ee406d510 0x7f8ee4143920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.699+0000 7f8ee359e700 1 -- 172.21.15.133:0/2190538360 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee40b2d50 con 0x7f8ee4143e60 2023-10-08T16:04:27.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.699+0000 7f8ee2d9d700 1 --2- 172.21.15.133:0/2190538360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ee406a0d0 0x7f8ee406cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:27.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.699+0000 7f8ee359e700 1 --2- 172.21.15.133:0/2190538360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ee4143e60 0x7f8ee4144280 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4071440 tx=0x7f8ed4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f036e2b685e4b4ca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:27.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.703+0000 7f8ee1d9b700 1 -- 172.21.15.133:0/2190538360 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4009e70 con 0x7f8ee4143e60 2023-10-08T16:04:27.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.703+0000 7f8ee1d9b700 1 -- 172.21.15.133:0/2190538360 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed400b860 con 0x7f8ee4143e60 2023-10-08T16:04:27.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.703+0000 7f8ee1d9b700 1 -- 172.21.15.133:0/2190538360 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed400bc00 con 0x7f8ee4143e60 2023-10-08T16:04:27.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.703+0000 7f8ee8a5c700 1 -- 172.21.15.133:0/2190538360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ee4143e60 msgr2=0x7f8ee4144280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:27.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.703+0000 7f8ee8a5c700 1 --2- 172.21.15.133:0/2190538360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ee4143e60 0x7f8ee4144280 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4071440 tx=0x7f8ed4009250 comp rx=0 tx=0).stop 2023-10-08T16:04:27.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.703+0000 7f8ee8a5c700 1 -- 172.21.15.133:0/2190538360 shutdown_connections 2023-10-08T16:04:27.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.703+0000 7f8ee8a5c700 1 --2- 172.21.15.133:0/2190538360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ee4143e60 0x7f8ee4144280 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.703+0000 7f8ee8a5c700 1 --2- 172.21.15.133:0/2190538360 >> v2:172.21.15.190:3300/0 conn(0x7f8ee406d510 0x7f8ee4143920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.703+0000 7f8ee8a5c700 1 --2- 172.21.15.133:0/2190538360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ee406a0d0 0x7f8ee406cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.703+0000 7f8ee8a5c700 1 -- 172.21.15.133:0/2190538360 >> 172.21.15.133:0/2190538360 conn(0x7f8ee40b6ba0 msgr2=0x7f8ee40b6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:27.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.703+0000 7f8ee8a5c700 1 -- 172.21.15.133:0/2190538360 shutdown_connections 2023-10-08T16:04:27.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.703+0000 7f8ee8a5c700 1 -- 172.21.15.133:0/2190538360 wait complete. 2023-10-08T16:04:27.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.703+0000 7f8ee8a5c700 1 Processor -- start 2023-10-08T16:04:27.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.703+0000 7f8ee8a5c700 1 -- start start 2023-10-08T16:04:27.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.703+0000 7f8ee8a5c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ee406a0d0 0x7f8ee413b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:27.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.703+0000 7f8ee8a5c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ee406d510 0x7f8ee40b0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:27.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.703+0000 7f8ee8a5c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ee4143e60 0x7f8ee41534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:27.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.703+0000 7f8ee8a5c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee40adc50 con 0x7f8ee406a0d0 2023-10-08T16:04:27.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.703+0000 7f8ee8a5c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee413d870 con 0x7f8ee4143e60 2023-10-08T16:04:27.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.703+0000 7f8ee8a5c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee413cba0 con 0x7f8ee406d510 2023-10-08T16:04:27.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.703+0000 7f8ee2d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ee406a0d0 0x7f8ee413b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:27.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.703+0000 7f8ee2d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ee406a0d0 0x7f8ee413b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43268/0 (socket says 172.21.15.133:43268) 2023-10-08T16:04:27.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.707+0000 7f8ee2d9d700 1 -- 172.21.15.133:0/1524509765 learned_addr learned my addr 172.21.15.133:0/1524509765 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:27.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.707+0000 7f8ee359e700 1 --2- 172.21.15.133:0/1524509765 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ee4143e60 0x7f8ee41534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:27.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.707+0000 7f8ee259c700 1 --2- 172.21.15.133:0/1524509765 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ee406d510 0x7f8ee40b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:27.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.707+0000 7f8ee2d9d700 1 -- 172.21.15.133:0/1524509765 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ee406d510 msgr2=0x7f8ee40b0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:27.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.707+0000 7f8ee2d9d700 1 --2- 172.21.15.133:0/1524509765 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ee406d510 0x7f8ee40b0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.707+0000 7f8ee2d9d700 1 -- 172.21.15.133:0/1524509765 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ee4143e60 msgr2=0x7f8ee41534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:27.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.707+0000 7f8ee2d9d700 1 --2- 172.21.15.133:0/1524509765 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ee4143e60 0x7f8ee41534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.707+0000 7f8ee2d9d700 1 -- 172.21.15.133:0/1524509765 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed40094f0 con 0x7f8ee406a0d0 2023-10-08T16:04:27.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.707+0000 7f8ee359e700 1 --2- 172.21.15.133:0/1524509765 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ee4143e60 0x7f8ee41534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:27.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.707+0000 7f8ee2d9d700 1 --2- 172.21.15.133:0/1524509765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ee406a0d0 0x7f8ee413b560 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00d890 tx=0x7f8ecc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:27.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.707+0000 7f8edaffd700 1 -- 172.21.15.133:0/1524509765 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc00b600 con 0x7f8ee406a0d0 2023-10-08T16:04:27.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.707+0000 7f8edaffd700 1 -- 172.21.15.133:0/1524509765 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ecc00b760 con 0x7f8ee406a0d0 2023-10-08T16:04:27.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.707+0000 7f8ee8a5c700 1 -- 172.21.15.133:0/1524509765 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee413db20 con 0x7f8ee406a0d0 2023-10-08T16:04:27.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.707+0000 7f8edaffd700 1 -- 172.21.15.133:0/1524509765 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc00bb00 con 0x7f8ee406a0d0 2023-10-08T16:04:27.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.707+0000 7f8ee8a5c700 1 -- 172.21.15.133:0/1524509765 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee413c540 con 0x7f8ee406a0d0 2023-10-08T16:04:27.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.707+0000 7f8ee8a5c700 1 -- 172.21.15.133:0/1524509765 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee40b3030 con 0x7f8ee406a0d0 2023-10-08T16:04:27.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.707+0000 7f8edaffd700 1 -- 172.21.15.133:0/1524509765 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8ecc014430 con 0x7f8ee406a0d0 2023-10-08T16:04:27.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.707+0000 7f8edaffd700 1 --2- 172.21.15.133:0/1524509765 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f8ec4060550 0x7f8ec4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:27.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.711+0000 7f8ee259c700 1 --2- 172.21.15.133:0/1524509765 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f8ec4060550 0x7f8ec4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:27.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.711+0000 7f8edaffd700 1 -- 172.21.15.133:0/1524509765 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ecc07cc80 con 0x7f8ee406a0d0 2023-10-08T16:04:27.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.711+0000 7f8ee259c700 1 --2- 172.21.15.133:0/1524509765 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f8ec4060550 0x7f8ec4062a00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8ee413ff40 tx=0x7f8edc00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:27.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.715+0000 7f8edaffd700 1 -- 172.21.15.133:0/1524509765 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8ee40b3030 con 0x7f8ee406a0d0 2023-10-08T16:04:27.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.875+0000 7f8ee8a5c700 1 -- 172.21.15.133:0/1524509765 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8ee406f7a0 con 0x7f8ee406a0d0 2023-10-08T16:04:27.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.875+0000 7f8edaffd700 1 -- 172.21.15.133:0/1524509765 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8ee406f7a0 con 0x7f8ee406a0d0 2023-10-08T16:04:27.880 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-10-08T16:04:27.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.879+0000 7f8ee8a5c700 1 -- 172.21.15.133:0/1524509765 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f8ec4060550 msgr2=0x7f8ec4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:27.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.879+0000 7f8ee8a5c700 1 --2- 172.21.15.133:0/1524509765 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f8ec4060550 0x7f8ec4062a00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8ee413ff40 tx=0x7f8edc00b040 comp rx=0 tx=0).stop 2023-10-08T16:04:27.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.879+0000 7f8ee8a5c700 1 -- 172.21.15.133:0/1524509765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ee406a0d0 msgr2=0x7f8ee413b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:27.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.879+0000 7f8ee8a5c700 1 --2- 172.21.15.133:0/1524509765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ee406a0d0 0x7f8ee413b560 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00d890 tx=0x7f8ecc008040 comp rx=0 tx=0).stop 2023-10-08T16:04:27.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.879+0000 7f8ee8a5c700 1 -- 172.21.15.133:0/1524509765 shutdown_connections 2023-10-08T16:04:27.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.879+0000 7f8ee8a5c700 1 --2- 172.21.15.133:0/1524509765 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f8ec4060550 0x7f8ec4062a00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.879+0000 7f8ee8a5c700 1 --2- 172.21.15.133:0/1524509765 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ee4143e60 0x7f8ee41534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.879+0000 7f8ee8a5c700 1 --2- 172.21.15.133:0/1524509765 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ee406d510 0x7f8ee40b0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.879+0000 7f8ee8a5c700 1 --2- 172.21.15.133:0/1524509765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ee406a0d0 0x7f8ee413b560 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:27.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.879+0000 7f8ee8a5c700 1 -- 172.21.15.133:0/1524509765 >> 172.21.15.133:0/1524509765 conn(0x7f8ee40b6ba0 msgr2=0x7f8ee406fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:27.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.879+0000 7f8ee8a5c700 1 -- 172.21.15.133:0/1524509765 shutdown_connections 2023-10-08T16:04:27.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.879+0000 7f8ee8a5c700 1 -- 172.21.15.133:0/1524509765 wait complete. 2023-10-08T16:04:27.894 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:04:27.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.995+0000 7f07eb9a9700 1 Processor -- start 2023-10-08T16:04:27.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.995+0000 7f07eb9a9700 1 -- start start 2023-10-08T16:04:27.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.995+0000 7f07eb9a9700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f07e40ae560 0x7f07e4143b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:27.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.995+0000 7f07eb9a9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e40afed0 con 0x7f07e40ae190 2023-10-08T16:04:27.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.995+0000 7f07eb9a9700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e406b730 con 0x7f07e4144090 2023-10-08T16:04:27.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.995+0000 7f07eb9a9700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e4144510 con 0x7f07e40ae560 2023-10-08T16:04:27.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.995+0000 7f07e9745700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f07e40ae190 0x7f07e40b08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49550/0 (socket says 172.21.15.133:49550) 2023-10-08T16:04:27.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.995+0000 7f07e9745700 1 -- 172.21.15.133:0/3062975338 learned_addr learned my addr 172.21.15.133:0/3062975338 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:27.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.995+0000 7f07e8f44700 1 --2- 172.21.15.133:0/3062975338 >> v2:172.21.15.190:3300/0 conn(0x7f07e40ae560 0x7f07e4143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:28.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.995+0000 7f07dbfff700 1 -- 172.21.15.133:0/3062975338 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2087974117 0 0) 0x7f07e40afed0 con 0x7f07e40ae190 2023-10-08T16:04:28.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.995+0000 7f07dbfff700 1 -- 172.21.15.133:0/3062975338 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07d0003570 con 0x7f07e40ae190 2023-10-08T16:04:28.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.995+0000 7f07e8f44700 1 -- 172.21.15.133:0/3062975338 >> v1:172.21.15.190:6789/0 conn(0x7f07e4144090 legacy=0x7f07e406e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:28.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.995+0000 7f07e8f44700 1 -- 172.21.15.133:0/3062975338 >> v1:172.21.15.133:6789/0 conn(0x7f07e40ae190 legacy=0x7f07e40b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:28.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.995+0000 7f07e8f44700 1 -- 172.21.15.133:0/3062975338 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e40af880 con 0x7f07e40ae560 2023-10-08T16:04:28.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.995+0000 7f07e8f44700 1 --2- 172.21.15.133:0/3062975338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07e40ae560 0x7f07e4143b50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f07dc009e60 tx=0x7f07dc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4299d290f7385bd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:28.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.995+0000 7f07dbfff700 1 -- 172.21.15.133:0/3062975338 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc00e070 con 0x7f07e40ae560 2023-10-08T16:04:28.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.995+0000 7f07dbfff700 1 -- 172.21.15.133:0/3062975338 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07dc00bb60 con 0x7f07e40ae560 2023-10-08T16:04:28.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.995+0000 7f07dbfff700 1 -- 172.21.15.133:0/3062975338 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc012430 con 0x7f07e40ae560 2023-10-08T16:04:28.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07eb9a9700 1 -- 172.21.15.133:0/3062975338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07e40ae560 msgr2=0x7f07e4143b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:28.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07eb9a9700 1 --2- 172.21.15.133:0/3062975338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07e40ae560 0x7f07e4143b50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f07dc009e60 tx=0x7f07dc009780 comp rx=0 tx=0).stop 2023-10-08T16:04:28.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07eb9a9700 1 -- 172.21.15.133:0/3062975338 shutdown_connections 2023-10-08T16:04:28.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07eb9a9700 1 --2- 172.21.15.133:0/3062975338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07e40ae560 0x7f07e4143b50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:28.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07eb9a9700 1 -- 172.21.15.133:0/3062975338 >> 172.21.15.133:0/3062975338 conn(0x7f07e40b4ba0 msgr2=0x7f07e40b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:28.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07eb9a9700 1 -- 172.21.15.133:0/3062975338 shutdown_connections 2023-10-08T16:04:28.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07eb9a9700 1 -- 172.21.15.133:0/3062975338 wait complete. 2023-10-08T16:04:28.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07eb9a9700 1 Processor -- start 2023-10-08T16:04:28.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07eb9a9700 1 -- start start 2023-10-08T16:04:28.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07eb9a9700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07e40ae190 0x7f07e4142b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:28.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07eb9a9700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07e40ae560 0x7f07e40abf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:28.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07eb9a9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07e4144090 0x7f07e40aca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:28.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07eb9a9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e40add80 con 0x7f07e4144090 2023-10-08T16:04:28.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07eb9a9700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e41520f0 con 0x7f07e40ae560 2023-10-08T16:04:28.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07eb9a9700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e4152950 con 0x7f07e40ae190 2023-10-08T16:04:28.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07e9f46700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07e4144090 0x7f07e40aca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:28.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07e9f46700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07e4144090 0x7f07e40aca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43274/0 (socket says 172.21.15.133:43274) 2023-10-08T16:04:28.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07e9f46700 1 -- 172.21.15.133:0/2266122775 learned_addr learned my addr 172.21.15.133:0/2266122775 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:28.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07e9745700 1 --2- 172.21.15.133:0/2266122775 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07e40ae190 0x7f07e4142b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:28.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07e8f44700 1 --2- 172.21.15.133:0/2266122775 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07e40ae560 0x7f07e40abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:28.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07e9f46700 1 -- 172.21.15.133:0/2266122775 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07e40ae190 msgr2=0x7f07e4142b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:28.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07e9f46700 1 --2- 172.21.15.133:0/2266122775 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07e40ae190 0x7f07e4142b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:28.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07e9f46700 1 -- 172.21.15.133:0/2266122775 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07e40ae560 msgr2=0x7f07e40abf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:28.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07e9f46700 1 --2- 172.21.15.133:0/2266122775 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07e40ae560 0x7f07e40abf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:28.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07e9f46700 1 -- 172.21.15.133:0/2266122775 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc009a20 con 0x7f07e4144090 2023-10-08T16:04:28.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07e8f44700 1 --2- 172.21.15.133:0/2266122775 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07e40ae560 0x7f07e40abf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:04:28.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:27.999+0000 7f07e9f46700 1 --2- 172.21.15.133:0/2266122775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07e4144090 0x7f07e40aca40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f07e000c560 tx=0x7f07e0007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:28.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.003+0000 7f07d97fa700 1 -- 172.21.15.133:0/2266122775 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e0001120 con 0x7f07e4144090 2023-10-08T16:04:28.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.003+0000 7f07d97fa700 1 -- 172.21.15.133:0/2266122775 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e0011590 con 0x7f07e4144090 2023-10-08T16:04:28.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.003+0000 7f07eb9a9700 1 -- 172.21.15.133:0/2266122775 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e40ac4c0 con 0x7f07e4144090 2023-10-08T16:04:28.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.003+0000 7f07d97fa700 1 -- 172.21.15.133:0/2266122775 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e0011950 con 0x7f07e4144090 2023-10-08T16:04:28.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.003+0000 7f07eb9a9700 1 -- 172.21.15.133:0/2266122775 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e41523b0 con 0x7f07e4144090 2023-10-08T16:04:28.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.003+0000 7f07d97fa700 1 -- 172.21.15.133:0/2266122775 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f07e0011d00 con 0x7f07e4144090 2023-10-08T16:04:28.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.003+0000 7f07eb9a9700 1 -- 172.21.15.133:0/2266122775 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e40ad040 con 0x7f07e4144090 2023-10-08T16:04:28.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.007+0000 7f07d97fa700 1 --2- 172.21.15.133:0/2266122775 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f07c8060550 0x7f07c8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:28.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.007+0000 7f07e9745700 1 --2- 172.21.15.133:0/2266122775 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f07c8060550 0x7f07c8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:28.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.007+0000 7f07d97fa700 1 -- 172.21.15.133:0/2266122775 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f07e007bbb0 con 0x7f07e4144090 2023-10-08T16:04:28.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.007+0000 7f07e9745700 1 --2- 172.21.15.133:0/2266122775 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f07c8060550 0x7f07c8062a00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f07d4007fd0 tx=0x7f07d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:28.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.015+0000 7f07d97fa700 1 -- 172.21.15.133:0/2266122775 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f07e004c100 con 0x7f07e4144090 2023-10-08T16:04:28.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.215+0000 7f07eb9a9700 1 -- 172.21.15.133:0/2266122775 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07e4064810 con 0x7f07e4144090 2023-10-08T16:04:28.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.215+0000 7f07d97fa700 1 -- 172.21.15.133:0/2266122775 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3082 (secure 0 0 0) 0x7f07e0017c20 con 0x7f07e4144090 2023-10-08T16:04:28.219 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:04:28.219 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3690493804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3690493804},{"type":"v1","addr":"172.21.15.190:6833","nonce":3690493804}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:04:16.997946+0000","modified":"2023-10-08T16:04:19.656961+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/443398897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":443398897},{"type":"v1","addr":"172.21.15.133:6835","nonce":443398897}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:04:28.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.219+0000 7f07eb9a9700 1 -- 172.21.15.133:0/2266122775 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f07c8060550 msgr2=0x7f07c8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:28.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.219+0000 7f07eb9a9700 1 --2- 172.21.15.133:0/2266122775 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f07c8060550 0x7f07c8062a00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f07d4007fd0 tx=0x7f07d4009040 comp rx=0 tx=0).stop 2023-10-08T16:04:28.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.219+0000 7f07eb9a9700 1 -- 172.21.15.133:0/2266122775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07e4144090 msgr2=0x7f07e40aca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:28.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.219+0000 7f07eb9a9700 1 --2- 172.21.15.133:0/2266122775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07e4144090 0x7f07e40aca40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f07e000c560 tx=0x7f07e0007ef0 comp rx=0 tx=0).stop 2023-10-08T16:04:28.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.219+0000 7f07eb9a9700 1 -- 172.21.15.133:0/2266122775 shutdown_connections 2023-10-08T16:04:28.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.219+0000 7f07eb9a9700 1 --2- 172.21.15.133:0/2266122775 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f07c8060550 0x7f07c8062a00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:28.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.219+0000 7f07eb9a9700 1 --2- 172.21.15.133:0/2266122775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07e4144090 0x7f07e40aca40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:28.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.219+0000 7f07eb9a9700 1 --2- 172.21.15.133:0/2266122775 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07e40ae560 0x7f07e40abf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:28.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.219+0000 7f07eb9a9700 1 --2- 172.21.15.133:0/2266122775 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07e40ae190 0x7f07e4142b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:28.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.219+0000 7f07eb9a9700 1 -- 172.21.15.133:0/2266122775 >> 172.21.15.133:0/2266122775 conn(0x7f07e40b4ba0 msgr2=0x7f07e406d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:28.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.219+0000 7f07eb9a9700 1 -- 172.21.15.133:0/2266122775 shutdown_connections 2023-10-08T16:04:28.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.219+0000 7f07eb9a9700 1 -- 172.21.15.133:0/2266122775 wait complete. 2023-10-08T16:04:28.222 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 6 2023-10-08T16:04:28.233 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:04:28.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.335+0000 7ff7d2ee3700 1 Processor -- start 2023-10-08T16:04:28.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.335+0000 7ff7d2ee3700 1 -- start start 2023-10-08T16:04:28.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.335+0000 7ff7d2ee3700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff7cc0b0030 0x7ff7cc0ae180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:28.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.335+0000 7ff7d2ee3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7cc0b0ec0 con 0x7ff7cc068380 2023-10-08T16:04:28.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.335+0000 7ff7d2ee3700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7cc0ad4f0 con 0x7ff7cc0b1dc0 2023-10-08T16:04:28.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.335+0000 7ff7d2ee3700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7cc0ae6c0 con 0x7ff7cc0b0030 2023-10-08T16:04:28.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.335+0000 7ff7d26e2700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff7cc068380 0x7ff7cc1514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49560/0 (socket says 172.21.15.133:49560) 2023-10-08T16:04:28.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.335+0000 7ff7d26e2700 1 -- 172.21.15.133:0/1067130074 learned_addr learned my addr 172.21.15.133:0/1067130074 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:28.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.335+0000 7ff7d16e0700 1 --2- 172.21.15.133:0/1067130074 >> v2:172.21.15.190:3300/0 conn(0x7ff7cc0b0030 0x7ff7cc0ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:28.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.335+0000 7ff7d16e0700 1 -- 172.21.15.133:0/1067130074 >> v1:172.21.15.190:6789/0 conn(0x7ff7cc0b1dc0 legacy=0x7ff7cc067c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:28.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.335+0000 7ff7d16e0700 1 -- 172.21.15.133:0/1067130074 >> v1:172.21.15.133:6789/0 conn(0x7ff7cc068380 legacy=0x7ff7cc1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:28.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.335+0000 7ff7d0edf700 1 -- 172.21.15.133:0/1067130074 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596114927 0 0) 0x7ff7cc0b0ec0 con 0x7ff7cc068380 2023-10-08T16:04:28.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.335+0000 7ff7d16e0700 1 -- 172.21.15.133:0/1067130074 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc0ac250 con 0x7ff7cc0b0030 2023-10-08T16:04:28.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.335+0000 7ff7d16e0700 1 --2- 172.21.15.133:0/1067130074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7cc0b0030 0x7ff7cc0ae180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4009e60 tx=0x7ff7c4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f6dab10b4411ef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:28.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.335+0000 7ff7d0edf700 1 -- 172.21.15.133:0/1067130074 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c400e070 con 0x7ff7cc0b0030 2023-10-08T16:04:28.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.335+0000 7ff7d0edf700 1 -- 172.21.15.133:0/1067130074 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c400bc30 con 0x7ff7cc0b0030 2023-10-08T16:04:28.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.335+0000 7ff7d0edf700 1 -- 172.21.15.133:0/1067130074 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c4012430 con 0x7ff7cc0b0030 2023-10-08T16:04:28.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.339+0000 7ff7d2ee3700 1 -- 172.21.15.133:0/1067130074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7cc0b0030 msgr2=0x7ff7cc0ae180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:28.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.339+0000 7ff7d2ee3700 1 --2- 172.21.15.133:0/1067130074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7cc0b0030 0x7ff7cc0ae180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4009e60 tx=0x7ff7c4009780 comp rx=0 tx=0).stop 2023-10-08T16:04:28.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.339+0000 7ff7d2ee3700 1 -- 172.21.15.133:0/1067130074 shutdown_connections 2023-10-08T16:04:28.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.339+0000 7ff7d2ee3700 1 --2- 172.21.15.133:0/1067130074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7cc0b0030 0x7ff7cc0ae180 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:28.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.339+0000 7ff7d2ee3700 1 -- 172.21.15.133:0/1067130074 >> 172.21.15.133:0/1067130074 conn(0x7ff7cc063670 msgr2=0x7ff7cc0b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:28.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.339+0000 7ff7d2ee3700 1 -- 172.21.15.133:0/1067130074 shutdown_connections 2023-10-08T16:04:28.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.339+0000 7ff7d2ee3700 1 -- 172.21.15.133:0/1067130074 wait complete. 2023-10-08T16:04:28.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.339+0000 7ff7d2ee3700 1 Processor -- start 2023-10-08T16:04:28.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.339+0000 7ff7d2ee3700 1 -- start start 2023-10-08T16:04:28.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.343+0000 7ff7d2ee3700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7cc068380 0x7ff7cc156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:28.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.343+0000 7ff7d2ee3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7cc0b0030 0x7ff7cc0aacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:28.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.343+0000 7ff7d2ee3700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7cc0b1dc0 0x7ff7cc143710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:28.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.343+0000 7ff7d2ee3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc142fa0 con 0x7ff7cc0b0030 2023-10-08T16:04:28.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.343+0000 7ff7d2ee3700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc145ef0 con 0x7ff7cc068380 2023-10-08T16:04:28.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.343+0000 7ff7d2ee3700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc156b50 con 0x7ff7cc0b1dc0 2023-10-08T16:04:28.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.343+0000 7ff7d16e0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7cc0b0030 0x7ff7cc0aacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:28.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.343+0000 7ff7d16e0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7cc0b0030 0x7ff7cc0aacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43276/0 (socket says 172.21.15.133:43276) 2023-10-08T16:04:28.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.343+0000 7ff7d16e0700 1 -- 172.21.15.133:0/261915022 learned_addr learned my addr 172.21.15.133:0/261915022 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:28.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.343+0000 7ff7d26e2700 1 --2- 172.21.15.133:0/261915022 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7cc0b1dc0 0x7ff7cc143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:28.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.343+0000 7ff7d1ee1700 1 --2- 172.21.15.133:0/261915022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7cc068380 0x7ff7cc156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:28.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.343+0000 7ff7d16e0700 1 -- 172.21.15.133:0/261915022 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7cc0b1dc0 msgr2=0x7ff7cc143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:28.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.343+0000 7ff7d16e0700 1 --2- 172.21.15.133:0/261915022 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7cc0b1dc0 0x7ff7cc143710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:28.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.343+0000 7ff7d16e0700 1 -- 172.21.15.133:0/261915022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7cc068380 msgr2=0x7ff7cc156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:28.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.343+0000 7ff7d16e0700 1 --2- 172.21.15.133:0/261915022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7cc068380 0x7ff7cc156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:28.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.343+0000 7ff7d16e0700 1 -- 172.21.15.133:0/261915022 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c4009a20 con 0x7ff7cc0b0030 2023-10-08T16:04:28.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.343+0000 7ff7d16e0700 1 --2- 172.21.15.133:0/261915022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7cc0b0030 0x7ff7cc0aacd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40099f0 tx=0x7ff7c4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:28.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.343+0000 7ff7c9ffb700 1 -- 172.21.15.133:0/261915022 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c401b420 con 0x7ff7cc0b0030 2023-10-08T16:04:28.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.343+0000 7ff7c9ffb700 1 -- 172.21.15.133:0/261915022 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c401b5c0 con 0x7ff7cc0b0030 2023-10-08T16:04:28.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.343+0000 7ff7c9ffb700 1 -- 172.21.15.133:0/261915022 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c401b980 con 0x7ff7cc0b0030 2023-10-08T16:04:28.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.343+0000 7ff7d2ee3700 1 -- 172.21.15.133:0/261915022 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7cc156e00 con 0x7ff7cc0b0030 2023-10-08T16:04:28.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.343+0000 7ff7d2ee3700 1 -- 172.21.15.133:0/261915022 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7cc142620 con 0x7ff7cc0b0030 2023-10-08T16:04:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.343+0000 7ff7d2ee3700 1 -- 172.21.15.133:0/261915022 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7cc1433f0 con 0x7ff7cc0b0030 2023-10-08T16:04:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.347+0000 7ff7c9ffb700 1 -- 172.21.15.133:0/261915022 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff7c401bcf0 con 0x7ff7cc0b0030 2023-10-08T16:04:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.347+0000 7ff7c9ffb700 1 --2- 172.21.15.133:0/261915022 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff7b8060550 0x7ff7b8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.347+0000 7ff7c9ffb700 1 -- 172.21.15.133:0/261915022 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff7c407e300 con 0x7ff7cc0b0030 2023-10-08T16:04:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.347+0000 7ff7d1ee1700 1 --2- 172.21.15.133:0/261915022 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff7b8060550 0x7ff7b8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.347+0000 7ff7d1ee1700 1 --2- 172.21.15.133:0/261915022 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff7b8060550 0x7ff7b8062a00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff7c00039e0 tx=0x7ff7c0007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:28.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.351+0000 7ff7c9ffb700 1 -- 172.21.15.133:0/261915022 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff7c404e9a0 con 0x7ff7cc0b0030 2023-10-08T16:04:28.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.519+0000 7ff7d2ee3700 1 -- 172.21.15.133:0/261915022 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7cc04be40 con 0x7ff7cc0b0030 2023-10-08T16:04:28.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.519+0000 7ff7c9ffb700 1 -- 172.21.15.133:0/261915022 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7ff7c4051fc0 con 0x7ff7cc0b0030 2023-10-08T16:04:28.524 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:04:28.524 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"f2546191-d59e-4805-8e1b-3d8d3d1dad86","created":"2023-10-08T16:03:52.631855+0000","modified":"2023-10-08T16:04:18.600728+0000","last_up_change":"2023-10-08T16:04:04.030581+0000","last_in_change":"2023-10-08T16:03:54.835293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:04.898316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:14.869859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:15.983795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8c5deadf-a203-4d30-aa7f-6e2e492b6ffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6809","nonce":33493},{"type":"v1","addr":"172.21.15.133:6811","nonce":33493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":33493},{"type":"v1","addr":"172.21.15.133:6815","nonce":33493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":33493},{"type":"v1","addr":"172.21.15.133:6822","nonce":33493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":33493},{"type":"v1","addr":"172.21.15.133:6818","nonce":33493}]},"public_addr":"172.21.15.133:6811/33493","cluster_addr":"172.21.15.133:6815/33493","heartbeat_back_addr":"172.21.15.133:6822/33493","heartbeat_front_addr":"172.21.15.133:6818/33493","state":["exists","up"]},{"osd":1,"uuid":"9b081c42-c915-48c3-a1ad-410f09a78576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":33490},{"type":"v1","addr":"172.21.15.133:6801","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":33490},{"type":"v1","addr":"172.21.15.133:6803","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":33490},{"type":"v1","addr":"172.21.15.133:6807","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":33490},{"type":"v1","addr":"172.21.15.133:6805","nonce":33490}]},"public_addr":"172.21.15.133:6801/33490","cluster_addr":"172.21.15.133:6803/33490","heartbeat_back_addr":"172.21.15.133:6807/33490","heartbeat_front_addr":"172.21.15.133:6805/33490","state":["exists","up"]},{"osd":2,"uuid":"88ecda43-01cd-4644-ab0c-92c91fd38966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":33492},{"type":"v1","addr":"172.21.15.133:6825","nonce":33492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":33492},{"type":"v1","addr":"172.21.15.133:6827","nonce":33492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":33492},{"type":"v1","addr":"172.21.15.133:6831","nonce":33492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":33492},{"type":"v1","addr":"172.21.15.133:6829","nonce":33492}]},"public_addr":"172.21.15.133:6825/33492","cluster_addr":"172.21.15.133:6827/33492","heartbeat_back_addr":"172.21.15.133:6831/33492","heartbeat_front_addr":"172.21.15.133:6829/33492","state":["exists","up"]},{"osd":3,"uuid":"39faf38d-b8e2-4e11-9b3b-84dc834c977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":33491},{"type":"v1","addr":"172.21.15.133:6810","nonce":33491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":33491},{"type":"v1","addr":"172.21.15.133:6814","nonce":33491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":33491},{"type":"v1","addr":"172.21.15.133:6823","nonce":33491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":33491},{"type":"v1","addr":"172.21.15.133:6819","nonce":33491}]},"public_addr":"172.21.15.133:6810/33491","cluster_addr":"172.21.15.133:6814/33491","heartbeat_back_addr":"172.21.15.133:6823/33491","heartbeat_front_addr":"172.21.15.133:6819/33491","state":["exists","up"]},{"osd":4,"uuid":"4c097e61-1cad-4b61-9183-4e7bc486bd32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":33678},{"type":"v1","addr":"172.21.15.190:6810","nonce":33678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":33678},{"type":"v1","addr":"172.21.15.190:6814","nonce":33678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":33678},{"type":"v1","addr":"172.21.15.190:6822","nonce":33678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":33678},{"type":"v1","addr":"172.21.15.190:6818","nonce":33678}]},"public_addr":"172.21.15.190:6810/33678","cluster_addr":"172.21.15.190:6814/33678","heartbeat_back_addr":"172.21.15.190:6822/33678","heartbeat_front_addr":"172.21.15.190:6818/33678","state":["exists","up"]},{"osd":5,"uuid":"05f072e0-7bc0-40f0-8cb6-8e322c82d6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":33676},{"type":"v1","addr":"172.21.15.190:6811","nonce":33676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":33676},{"type":"v1","addr":"172.21.15.190:6815","nonce":33676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":33676},{"type":"v1","addr":"172.21.15.190:6823","nonce":33676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":33676},{"type":"v1","addr":"172.21.15.190:6819","nonce":33676}]},"public_addr":"172.21.15.190:6811/33676","cluster_addr":"172.21.15.190:6815/33676","heartbeat_back_addr":"172.21.15.190:6823/33676","heartbeat_front_addr":"172.21.15.190:6819/33676","state":["exists","up"]},{"osd":6,"uuid":"1bcce8d7-14f3-442d-b135-68c7d66cdedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":33677},{"type":"v1","addr":"172.21.15.190:6801","nonce":33677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":33677},{"type":"v1","addr":"172.21.15.190:6803","nonce":33677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":33677},{"type":"v1","addr":"172.21.15.190:6807","nonce":33677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":33677},{"type":"v1","addr":"172.21.15.190:6805","nonce":33677}]},"public_addr":"172.21.15.190:6801/33677","cluster_addr":"172.21.15.190:6803/33677","heartbeat_back_addr":"172.21.15.190:6807/33677","heartbeat_front_addr":"172.21.15.190:6805/33677","state":["exists","up"]},{"osd":7,"uuid":"9157dbf7-2bf9-43d7-a89a-a8e3dae7514c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":33686},{"type":"v1","addr":"172.21.15.190:6825","nonce":33686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":33686},{"type":"v1","addr":"172.21.15.190:6827","nonce":33686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":33686},{"type":"v1","addr":"172.21.15.190:6831","nonce":33686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":33686},{"type":"v1","addr":"172.21.15.190:6829","nonce":33686}]},"public_addr":"172.21.15.190:6825/33686","cluster_addr":"172.21.15.190:6827/33686","heartbeat_back_addr":"172.21.15.190:6831/33686","heartbeat_front_addr":"172.21.15.190:6829/33686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.886742+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.199618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.871695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.115926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.069650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.841448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.132320+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.315132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:04:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.523+0000 7ff7d2ee3700 1 -- 172.21.15.133:0/261915022 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff7b8060550 msgr2=0x7ff7b8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.523+0000 7ff7d2ee3700 1 --2- 172.21.15.133:0/261915022 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff7b8060550 0x7ff7b8062a00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff7c00039e0 tx=0x7ff7c0007ec0 comp rx=0 tx=0).stop 2023-10-08T16:04:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.523+0000 7ff7d2ee3700 1 -- 172.21.15.133:0/261915022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7cc0b0030 msgr2=0x7ff7cc0aacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.523+0000 7ff7d2ee3700 1 --2- 172.21.15.133:0/261915022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7cc0b0030 0x7ff7cc0aacd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40099f0 tx=0x7ff7c4019000 comp rx=0 tx=0).stop 2023-10-08T16:04:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.523+0000 7ff7d2ee3700 1 -- 172.21.15.133:0/261915022 shutdown_connections 2023-10-08T16:04:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.523+0000 7ff7d2ee3700 1 --2- 172.21.15.133:0/261915022 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff7b8060550 0x7ff7b8062a00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.523+0000 7ff7d2ee3700 1 --2- 172.21.15.133:0/261915022 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff7cc0b1dc0 0x7ff7cc143710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.523+0000 7ff7d2ee3700 1 --2- 172.21.15.133:0/261915022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7cc0b0030 0x7ff7cc0aacd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.523+0000 7ff7d2ee3700 1 --2- 172.21.15.133:0/261915022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7cc068380 0x7ff7cc156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.523+0000 7ff7d2ee3700 1 -- 172.21.15.133:0/261915022 >> 172.21.15.133:0/261915022 conn(0x7ff7cc063670 msgr2=0x7ff7cc14c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.523+0000 7ff7d2ee3700 1 -- 172.21.15.133:0/261915022 shutdown_connections 2023-10-08T16:04:28.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.523+0000 7ff7d2ee3700 1 -- 172.21.15.133:0/261915022 wait complete. 2023-10-08T16:04:28.539 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:04:28.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f53163700 1 Processor -- start 2023-10-08T16:04:28.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f53163700 1 -- start start 2023-10-08T16:04:28.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f53163700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f4c0b5b80 0x7f8f4c145af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:28.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f53163700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f4c0b2ae0 con 0x7f8f4c0b4cf0 2023-10-08T16:04:28.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f53163700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f4c0b1d60 con 0x7f8f4c0b57b0 2023-10-08T16:04:28.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f53163700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c0b1090 con 0x7f8f4c0b5b80 2023-10-08T16:04:28.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f51700700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8f4c0b4cf0 0x7f8f4c14ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49574/0 (socket says 172.21.15.133:49574) 2023-10-08T16:04:28.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f51700700 1 -- 172.21.15.133:0/1617986366 learned_addr learned my addr 172.21.15.133:0/1617986366 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:28.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f4bfff700 1 --2- 172.21.15.133:0/1617986366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f4c0b5b80 0x7f8f4c145af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:28.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f4b7fe700 1 -- 172.21.15.133:0/1617986366 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332757898 0 0) 0x7f8f4c0b2ae0 con 0x7f8f4c0b4cf0 2023-10-08T16:04:28.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f4b7fe700 1 -- 172.21.15.133:0/1617986366 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f2c003570 con 0x7f8f4c0b4cf0 2023-10-08T16:04:28.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f4b7fe700 1 -- 172.21.15.133:0/1617986366 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755006850 0 0) 0x7f8f4c0b1d60 con 0x7f8f4c0b57b0 2023-10-08T16:04:28.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f4b7fe700 1 -- 172.21.15.133:0/1617986366 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f4c0b2ae0 con 0x7f8f4c0b57b0 2023-10-08T16:04:28.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f4b7fe700 1 -- 172.21.15.133:0/1617986366 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3128532223 0 0) 0x7f8f2c003570 con 0x7f8f4c0b4cf0 2023-10-08T16:04:28.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f4b7fe700 1 -- 172.21.15.133:0/1617986366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f4c0b5b80 msgr2=0x7f8f4c145af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:28.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f4b7fe700 1 --2- 172.21.15.133:0/1617986366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f4c0b5b80 0x7f8f4c145af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:28.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f4b7fe700 1 -- 172.21.15.133:0/1617986366 >> v1:172.21.15.190:6789/0 conn(0x7f8f4c0b57b0 legacy=0x7f8f4c0b0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:28.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f4b7fe700 1 -- 172.21.15.133:0/1617986366 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4c0b24d0 con 0x7f8f4c0b4cf0 2023-10-08T16:04:28.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f4b7fe700 1 -- 172.21.15.133:0/1617986366 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2883817959 0 0) 0x7f8f44001470 con 0x7f8f4c0b4cf0 2023-10-08T16:04:28.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f4bfff700 1 --2- 172.21.15.133:0/1617986366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f4c0b5b80 0x7f8f4c145af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:04:28.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f4b7fe700 1 -- 172.21.15.133:0/1617986366 >> v1:172.21.15.133:6789/0 conn(0x7f8f4c0b4cf0 legacy=0x7f8f4c14ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:28.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f4b7fe700 1 --2- 172.21.15.133:0/1617986366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f2c003c20 0x7f8f2c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:28.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f4b7fe700 1 --2- 172.21.15.133:0/1617986366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f4c0b5b80 0x7f8f2c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f4b7fe700 1 --2- 172.21.15.133:0/1617986366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f2c004d50 0x7f8f2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f4b7fe700 1 -- 172.21.15.133:0/1617986366 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c00bb10 con 0x7f8f2c003c20 2023-10-08T16:04:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f4b7fe700 1 -- 172.21.15.133:0/1617986366 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c00bc50 con 0x7f8f2c004d50 2023-10-08T16:04:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f4b7fe700 1 -- 172.21.15.133:0/1617986366 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c00be10 con 0x7f8f4c0b5b80 2023-10-08T16:04:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f50eff700 1 --2- 172.21.15.133:0/1617986366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f2c003c20 0x7f8f2c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f4bfff700 1 --2- 172.21.15.133:0/1617986366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f4c0b5b80 0x7f8f2c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f51700700 1 --2- 172.21.15.133:0/1617986366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f2c004d50 0x7f8f2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:28.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f50eff700 1 -- 172.21.15.133:0/1617986366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f4c0b5b80 msgr2=0x7f8f2c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:28.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f50eff700 1 --2- 172.21.15.133:0/1617986366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f4c0b5b80 0x7f8f2c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:28.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f50eff700 1 -- 172.21.15.133:0/1617986366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f2c004d50 msgr2=0x7f8f2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:28.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f50eff700 1 --2- 172.21.15.133:0/1617986366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f2c004d50 0x7f8f2c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:28.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f50eff700 1 -- 172.21.15.133:0/1617986366 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3c009420 con 0x7f8f2c003c20 2023-10-08T16:04:28.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.639+0000 7f8f50eff700 1 --2- 172.21.15.133:0/1617986366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f2c003c20 0x7f8f2c004010 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400c3c0 tx=0x7f8f34001bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e649597f9a03dbb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:28.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f4b7fe700 1 -- 172.21.15.133:0/1617986366 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34001ee0 con 0x7f8f2c003c20 2023-10-08T16:04:28.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f4b7fe700 1 -- 172.21.15.133:0/1617986366 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3400ccb0 con 0x7f8f2c003c20 2023-10-08T16:04:28.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f4b7fe700 1 -- 172.21.15.133:0/1617986366 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34012650 con 0x7f8f2c003c20 2023-10-08T16:04:28.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f53163700 1 -- 172.21.15.133:0/1617986366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f2c003c20 msgr2=0x7f8f2c004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:28.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f53163700 1 --2- 172.21.15.133:0/1617986366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f2c003c20 0x7f8f2c004010 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400c3c0 tx=0x7f8f34001bd0 comp rx=0 tx=0).stop 2023-10-08T16:04:28.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f51700700 1 -- 172.21.15.133:0/1617986366 reap_dead start 2023-10-08T16:04:28.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f53163700 1 -- 172.21.15.133:0/1617986366 shutdown_connections 2023-10-08T16:04:28.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f53163700 1 -- 172.21.15.133:0/1617986366 >> 172.21.15.133:0/1617986366 conn(0x7f8f4c062ba0 msgr2=0x7f8f4c062fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:28.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f53163700 1 -- 172.21.15.133:0/1617986366 shutdown_connections 2023-10-08T16:04:28.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f53163700 1 -- 172.21.15.133:0/1617986366 wait complete. 2023-10-08T16:04:28.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f53163700 1 Processor -- start 2023-10-08T16:04:28.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f53163700 1 -- start start 2023-10-08T16:04:28.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f53163700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f2c003c20 0x7f8f4c0a8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:28.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f53163700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f4c155e20 0x7f8f4c151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:28.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f53163700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f4c142630 0x7f8f4c0af370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:28.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f53163700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c155990 con 0x7f8f4c142630 2023-10-08T16:04:28.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f53163700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c0a8a40 con 0x7f8f4c155e20 2023-10-08T16:04:28.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f53163700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c155340 con 0x7f8f2c003c20 2023-10-08T16:04:28.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f51700700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f4c142630 0x7f8f4c0af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:28.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f51700700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f4c142630 0x7f8f4c0af370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43290/0 (socket says 172.21.15.133:43290) 2023-10-08T16:04:28.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f51700700 1 -- 172.21.15.133:0/2312716221 learned_addr learned my addr 172.21.15.133:0/2312716221 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:28.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f4bfff700 1 --2- 172.21.15.133:0/2312716221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f4c155e20 0x7f8f4c151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:28.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f50eff700 1 --2- 172.21.15.133:0/2312716221 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f2c003c20 0x7f8f4c0a8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:28.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f51700700 1 -- 172.21.15.133:0/2312716221 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f2c003c20 msgr2=0x7f8f4c0a8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:28.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f51700700 1 --2- 172.21.15.133:0/2312716221 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f2c003c20 0x7f8f4c0a8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:28.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f51700700 1 -- 172.21.15.133:0/2312716221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f4c155e20 msgr2=0x7f8f4c151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:28.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f51700700 1 --2- 172.21.15.133:0/2312716221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f4c155e20 0x7f8f4c151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:28.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f51700700 1 -- 172.21.15.133:0/2312716221 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4c155620 con 0x7f8f4c142630 2023-10-08T16:04:28.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f50eff700 1 --2- 172.21.15.133:0/2312716221 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f2c003c20 0x7f8f4c0a8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:28.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f4bfff700 1 --2- 172.21.15.133:0/2312716221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f4c155e20 0x7f8f4c151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:28.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.643+0000 7f8f51700700 1 --2- 172.21.15.133:0/2312716221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f4c142630 0x7f8f4c0af370 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c0b1c90 tx=0x7f8f4c143580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:28.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.647+0000 7f8f48ff9700 1 -- 172.21.15.133:0/2312716221 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f440077d0 con 0x7f8f4c142630 2023-10-08T16:04:28.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.647+0000 7f8f48ff9700 1 -- 172.21.15.133:0/2312716221 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f44000c70 con 0x7f8f4c142630 2023-10-08T16:04:28.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.647+0000 7f8f53163700 1 -- 172.21.15.133:0/2312716221 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f4c152100 con 0x7f8f4c142630 2023-10-08T16:04:28.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.647+0000 7f8f48ff9700 1 -- 172.21.15.133:0/2312716221 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4400fad0 con 0x7f8f4c142630 2023-10-08T16:04:28.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.647+0000 7f8f53163700 1 -- 172.21.15.133:0/2312716221 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f4c1432f0 con 0x7f8f4c142630 2023-10-08T16:04:28.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.647+0000 7f8f53163700 1 -- 172.21.15.133:0/2312716221 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f4c155b00 con 0x7f8f4c142630 2023-10-08T16:04:28.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.647+0000 7f8f48ff9700 1 -- 172.21.15.133:0/2312716221 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8f4401d460 con 0x7f8f4c142630 2023-10-08T16:04:28.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.647+0000 7f8f48ff9700 1 --2- 172.21.15.133:0/2312716221 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f8f30060550 0x7f8f30062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:28.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.651+0000 7f8f50eff700 1 --2- 172.21.15.133:0/2312716221 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f8f30060550 0x7f8f30062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:28.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.651+0000 7f8f48ff9700 1 -- 172.21.15.133:0/2312716221 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8f4407c700 con 0x7f8f4c142630 2023-10-08T16:04:28.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.651+0000 7f8f50eff700 1 --2- 172.21.15.133:0/2312716221 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f8f30060550 0x7f8f30062a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8f34000f80 tx=0x7f8f34016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:28.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.655+0000 7f8f48ff9700 1 -- 172.21.15.133:0/2312716221 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8f4404ccf0 con 0x7f8f4c142630 2023-10-08T16:04:28.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.847+0000 7f8f53163700 1 -- 172.21.15.133:0/2312716221 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f4c064810 con 0x7f8f4c142630 2023-10-08T16:04:28.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.851+0000 7f8f48ff9700 1 -- 172.21.15.133:0/2312716221 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3082 (secure 0 0 0) 0x7f8f44050310 con 0x7f8f4c142630 2023-10-08T16:04:28.854 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:04:28.854 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3690493804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3690493804},{"type":"v1","addr":"172.21.15.190:6833","nonce":3690493804}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:04:16.997946+0000","modified":"2023-10-08T16:04:19.656961+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/443398897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":443398897},{"type":"v1","addr":"172.21.15.133:6835","nonce":443398897}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:04:28.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.851+0000 7f8f53163700 1 -- 172.21.15.133:0/2312716221 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f8f30060550 msgr2=0x7f8f30062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:28.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.851+0000 7f8f53163700 1 --2- 172.21.15.133:0/2312716221 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f8f30060550 0x7f8f30062a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8f34000f80 tx=0x7f8f34016000 comp rx=0 tx=0).stop 2023-10-08T16:04:28.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.851+0000 7f8f53163700 1 -- 172.21.15.133:0/2312716221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f4c142630 msgr2=0x7f8f4c0af370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:28.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.851+0000 7f8f53163700 1 --2- 172.21.15.133:0/2312716221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f4c142630 0x7f8f4c0af370 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c0b1c90 tx=0x7f8f4c143580 comp rx=0 tx=0).stop 2023-10-08T16:04:28.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.851+0000 7f8f53163700 1 -- 172.21.15.133:0/2312716221 shutdown_connections 2023-10-08T16:04:28.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.851+0000 7f8f53163700 1 --2- 172.21.15.133:0/2312716221 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f8f30060550 0x7f8f30062a00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:28.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.851+0000 7f8f53163700 1 --2- 172.21.15.133:0/2312716221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f4c142630 0x7f8f4c0af370 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:28.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.851+0000 7f8f53163700 1 --2- 172.21.15.133:0/2312716221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f4c155e20 0x7f8f4c151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:28.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.851+0000 7f8f53163700 1 --2- 172.21.15.133:0/2312716221 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f2c003c20 0x7f8f4c0a8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:28.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.851+0000 7f8f53163700 1 -- 172.21.15.133:0/2312716221 >> 172.21.15.133:0/2312716221 conn(0x7f8f4c062ba0 msgr2=0x7f8f4c0b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:28.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.851+0000 7f8f53163700 1 -- 172.21.15.133:0/2312716221 shutdown_connections 2023-10-08T16:04:28.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:28.851+0000 7f8f53163700 1 -- 172.21.15.133:0/2312716221 wait complete. 2023-10-08T16:04:28.857 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 6 2023-10-08T16:04:29.068 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T16:04:16.997946+0000', 'modified': '2023-10-08T16:04:19.656961+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6835/443398897', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 443398897}, {'type': 'v1', 'addr': '172.21.15.133:6835', 'nonce': 443398897}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T16:04:29.068 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T16:04:29.069 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-08T16:04:29.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.187+0000 7f6b8359e700 1 Processor -- start 2023-10-08T16:04:29.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.187+0000 7f6b8359e700 1 -- start start 2023-10-08T16:04:29.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.187+0000 7f6b8359e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b840b5ef0 0x7f6b84146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:29.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.187+0000 7f6b8359e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b84142740 con 0x7f6b84063870 2023-10-08T16:04:29.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.187+0000 7f6b8359e700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b841466a0 con 0x7f6b840b62c0 2023-10-08T16:04:29.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.187+0000 7f6b8359e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b840b22d0 con 0x7f6b840b5ef0 2023-10-08T16:04:29.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.187+0000 7f6b81d9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6b84063870 0x7f6b8406df40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49590/0 (socket says 172.21.15.133:49590) 2023-10-08T16:04:29.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.187+0000 7f6b81d9b700 1 -- 172.21.15.133:0/3224738296 learned_addr learned my addr 172.21.15.133:0/3224738296 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:04:29.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.191+0000 7f6b8259c700 1 --2- 172.21.15.133:0/3224738296 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b840b5ef0 0x7f6b84146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:29.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.191+0000 7f6b8159a700 1 -- 172.21.15.133:0/3224738296 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863821384 0 0) 0x7f6b84142740 con 0x7f6b84063870 2023-10-08T16:04:29.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.191+0000 7f6b8159a700 1 -- 172.21.15.133:0/3224738296 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b70003570 con 0x7f6b84063870 2023-10-08T16:04:29.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.191+0000 7f6b8159a700 1 -- 172.21.15.133:0/3224738296 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2204571482 0 0) 0x7f6b841466a0 con 0x7f6b840b62c0 2023-10-08T16:04:29.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.191+0000 7f6b8159a700 1 -- 172.21.15.133:0/3224738296 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b84142740 con 0x7f6b840b62c0 2023-10-08T16:04:29.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.191+0000 7f6b8159a700 1 -- 172.21.15.133:0/3224738296 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 629691216 0 0) 0x7f6b70003570 con 0x7f6b84063870 2023-10-08T16:04:29.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.191+0000 7f6b8259c700 1 -- 172.21.15.133:0/3224738296 >> v1:172.21.15.190:6789/0 conn(0x7f6b840b62c0 legacy=0x7f6b84142bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:29.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.191+0000 7f6b8259c700 1 -- 172.21.15.133:0/3224738296 >> v1:172.21.15.133:6789/0 conn(0x7f6b84063870 legacy=0x7f6b8406df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:29.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.191+0000 7f6b8259c700 1 -- 172.21.15.133:0/3224738296 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b84146980 con 0x7f6b840b5ef0 2023-10-08T16:04:29.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.191+0000 7f6b8259c700 1 --2- 172.21.15.133:0/3224738296 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b840b5ef0 0x7f6b84146080 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c009910 tx=0x7f6b6c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=336c422dc3296358 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:29.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.191+0000 7f6b8159a700 1 -- 172.21.15.133:0/3224738296 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b740017f0 con 0x7f6b840b5ef0 2023-10-08T16:04:29.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.191+0000 7f6b8159a700 1 -- 172.21.15.133:0/3224738296 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6c011420 con 0x7f6b840b5ef0 2023-10-08T16:04:29.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.191+0000 7f6b8159a700 1 -- 172.21.15.133:0/3224738296 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c0117c0 con 0x7f6b840b5ef0 2023-10-08T16:04:29.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.191+0000 7f6b8359e700 1 -- 172.21.15.133:0/3224738296 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b840b5ef0 msgr2=0x7f6b84146080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:29.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.191+0000 7f6b8359e700 1 --2- 172.21.15.133:0/3224738296 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b840b5ef0 0x7f6b84146080 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c009910 tx=0x7f6b6c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.191+0000 7f6b8359e700 1 -- 172.21.15.133:0/3224738296 shutdown_connections 2023-10-08T16:04:29.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.191+0000 7f6b8359e700 1 --2- 172.21.15.133:0/3224738296 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b840b5ef0 0x7f6b84146080 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.191+0000 7f6b8359e700 1 -- 172.21.15.133:0/3224738296 >> 172.21.15.133:0/3224738296 conn(0x7f6b84070bd0 msgr2=0x7f6b8406a740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:29.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.191+0000 7f6b8359e700 1 -- 172.21.15.133:0/3224738296 shutdown_connections 2023-10-08T16:04:29.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.191+0000 7f6b8359e700 1 -- 172.21.15.133:0/3224738296 wait complete. 2023-10-08T16:04:29.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.195+0000 7f6b8359e700 1 Processor -- start 2023-10-08T16:04:29.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.195+0000 7f6b8359e700 1 -- start start 2023-10-08T16:04:29.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.195+0000 7f6b8359e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b84063870 0x7f6b84155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:29.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.195+0000 7f6b8359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b840b5ef0 0x7f6b840b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:29.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.195+0000 7f6b8359e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b840b62c0 0x7f6b840b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:29.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.195+0000 7f6b8359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b840ac1f0 con 0x7f6b840b5ef0 2023-10-08T16:04:29.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.195+0000 7f6b8359e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b840b3df0 con 0x7f6b84063870 2023-10-08T16:04:29.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.195+0000 7f6b8359e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b840b4660 con 0x7f6b840b62c0 2023-10-08T16:04:29.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.195+0000 7f6b81d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b840b5ef0 0x7f6b840b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:29.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.195+0000 7f6b81d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b840b5ef0 0x7f6b840b38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43296/0 (socket says 172.21.15.133:43296) 2023-10-08T16:04:29.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.195+0000 7f6b81d9b700 1 -- 172.21.15.133:0/1023719224 learned_addr learned my addr 172.21.15.133:0/1023719224 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:29.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.195+0000 7f6b8259c700 1 --2- 172.21.15.133:0/1023719224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b84063870 0x7f6b84155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:29.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.195+0000 7f6b82d9d700 1 --2- 172.21.15.133:0/1023719224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b840b62c0 0x7f6b840b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:29.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.195+0000 7f6b81d9b700 1 -- 172.21.15.133:0/1023719224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b840b62c0 msgr2=0x7f6b840b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:29.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.195+0000 7f6b81d9b700 1 --2- 172.21.15.133:0/1023719224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b840b62c0 0x7f6b840b4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.195+0000 7f6b81d9b700 1 -- 172.21.15.133:0/1023719224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b84063870 msgr2=0x7f6b84155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:29.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.195+0000 7f6b81d9b700 1 --2- 172.21.15.133:0/1023719224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b84063870 0x7f6b84155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.195+0000 7f6b81d9b700 1 -- 172.21.15.133:0/1023719224 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c009420 con 0x7f6b840b5ef0 2023-10-08T16:04:29.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.195+0000 7f6b82d9d700 1 --2- 172.21.15.133:0/1023719224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b840b62c0 0x7f6b840b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:29.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.195+0000 7f6b81d9b700 1 --2- 172.21.15.133:0/1023719224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b840b5ef0 0x7f6b840b38b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6b740021e0 tx=0x7f6b74001d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:29.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.195+0000 7f6b7a7fc700 1 -- 172.21.15.133:0/1023719224 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7400abc0 con 0x7f6b840b5ef0 2023-10-08T16:04:29.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.195+0000 7f6b8359e700 1 -- 172.21.15.133:0/1023719224 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b840ac610 con 0x7f6b840b5ef0 2023-10-08T16:04:29.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.195+0000 7f6b8359e700 1 -- 172.21.15.133:0/1023719224 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b840a9a60 con 0x7f6b840b5ef0 2023-10-08T16:04:29.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.195+0000 7f6b7a7fc700 1 -- 172.21.15.133:0/1023719224 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7400ad20 con 0x7f6b840b5ef0 2023-10-08T16:04:29.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.195+0000 7f6b7a7fc700 1 -- 172.21.15.133:0/1023719224 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b74007320 con 0x7f6b840b5ef0 2023-10-08T16:04:29.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.199+0000 7f6b7a7fc700 1 -- 172.21.15.133:0/1023719224 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6b740076d0 con 0x7f6b840b5ef0 2023-10-08T16:04:29.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.199+0000 7f6b7a7fc700 1 --2- 172.21.15.133:0/1023719224 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6b64060550 0x7f6b64062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:29.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.199+0000 7f6b7a7fc700 1 -- 172.21.15.133:0/1023719224 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6b7407c6a0 con 0x7f6b840b5ef0 2023-10-08T16:04:29.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.199+0000 7f6b8259c700 1 --2- 172.21.15.133:0/1023719224 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6b64060550 0x7f6b64062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:29.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.199+0000 7f6b8259c700 1 --2- 172.21.15.133:0/1023719224 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6b64060550 0x7f6b64062a00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0030c0 tx=0x7f6b6c016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:29.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.203+0000 7f6b8afa3740 1 Processor -- start 2023-10-08T16:04:29.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.203+0000 7f6b8afa3740 1 -- start start 2023-10-08T16:04:29.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.203+0000 7f6b8afa3740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x1703ae0 0x1963ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:29.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.203+0000 7f6b8afa3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x1703710 0x1937820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:29.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.203+0000 7f6b8afa3740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x174e790 0x1966a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:29.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.203+0000 7f6b8afa3740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x18aef30 con 0x174e790 2023-10-08T16:04:29.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.203+0000 7f6b8afa3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x18aaed0 con 0x1703710 2023-10-08T16:04:29.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.203+0000 7f6b8afa3740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x18710b0 con 0x1703ae0 2023-10-08T16:04:29.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.203+0000 7f6b82d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x174e790 0x1966a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:29.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.203+0000 7f6b82d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x174e790 0x1966a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43300/0 (socket says 172.21.15.133:43300) 2023-10-08T16:04:29.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.203+0000 7f6b82d9d700 1 -- 172.21.15.133:0/3433260566 learned_addr learned my addr 172.21.15.133:0/3433260566 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:29.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.203+0000 7f6b8259c700 1 --2- 172.21.15.133:0/3433260566 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x1703ae0 0x1963ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:29.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.203+0000 7f6b81d9b700 1 --2- 172.21.15.133:0/3433260566 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x1703710 0x1937820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:29.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.203+0000 7f6b82d9d700 1 -- 172.21.15.133:0/3433260566 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x1703ae0 msgr2=0x1963ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:29.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.203+0000 7f6b82d9d700 1 --2- 172.21.15.133:0/3433260566 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x1703ae0 0x1963ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.203+0000 7f6b82d9d700 1 -- 172.21.15.133:0/3433260566 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x1703710 msgr2=0x1937820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:29.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.203+0000 7f6b82d9d700 1 --2- 172.21.15.133:0/3433260566 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x1703710 0x1937820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.203+0000 7f6b82d9d700 1 -- 172.21.15.133:0/3433260566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x174f9e0 con 0x174e790 2023-10-08T16:04:29.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.203+0000 7f6b82d9d700 1 --2- 172.21.15.133:0/3433260566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x174e790 0x1966a10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c0037b0 tx=0x7f6b7c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1d91830003709e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:29.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.203+0000 7f6b637fe700 1 -- 172.21.15.133:0/3433260566 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c00e6b0 con 0x174e790 2023-10-08T16:04:29.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.203+0000 7f6b637fe700 1 -- 172.21.15.133:0/3433260566 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7c00e810 con 0x174e790 2023-10-08T16:04:29.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.203+0000 7f6b637fe700 1 -- 172.21.15.133:0/3433260566 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c00ebb0 con 0x174e790 2023-10-08T16:04:29.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b8afa3740 1 -- 172.21.15.133:0/3433260566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x174e790 msgr2=0x1966a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:29.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b8afa3740 1 --2- 172.21.15.133:0/3433260566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x174e790 0x1966a10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c0037b0 tx=0x7f6b7c009040 comp rx=0 tx=0).stop 2023-10-08T16:04:29.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b8afa3740 1 -- 172.21.15.133:0/3433260566 shutdown_connections 2023-10-08T16:04:29.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b8afa3740 1 --2- 172.21.15.133:0/3433260566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x174e790 0x1966a10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b8afa3740 1 --2- 172.21.15.133:0/3433260566 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x1703710 0x1937820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b8afa3740 1 --2- 172.21.15.133:0/3433260566 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x1703ae0 0x1963ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b8afa3740 1 -- 172.21.15.133:0/3433260566 >> 172.21.15.133:0/3433260566 conn(0x1703eb0 msgr2=0x1966300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:29.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b8afa3740 1 -- 172.21.15.133:0/3433260566 shutdown_connections 2023-10-08T16:04:29.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b8afa3740 1 -- 172.21.15.133:0/3433260566 wait complete. 2023-10-08T16:04:29.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b8afa3740 1 -- start start 2023-10-08T16:04:29.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b8afa3740 1 Processor -- start 2023-10-08T16:04:29.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b8afa3740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1703710 0x193b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:29.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b8afa3740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x1703ae0 0x193b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:29.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b8afa3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x174e790 0x193bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:29.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b8afa3740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x1870d50 con 0x1703710 2023-10-08T16:04:29.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b8afa3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x1849970 con 0x174e790 2023-10-08T16:04:29.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b8afa3740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x1780650 con 0x1703ae0 2023-10-08T16:04:29.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b8afa3740 10 client.0 _ll_register_callbacks cb 0x18f46a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:04:29.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b8259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1703710 0x193b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:29.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b8259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1703710 0x193b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43316/0 (socket says 172.21.15.133:43316) 2023-10-08T16:04:29.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b8259c700 1 -- 172.21.15.133:0/3903808117 learned_addr learned my addr 172.21.15.133:0/3903808117 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:29.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b82d9d700 1 --2- 172.21.15.133:0/3903808117 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x174e790 0x193bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:29.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b81d9b700 1 --2- 172.21.15.133:0/3903808117 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x1703ae0 0x193b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:29.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b8259c700 1 -- 172.21.15.133:0/3903808117 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x1703ae0 msgr2=0x193b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:29.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b8259c700 1 --2- 172.21.15.133:0/3903808117 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x1703ae0 0x193b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b8259c700 1 -- 172.21.15.133:0/3903808117 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x174e790 msgr2=0x193bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:29.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b8259c700 1 --2- 172.21.15.133:0/3903808117 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x174e790 0x193bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b8259c700 1 -- 172.21.15.133:0/3903808117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7c00f040 con 0x1703710 2023-10-08T16:04:29.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.207+0000 7f6b81d9b700 1 --2- 172.21.15.133:0/3903808117 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x1703ae0 0x193b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:04:29.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b8259c700 1 --2- 172.21.15.133:0/3903808117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1703710 0x193b170 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6b840b6750 tx=0x7f6b6c022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5255b924aa868d1a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:29.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b60ff9700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-10-08T16:04:29.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b60ff9700 1 -- 172.21.15.133:0/3903808117 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c022070 con 0x1703710 2023-10-08T16:04:29.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b60ff9700 1 -- 172.21.15.133:0/3903808117 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6b6c01cac0 con 0x1703710 2023-10-08T16:04:29.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b8afa3740 1 -- 172.21.15.133:0/3903808117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1849cc0 con 0x1703710 2023-10-08T16:04:29.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b60ff9700 1 -- 172.21.15.133:0/3903808117 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b6c01ce90 con 0x1703710 2023-10-08T16:04:29.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b8afa3740 10 client.4650 fetch_fsmap learned FSMap version 6 2023-10-08T16:04:29.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b8afa3740 1 -- 172.21.15.133:0/3903808117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x1879370 con 0x1703710 2023-10-08T16:04:29.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b60ff9700 1 -- 172.21.15.133:0/3903808117 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1849cc0 con 0x1703710 2023-10-08T16:04:29.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b60ff9700 1 -- 172.21.15.133:0/3903808117 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 6) v1 ==== 2010+0+0 (secure 0 0 0) 0x7f6b6c035c80 con 0x1703710 2023-10-08T16:04:29.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b8afa3740 10 client.4650 fetch_fsmap finished waiting for FSMap version 6 2023-10-08T16:04:29.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b8afa3740 10 client.4650 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T16:04:29.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b8afa3740 20 client.4650 populate_metadata read hostname 'smithi133' 2023-10-08T16:04:29.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b8afa3740 1 --2- 172.21.15.133:0/3903808117 >> [v2:172.21.15.133:6834/443398897,v1:172.21.15.133:6835/443398897] conn(0x1978de0 0x197b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:29.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b8afa3740 4 client.4650 mds_command: new command op to 4284 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T16:04:29.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b8afa3740 1 -- 172.21.15.133:0/3903808117 --> [v2:172.21.15.133:6834/443398897,v1:172.21.15.133:6835/443398897] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x184d3e0 con 0x1978de0 2023-10-08T16:04:29.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b81d9b700 1 --2- 172.21.15.133:0/3903808117 >> [v2:172.21.15.133:6834/443398897,v1:172.21.15.133:6835/443398897] conn(0x1978de0 0x197b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:29.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b60ff9700 10 client.4650 ms_handle_connect on v2:172.21.15.133:6834/443398897 2023-10-08T16:04:29.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b81d9b700 1 --2- 172.21.15.133:0/3903808117 >> [v2:172.21.15.133:6834/443398897,v1:172.21.15.133:6835/443398897] conn(0x1978de0 0x197b1c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19477c4ce345b0d7 server_cookie=6019bd88f36f4dc6 in_seq=0 out_seq=0 2023-10-08T16:04:29.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b60ff9700 1 -- 172.21.15.133:0/3903808117 <== mds.0 v2:172.21.15.133:6834/443398897 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x184d3e0 con 0x1978de0 2023-10-08T16:04:29.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b60ff9700 10 client.4650 handle_command_reply: tid=0 2023-10-08T16:04:29.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b8afa3740 1 client.4650 shutdown 2023-10-08T16:04:29.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b8afa3740 1 -- 172.21.15.133:0/3903808117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1703710 msgr2=0x193b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:29.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b8afa3740 1 --2- 172.21.15.133:0/3903808117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1703710 0x193b170 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6b840b6750 tx=0x7f6b6c022000 comp rx=0 tx=0).stop 2023-10-08T16:04:29.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b8afa3740 1 -- 172.21.15.133:0/3903808117 shutdown_connections 2023-10-08T16:04:29.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b8afa3740 1 --2- 172.21.15.133:0/3903808117 >> [v2:172.21.15.133:6834/443398897,v1:172.21.15.133:6835/443398897] conn(0x1978de0 0x197b1c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b8afa3740 1 --2- 172.21.15.133:0/3903808117 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x174e790 0x193bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b8afa3740 1 --2- 172.21.15.133:0/3903808117 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x1703ae0 0x193b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b60ff9700 0 client.4650 ms_handle_reset on v2:172.21.15.133:6834/443398897 2023-10-08T16:04:29.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b8afa3740 1 --2- 172.21.15.133:0/3903808117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1703710 0x193b170 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b8afa3740 1 -- 172.21.15.133:0/3903808117 >> 172.21.15.133:0/3903808117 conn(0x1703eb0 msgr2=0x193d170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:29.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b8afa3740 1 -- 172.21.15.133:0/3903808117 shutdown_connections 2023-10-08T16:04:29.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.211+0000 7f6b8afa3740 1 -- 172.21.15.133:0/3903808117 wait complete. 2023-10-08T16:04:29.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.215+0000 7f6b8afa3740 20 client.4650 trim_cache size 0 max 16384 2023-10-08T16:04:29.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.231+0000 7f6b8afa3740 1 Processor -- start 2023-10-08T16:04:29.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.231+0000 7f6b8afa3740 1 -- start start 2023-10-08T16:04:29.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.231+0000 7f6b8afa3740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1703710 0x19c1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:29.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.231+0000 7f6b8afa3740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x1703ae0 0x19c2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:29.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.231+0000 7f6b8afa3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x174e790 0x19c29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:29.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.231+0000 7f6b8afa3740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x18a9d60 con 0x1703710 2023-10-08T16:04:29.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.231+0000 7f6b8afa3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x187f610 con 0x174e790 2023-10-08T16:04:29.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.231+0000 7f6b8afa3740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x18a8890 con 0x1703ae0 2023-10-08T16:04:29.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.231+0000 7f6b8259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1703710 0x19c1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:29.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.231+0000 7f6b8259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1703710 0x19c1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43330/0 (socket says 172.21.15.133:43330) 2023-10-08T16:04:29.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.231+0000 7f6b8259c700 1 -- 172.21.15.133:0/3649199934 learned_addr learned my addr 172.21.15.133:0/3649199934 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:29.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.231+0000 7f6b82d9d700 1 --2- 172.21.15.133:0/3649199934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x174e790 0x19c29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:29.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.231+0000 7f6b81d9b700 1 --2- 172.21.15.133:0/3649199934 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x1703ae0 0x19c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:29.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b8259c700 1 -- 172.21.15.133:0/3649199934 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x1703ae0 msgr2=0x19c2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:29.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b8259c700 1 --2- 172.21.15.133:0/3649199934 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x1703ae0 0x19c2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b8259c700 1 -- 172.21.15.133:0/3649199934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x174e790 msgr2=0x19c29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:29.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b8259c700 1 --2- 172.21.15.133:0/3649199934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x174e790 0x19c29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b8259c700 1 -- 172.21.15.133:0/3649199934 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x185fd80 con 0x1703710 2023-10-08T16:04:29.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b82d9d700 1 --2- 172.21.15.133:0/3649199934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x174e790 0x19c29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:04:29.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b8259c700 1 --2- 172.21.15.133:0/3649199934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1703710 0x19c1f20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c009f80 tx=0x7f6b6c02e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f191984c5508f58a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:29.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b63fff700 1 -- 172.21.15.133:0/3649199934 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c022040 con 0x1703710 2023-10-08T16:04:29.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b63fff700 1 -- 172.21.15.133:0/3649199934 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6c01ce90 con 0x1703710 2023-10-08T16:04:29.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b63fff700 1 -- 172.21.15.133:0/3649199934 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c02b700 con 0x1703710 2023-10-08T16:04:29.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b8afa3740 1 -- 172.21.15.133:0/3649199934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1703710 msgr2=0x19c1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:29.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b8afa3740 1 --2- 172.21.15.133:0/3649199934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1703710 0x19c1f20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c009f80 tx=0x7f6b6c02e040 comp rx=0 tx=0).stop 2023-10-08T16:04:29.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b8afa3740 1 -- 172.21.15.133:0/3649199934 shutdown_connections 2023-10-08T16:04:29.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b8afa3740 1 --2- 172.21.15.133:0/3649199934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x174e790 0x19c29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b8afa3740 1 --2- 172.21.15.133:0/3649199934 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x1703ae0 0x19c2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b8afa3740 1 --2- 172.21.15.133:0/3649199934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1703710 0x19c1f20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b8afa3740 1 -- 172.21.15.133:0/3649199934 >> 172.21.15.133:0/3649199934 conn(0x1703eb0 msgr2=0x1935f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:29.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b8afa3740 1 -- 172.21.15.133:0/3649199934 shutdown_connections 2023-10-08T16:04:29.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b8afa3740 1 -- 172.21.15.133:0/3649199934 wait complete. 2023-10-08T16:04:29.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b8afa3740 1 -- start start 2023-10-08T16:04:29.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b8afa3740 1 Processor -- start 2023-10-08T16:04:29.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b8afa3740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x1703710 0x1995560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:29.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b8afa3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x1703ae0 0x1995aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:29.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b8afa3740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x174e790 0x1995fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:29.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b8afa3740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x18ad590 con 0x174e790 2023-10-08T16:04:29.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b8afa3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x177c7c0 con 0x1703ae0 2023-10-08T16:04:29.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b8afa3740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x187ef40 con 0x1703710 2023-10-08T16:04:29.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b8afa3740 10 client.0 _ll_register_callbacks cb 0x1854920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:04:29.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b82d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x174e790 0x1995fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:29.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b82d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x174e790 0x1995fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43334/0 (socket says 172.21.15.133:43334) 2023-10-08T16:04:29.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b82d9d700 1 -- 172.21.15.133:0/3425079088 learned_addr learned my addr 172.21.15.133:0/3425079088 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:04:29.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b81d9b700 1 --2- 172.21.15.133:0/3425079088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x1703ae0 0x1995aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:29.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b8259c700 1 --2- 172.21.15.133:0/3425079088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x1703710 0x1995560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:29.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.235+0000 7f6b82d9d700 1 -- 172.21.15.133:0/3425079088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x1703710 msgr2=0x1995560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:29.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b82d9d700 1 --2- 172.21.15.133:0/3425079088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x1703710 0x1995560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b82d9d700 1 -- 172.21.15.133:0/3425079088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x1703ae0 msgr2=0x1995aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:04:29.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b82d9d700 1 --2- 172.21.15.133:0/3425079088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x1703ae0 0x1995aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b82d9d700 1 -- 172.21.15.133:0/3425079088 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x174f9e0 con 0x174e790 2023-10-08T16:04:29.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b82d9d700 1 --2- 172.21.15.133:0/3425079088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x174e790 0x1995fe0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c003000 tx=0x7f6b7c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a270861c0929cbe8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:04:29.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b60ff9700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-10-08T16:04:29.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b60ff9700 1 -- 172.21.15.133:0/3425079088 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c025070 con 0x174e790 2023-10-08T16:04:29.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b60ff9700 1 -- 172.21.15.133:0/3425079088 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6b7c006a30 con 0x174e790 2023-10-08T16:04:29.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b8afa3740 1 -- 172.21.15.133:0/3425079088 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6b7c00e810 con 0x174e790 2023-10-08T16:04:29.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b60ff9700 1 -- 172.21.15.133:0/3425079088 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b7c00ec20 con 0x174e790 2023-10-08T16:04:29.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b8afa3740 10 client.4656 fetch_fsmap learned FSMap version 6 2023-10-08T16:04:29.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b8afa3740 1 -- 172.21.15.133:0/3425079088 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x1879370 con 0x174e790 2023-10-08T16:04:29.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b60ff9700 1 -- 172.21.15.133:0/3425079088 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7c00e810 con 0x174e790 2023-10-08T16:04:29.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b60ff9700 1 -- 172.21.15.133:0/3425079088 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 6) v1 ==== 2010+0+0 (secure 0 0 0) 0x7f6b7c028030 con 0x174e790 2023-10-08T16:04:29.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b8afa3740 10 client.4656 fetch_fsmap finished waiting for FSMap version 6 2023-10-08T16:04:29.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b8afa3740 10 client.4656 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T16:04:29.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b8afa3740 20 client.4656 populate_metadata read hostname 'smithi133' 2023-10-08T16:04:29.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b8afa3740 1 --2- 172.21.15.133:0/3425079088 >> [v2:172.21.15.133:6834/443398897,v1:172.21.15.133:6835/443398897] conn(0x19cbf90 0x19ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:04:29.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b8afa3740 4 client.4656 mds_command: new command op to 4284 tid=0[{"prefix": "status"}] 2023-10-08T16:04:29.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b8afa3740 1 -- 172.21.15.133:0/3425079088 --> [v2:172.21.15.133:6834/443398897,v1:172.21.15.133:6835/443398897] -- command(tid 0: {"prefix": "status"}) v1 -- 0x187f410 con 0x19cbf90 2023-10-08T16:04:29.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b8259c700 1 --2- 172.21.15.133:0/3425079088 >> [v2:172.21.15.133:6834/443398897,v1:172.21.15.133:6835/443398897] conn(0x19cbf90 0x19ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:04:29.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b60ff9700 10 client.4656 ms_handle_connect on v2:172.21.15.133:6834/443398897 2023-10-08T16:04:29.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b8259c700 1 --2- 172.21.15.133:0/3425079088 >> [v2:172.21.15.133:6834/443398897,v1:172.21.15.133:6835/443398897] conn(0x19cbf90 0x19ce370 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e281708fb6106a8 server_cookie=da5e9de28a27fb74 in_seq=0 out_seq=0 2023-10-08T16:04:29.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b60ff9700 1 -- 172.21.15.133:0/3425079088 <== mds.0 v2:172.21.15.133:6834/443398897 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x187f410 con 0x19cbf90 2023-10-08T16:04:29.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b60ff9700 10 client.4656 handle_command_reply: tid=0 2023-10-08T16:04:29.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b8afa3740 1 client.4656 shutdown 2023-10-08T16:04:29.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b8afa3740 1 -- 172.21.15.133:0/3425079088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x174e790 msgr2=0x1995fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:29.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b8afa3740 1 --2- 172.21.15.133:0/3425079088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x174e790 0x1995fe0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c003000 tx=0x7f6b7c019000 comp rx=0 tx=0).stop 2023-10-08T16:04:29.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b8afa3740 1 -- 172.21.15.133:0/3425079088 shutdown_connections 2023-10-08T16:04:29.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b8afa3740 1 --2- 172.21.15.133:0/3425079088 >> [v2:172.21.15.133:6834/443398897,v1:172.21.15.133:6835/443398897] conn(0x19cbf90 0x19ce370 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b8afa3740 1 --2- 172.21.15.133:0/3425079088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x174e790 0x1995fe0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b8afa3740 1 --2- 172.21.15.133:0/3425079088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x1703ae0 0x1995aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b8afa3740 1 --2- 172.21.15.133:0/3425079088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x1703710 0x1995560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b60ff9700 0 client.4656 ms_handle_reset on v2:172.21.15.133:6834/443398897 2023-10-08T16:04:29.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b8afa3740 1 -- 172.21.15.133:0/3425079088 >> 172.21.15.133:0/3425079088 conn(0x1703eb0 msgr2=0x1935f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:29.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b8afa3740 1 -- 172.21.15.133:0/3425079088 shutdown_connections 2023-10-08T16:04:29.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b8afa3740 1 -- 172.21.15.133:0/3425079088 wait complete. 2023-10-08T16:04:29.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b8afa3740 20 client.4656 trim_cache size 0 max 16384 2023-10-08T16:04:29.248 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-10-08T16:04:29.249 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "f2546191-d59e-4805-8e1b-3d8d3d1dad86", 2023-10-08T16:04:29.249 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2023-10-08T16:04:29.249 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 4284, 2023-10-08T16:04:29.249 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-10-08T16:04:29.249 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-10-08T16:04:29.249 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-10-08T16:04:29.249 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 11.598729918, 2023-10-08T16:04:29.249 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 6, 2023-10-08T16:04:29.249 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 20, 2023-10-08T16:04:29.249 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 20, 2023-10-08T16:04:29.249 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 18.814881894999999 2023-10-08T16:04:29.250 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-10-08T16:04:29.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b8359e700 1 -- 172.21.15.133:0/1023719224 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6b64060550 msgr2=0x7f6b64062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:29.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.239+0000 7f6b8359e700 1 --2- 172.21.15.133:0/1023719224 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6b64060550 0x7f6b64062a00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0030c0 tx=0x7f6b6c016000 comp rx=0 tx=0).stop 2023-10-08T16:04:29.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.243+0000 7f6b8359e700 1 -- 172.21.15.133:0/1023719224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b840b5ef0 msgr2=0x7f6b840b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:04:29.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.243+0000 7f6b8359e700 1 --2- 172.21.15.133:0/1023719224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b840b5ef0 0x7f6b840b38b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6b740021e0 tx=0x7f6b74001d30 comp rx=0 tx=0).stop 2023-10-08T16:04:29.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.243+0000 7f6b8359e700 1 -- 172.21.15.133:0/1023719224 shutdown_connections 2023-10-08T16:04:29.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.243+0000 7f6b8359e700 1 --2- 172.21.15.133:0/1023719224 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6b64060550 0x7f6b64062a00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.243+0000 7f6b8359e700 1 --2- 172.21.15.133:0/1023719224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b840b62c0 0x7f6b840b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.243+0000 7f6b8359e700 1 --2- 172.21.15.133:0/1023719224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b840b5ef0 0x7f6b840b38b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.243+0000 7f6b8359e700 1 --2- 172.21.15.133:0/1023719224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b84063870 0x7f6b84155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:04:29.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.243+0000 7f6b8359e700 1 -- 172.21.15.133:0/1023719224 >> 172.21.15.133:0/1023719224 conn(0x7f6b84070bd0 msgr2=0x7f6b8406fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:04:29.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.243+0000 7f6b8359e700 1 -- 172.21.15.133:0/1023719224 shutdown_connections 2023-10-08T16:04:29.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:04:29.243+0000 7f6b8359e700 1 -- 172.21.15.133:0/1023719224 wait complete. 2023-10-08T16:04:29.258 INFO:teuthology.run_tasks:Running task check-counter... 2023-10-08T16:04:29.269 INFO:teuthology.run_tasks:Running task workunit... 2023-10-08T16:04:29.280 INFO:tasks.workunit:Pulling workunits from ref abf19fc7a04fe4fceab4e98d4013ae1da7c06006 2023-10-08T16:04:29.280 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-08T16:04:29.280 DEBUG:teuthology.orchestra.run.smithi133:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-08T16:04:29.287 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:04:29.288 INFO:teuthology.orchestra.run.smithi133.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-08T16:04:29.288 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-10-08T16:04:29.294 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-10-08T16:04:29.295 DEBUG:teuthology.orchestra.run.smithi133:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-10-08T16:04:29.301 INFO:tasks.workunit:timeout=3h 2023-10-08T16:04:29.301 INFO:tasks.workunit:cleanup=True 2023-10-08T16:04:29.302 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout abf19fc7a04fe4fceab4e98d4013ae1da7c06006 2023-10-08T16:04:29.310 INFO:tasks.workunit.client.0.smithi133.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-08T16:04:49.130 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:04:49.133 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:05:19.203 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:05:19.206 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:05:21.447 INFO:tasks.workunit.client.0.smithi133.stderr:Note: switching to 'abf19fc7a04fe4fceab4e98d4013ae1da7c06006'. 2023-10-08T16:05:21.447 INFO:tasks.workunit.client.0.smithi133.stderr: 2023-10-08T16:05:21.447 INFO:tasks.workunit.client.0.smithi133.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-08T16:05:21.447 INFO:tasks.workunit.client.0.smithi133.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-08T16:05:21.447 INFO:tasks.workunit.client.0.smithi133.stderr:state without impacting any branches by switching back to a branch. 2023-10-08T16:05:21.447 INFO:tasks.workunit.client.0.smithi133.stderr: 2023-10-08T16:05:21.447 INFO:tasks.workunit.client.0.smithi133.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-08T16:05:21.447 INFO:tasks.workunit.client.0.smithi133.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-08T16:05:21.447 INFO:tasks.workunit.client.0.smithi133.stderr: 2023-10-08T16:05:21.448 INFO:tasks.workunit.client.0.smithi133.stderr: git switch -c 2023-10-08T16:05:21.448 INFO:tasks.workunit.client.0.smithi133.stderr: 2023-10-08T16:05:21.448 INFO:tasks.workunit.client.0.smithi133.stderr:Or undo this operation with: 2023-10-08T16:05:21.448 INFO:tasks.workunit.client.0.smithi133.stderr: 2023-10-08T16:05:21.448 INFO:tasks.workunit.client.0.smithi133.stderr: git switch - 2023-10-08T16:05:21.448 INFO:tasks.workunit.client.0.smithi133.stderr: 2023-10-08T16:05:21.448 INFO:tasks.workunit.client.0.smithi133.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-08T16:05:21.448 INFO:tasks.workunit.client.0.smithi133.stderr: 2023-10-08T16:05:21.448 INFO:tasks.workunit.client.0.smithi133.stderr:HEAD is now at abf19fc7a04 Merge branch 'tr-62538' of https://github.com/vshankar/ceph into wip-yuri-testing-2023-10-07-1508-quincy 2023-10-08T16:05:21.452 DEBUG:teuthology.orchestra.run.smithi133:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-08T16:05:21.482 INFO:tasks.workunit.client.0.smithi133.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-08T16:05:21.485 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-08T16:05:21.486 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-08T16:05:22.274 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-08T16:05:22.380 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-08T16:05:22.439 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-08T16:05:22.442 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-08T16:05:22.442 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-08T16:05:22.501 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-08T16:05:22.506 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-10-08T16:05:22.506 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-08T16:05:22.513 INFO:tasks.workunit:Running workunits matching libcephfs/test.sh on client.0... 2023-10-08T16:05:22.515 INFO:tasks.workunit:Running workunit libcephfs/test.sh... 2023-10-08T16:05:22.515 DEBUG:teuthology.orchestra.run.smithi133:workunit test libcephfs/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=abf19fc7a04fe4fceab4e98d4013ae1da7c06006 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh 2023-10-08T16:05:22.573 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] Running 123 tests from 4 test suites. 2023-10-08T16:05:22.573 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment set-up. 2023-10-08T16:05:22.573 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 114 tests from LibCephFS 2023-10-08T16:05:22.573 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.OpenEmptyComponent 2023-10-08T16:05:22.714 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.OpenEmptyComponent (142 ms) 2023-10-08T16:05:22.715 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.OpenReadTruncate 2023-10-08T16:05:25.444 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.OpenReadTruncate (2730 ms) 2023-10-08T16:05:25.445 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.OpenReadWrite 2023-10-08T16:05:25.501 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.OpenReadWrite (56 ms) 2023-10-08T16:05:25.501 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.MountNonExist 2023-10-08T16:05:25.538 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.MountNonExist (37 ms) 2023-10-08T16:05:25.539 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.MountDouble 2023-10-08T16:05:26.570 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.MountDouble (1032 ms) 2023-10-08T16:05:26.571 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.MountRemount 2023-10-08T16:05:27.624 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.MountRemount (1054 ms) 2023-10-08T16:05:27.625 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.UnmountUnmounted 2023-10-08T16:05:27.636 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.UnmountUnmounted (12 ms) 2023-10-08T16:05:27.636 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.ReleaseUnmounted 2023-10-08T16:05:27.646 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.ReleaseUnmounted (9 ms) 2023-10-08T16:05:27.646 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.ReleaseMounted 2023-10-08T16:05:28.669 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.ReleaseMounted (1024 ms) 2023-10-08T16:05:28.669 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.UnmountRelease 2023-10-08T16:05:29.701 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.UnmountRelease (1031 ms) 2023-10-08T16:05:29.701 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Mount 2023-10-08T16:05:31.763 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Mount (2062 ms) 2023-10-08T16:05:31.764 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.OpenLayout 2023-10-08T16:05:31.860 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.OpenLayout (97 ms) 2023-10-08T16:05:31.861 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.DirLs 2023-10-08T16:05:41.381 INFO:tasks.workunit.client.0.smithi133.stdout:rand: 1523 2023-10-08T16:05:41.381 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.DirLs (9515 ms) 2023-10-08T16:05:41.381 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.ManyNestedDirs 2023-10-08T16:05:42.273 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.ManyNestedDirs (897 ms) 2023-10-08T16:05:42.273 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Xattrs 2023-10-08T16:05:42.351 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_a 2023-10-08T16:05:42.351 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_b 2023-10-08T16:05:42.352 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_c 2023-10-08T16:05:42.352 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_d 2023-10-08T16:05:42.352 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_e 2023-10-08T16:05:42.352 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_f 2023-10-08T16:05:42.352 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_g 2023-10-08T16:05:42.352 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_h 2023-10-08T16:05:42.352 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_i 2023-10-08T16:05:42.352 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_j 2023-10-08T16:05:42.352 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_k 2023-10-08T16:05:42.352 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_l 2023-10-08T16:05:42.352 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_m 2023-10-08T16:05:42.352 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_n 2023-10-08T16:05:42.353 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_o 2023-10-08T16:05:42.353 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_p 2023-10-08T16:05:42.353 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_q 2023-10-08T16:05:42.353 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_r 2023-10-08T16:05:42.353 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_s 2023-10-08T16:05:42.353 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_t 2023-10-08T16:05:42.353 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_u 2023-10-08T16:05:42.353 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_v 2023-10-08T16:05:42.353 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_w 2023-10-08T16:05:42.353 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_x 2023-10-08T16:05:42.353 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_y 2023-10-08T16:05:42.353 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_z 2023-10-08T16:05:42.398 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Xattrs (126 ms) 2023-10-08T16:05:42.398 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Xattrs_ll 2023-10-08T16:05:42.434 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Xattrs_ll (36 ms) 2023-10-08T16:05:42.435 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.LstatSlashdot 2023-10-08T16:05:42.468 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.LstatSlashdot (33 ms) 2023-10-08T16:05:42.468 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.StatDirNlink 2023-10-08T16:05:42.551 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.StatDirNlink (83 ms) 2023-10-08T16:05:42.551 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.DoubleChmod 2023-10-08T16:05:42.602 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.DoubleChmod (51 ms) 2023-10-08T16:05:42.602 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Fchmod 2023-10-08T16:05:42.649 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Fchmod (48 ms) 2023-10-08T16:05:42.649 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Lchmod 2023-10-08T16:05:42.707 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Lchmod (58 ms) 2023-10-08T16:05:42.707 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Fchown 2023-10-08T16:05:42.758 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Fchown (50 ms) 2023-10-08T16:05:42.758 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.FlagO_PATH 2023-10-08T16:05:42.796 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.FlagO_PATH (39 ms) 2023-10-08T16:05:42.796 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Symlinks 2023-10-08T16:05:42.895 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Symlinks (98 ms) 2023-10-08T16:05:42.895 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.DirSyms 2023-10-08T16:05:42.971 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.DirSyms (77 ms) 2023-10-08T16:05:42.972 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.LoopSyms 2023-10-08T16:05:43.014 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.LoopSyms (42 ms) 2023-10-08T16:05:43.014 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.HardlinkNoOriginal 2023-10-08T16:05:43.153 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.HardlinkNoOriginal (140 ms) 2023-10-08T16:05:43.154 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.BadArgument 2023-10-08T16:05:43.206 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.BadArgument (52 ms) 2023-10-08T16:05:43.206 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.BadFileDesc 2023-10-08T16:05:43.243 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.BadFileDesc (37 ms) 2023-10-08T16:05:43.243 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.ReadEmptyFile 2023-10-08T16:05:43.290 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.ReadEmptyFile (48 ms) 2023-10-08T16:05:43.291 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.PreadvPwritev 2023-10-08T16:05:43.341 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.PreadvPwritev (50 ms) 2023-10-08T16:05:43.341 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.LlreadvLlwritev 2023-10-08T16:05:43.391 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.LlreadvLlwritev (50 ms) 2023-10-08T16:05:43.391 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.StripeUnitGran 2023-10-08T16:05:43.423 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.StripeUnitGran (32 ms) 2023-10-08T16:05:43.423 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Rename 2023-10-08T16:05:43.482 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Rename (60 ms) 2023-10-08T16:05:43.483 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.UseUnmounted 2023-10-08T16:05:43.495 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.UseUnmounted (12 ms) 2023-10-08T16:05:43.495 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.GetPoolId 2023-10-08T16:05:43.523 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.GetPoolId (28 ms) 2023-10-08T16:05:43.523 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.GetPoolReplication 2023-10-08T16:05:43.557 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.GetPoolReplication (34 ms) 2023-10-08T16:05:43.557 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.GetExtentOsds 2023-10-08T16:05:43.599 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.GetExtentOsds (42 ms) 2023-10-08T16:05:43.599 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.GetOsdCrushLocation 2023-10-08T16:05:43.642 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.GetOsdCrushLocation (44 ms) 2023-10-08T16:05:43.642 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.GetOsdAddr 2023-10-08T16:05:43.677 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.GetOsdAddr (34 ms) 2023-10-08T16:05:43.677 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.OpenNoClose 2023-10-08T16:05:43.764 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.OpenNoClose (87 ms) 2023-10-08T16:05:43.764 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Nlink 2023-10-08T16:05:43.835 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Nlink (71 ms) 2023-10-08T16:05:43.835 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.SlashDotDot 2023-10-08T16:05:45.890 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.SlashDotDot (2056 ms) 2023-10-08T16:05:45.890 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Btime 2023-10-08T16:05:46.942 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Btime (1051 ms) 2023-10-08T16:05:46.942 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.SetBtime 2023-10-08T16:05:46.989 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.SetBtime (47 ms) 2023-10-08T16:05:46.989 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.LazyStatx 2023-10-08T16:05:48.074 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.LazyStatx (1084 ms) 2023-10-08T16:05:48.074 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.ChangeAttr 2023-10-08T16:05:48.133 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.ChangeAttr (60 ms) 2023-10-08T16:05:48.134 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.DirChangeAttrCreateFile 2023-10-08T16:05:48.252 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.DirChangeAttrCreateFile (118 ms) 2023-10-08T16:05:48.253 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.DirChangeAttrRenameFile 2023-10-08T16:05:48.357 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.DirChangeAttrRenameFile (105 ms) 2023-10-08T16:05:48.357 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.DirChangeAttrRemoveFile 2023-10-08T16:05:48.433 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.DirChangeAttrRemoveFile (77 ms) 2023-10-08T16:05:48.434 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.SetSize 2023-10-08T16:05:49.251 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:05:49.254 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:05:50.451 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.SetSize (2017 ms) 2023-10-08T16:05:50.451 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.OperationsOnRoot 2023-10-08T16:05:50.488 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.OperationsOnRoot (37 ms) 2023-10-08T16:05:50.488 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.ShutdownRace 2023-10-08T16:05:50.488 INFO:tasks.workunit.client.0.smithi133.stdout:Setting RLIMIT_NOFILE from 1024 to 16384 2023-10-08T16:06:19.305 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:06:19.308 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:06:20.223 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.ShutdownRace (29736 ms) 2023-10-08T16:06:20.224 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.TestUtime 2023-10-08T16:06:20.283 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.TestUtime (60 ms) 2023-10-08T16:06:20.283 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.TestUtimes 2023-10-08T16:06:20.348 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.TestUtimes (64 ms) 2023-10-08T16:06:20.348 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.TestFutimens 2023-10-08T16:06:20.402 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.TestFutimens (54 ms) 2023-10-08T16:06:20.402 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.OperationsOnDotDot 2023-10-08T16:06:20.469 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.OperationsOnDotDot (66 ms) 2023-10-08T16:06:20.469 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Caps_vxattr 2023-10-08T16:06:20.514 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Caps_vxattr (45 ms) 2023-10-08T16:06:20.514 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.SnapXattrs 2023-10-08T16:06:21.545 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.SnapXattrs (1031 ms) 2023-10-08T16:06:21.545 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.SnapQuota 2023-10-08T16:06:22.580 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.SnapQuota (1036 ms) 2023-10-08T16:06:22.581 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Lseek 2023-10-08T16:06:22.641 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Lseek (60 ms) 2023-10-08T16:06:22.641 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.SnapInfoOnNonSnapshot 2023-10-08T16:06:23.672 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.SnapInfoOnNonSnapshot (1032 ms) 2023-10-08T16:06:23.673 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.EmptySnapInfo 2023-10-08T16:06:24.705 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.EmptySnapInfo (1032 ms) 2023-10-08T16:06:24.705 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.SnapInfo 2023-10-08T16:06:25.746 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.SnapInfo (1041 ms) 2023-10-08T16:06:25.746 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.LookupInoMDSDir 2023-10-08T16:06:25.776 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.LookupInoMDSDir (30 ms) 2023-10-08T16:06:25.776 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.LookupVino 2023-10-08T16:06:27.876 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.LookupVino (2100 ms) 2023-10-08T16:06:27.877 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Openat 2023-10-08T16:06:27.989 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Openat (114 ms) 2023-10-08T16:06:27.990 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Statxat 2023-10-08T16:06:28.103 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Statxat (113 ms) 2023-10-08T16:06:28.103 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.StatxatATFDCWD 2023-10-08T16:06:28.184 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.StatxatATFDCWD (82 ms) 2023-10-08T16:06:28.185 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Fdopendir 2023-10-08T16:06:28.288 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Fdopendir (104 ms) 2023-10-08T16:06:28.289 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.FdopendirATFDCWD 2023-10-08T16:06:28.398 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.FdopendirATFDCWD (110 ms) 2023-10-08T16:06:28.399 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.FdopendirReaddirTestWithDelete 2023-10-08T16:06:28.494 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.FdopendirReaddirTestWithDelete (96 ms) 2023-10-08T16:06:28.495 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.FdopendirOnNonDir 2023-10-08T16:06:28.592 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.FdopendirOnNonDir (97 ms) 2023-10-08T16:06:28.592 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Mkdirat 2023-10-08T16:06:28.639 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Mkdirat (48 ms) 2023-10-08T16:06:28.639 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.MkdiratATFDCWD 2023-10-08T16:06:28.703 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.MkdiratATFDCWD (64 ms) 2023-10-08T16:06:28.703 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Readlinkat 2023-10-08T16:06:28.830 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Readlinkat (126 ms) 2023-10-08T16:06:28.830 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.ReadlinkatATFDCWD 2023-10-08T16:06:28.938 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.ReadlinkatATFDCWD (108 ms) 2023-10-08T16:06:28.938 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Symlinkat 2023-10-08T16:06:29.045 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Symlinkat (107 ms) 2023-10-08T16:06:29.045 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.SymlinkatATFDCWD 2023-10-08T16:06:29.153 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.SymlinkatATFDCWD (108 ms) 2023-10-08T16:06:29.153 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Unlinkat 2023-10-08T16:06:29.253 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Unlinkat (99 ms) 2023-10-08T16:06:29.253 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.UnlinkatATFDCWD 2023-10-08T16:06:29.362 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.UnlinkatATFDCWD (110 ms) 2023-10-08T16:06:29.362 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Chownat 2023-10-08T16:06:29.463 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Chownat (101 ms) 2023-10-08T16:06:29.463 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.ChownatATFDCWD 2023-10-08T16:06:29.557 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.ChownatATFDCWD (95 ms) 2023-10-08T16:06:29.558 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Chmodat 2023-10-08T16:06:29.655 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Chmodat (97 ms) 2023-10-08T16:06:29.655 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.ChmodatATFDCWD 2023-10-08T16:06:29.743 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.ChmodatATFDCWD (88 ms) 2023-10-08T16:06:29.743 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Utimensat 2023-10-08T16:06:30.502 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Utimensat (759 ms) 2023-10-08T16:06:30.502 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.UtimensatATFDCWD 2023-10-08T16:06:35.485 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.UtimensatATFDCWD (4979 ms) 2023-10-08T16:06:35.485 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.LookupMdsPrivateInos 2023-10-08T16:06:36.034 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.LookupMdsPrivateInos (553 ms) 2023-10-08T16:06:36.052 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.SetMountTimeoutPostMount 2023-10-08T16:06:36.064 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.SetMountTimeoutPostMount (30 ms) 2023-10-08T16:06:36.064 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.SetMountTimeout 2023-10-08T16:06:37.096 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.SetMountTimeout (1032 ms) 2023-10-08T16:06:37.097 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.SnapdirAttrs 2023-10-08T16:06:38.131 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.SnapdirAttrs (1035 ms) 2023-10-08T16:06:38.131 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.ReaddirRCB 2023-10-08T16:06:38.234 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.ReaddirRCB (103 ms) 2023-10-08T16:06:38.234 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.MulticlientSimple 2023-10-08T16:06:38.415 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.MulticlientSimple (181 ms) 2023-10-08T16:06:38.416 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.MulticlientHoleEOF 2023-10-08T16:06:38.532 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.MulticlientHoleEOF (117 ms) 2023-10-08T16:06:38.532 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.MulticlientRevokeCaps 2023-10-08T16:06:49.362 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:06:49.366 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:07:19.411 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:07:19.414 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:07:38.600 INFO:tasks.workunit.client.0.smithi133.stdout: Will run test for 60 seconds! 2023-10-08T16:07:38.600 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.MulticlientRevokeCaps (60067 ms) 2023-10-08T16:07:38.600 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.BasicLocking 2023-10-08T16:07:38.669 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.BasicLocking (70 ms) 2023-10-08T16:07:38.669 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.ConcurrentLocking 2023-10-08T16:07:38.759 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.ConcurrentLocking (89 ms) 2023-10-08T16:07:38.759 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.ThreesomeLocking 2023-10-08T16:07:38.865 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.ThreesomeLocking (107 ms) 2023-10-08T16:07:38.865 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.BasicRecordLocking 2023-10-08T16:07:38.922 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.BasicRecordLocking (57 ms) 2023-10-08T16:07:38.922 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.ConcurrentRecordLocking 2023-10-08T16:07:39.012 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.ConcurrentRecordLocking (90 ms) 2023-10-08T16:07:39.012 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.ThreesomeRecordLocking 2023-10-08T16:07:39.111 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.ThreesomeRecordLocking (99 ms) 2023-10-08T16:07:39.111 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.DelegMultiClient 2023-10-08T16:07:39.654 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.DelegMultiClient (543 ms) 2023-10-08T16:07:39.654 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.DelegSingleClient 2023-10-08T16:07:40.517 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.DelegSingleClient (863 ms) 2023-10-08T16:07:40.517 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.DelegTimeout 2023-10-08T16:07:42.615 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.DelegTimeout (2098 ms) 2023-10-08T16:07:42.615 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.RecalledGetattr 2023-10-08T16:07:42.741 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.RecalledGetattr (126 ms) 2023-10-08T16:07:42.741 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.LayoutVerifyDefaultLayout 2023-10-08T16:07:42.775 INFO:tasks.workunit.client.0.smithi133.stderr:layout:{"stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_name": "cephfs_data", "pool_id": 3, "pool_namespace": "", "inheritance": "@default"} 2023-10-08T16:07:42.813 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.LayoutVerifyDefaultLayout (72 ms) 2023-10-08T16:07:42.813 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.LayoutSetAndVerifyNewAndInheritedLayout 2023-10-08T16:07:42.862 INFO:tasks.workunit.client.0.smithi133.stderr:layout:{"stripe_unit": 65536, "stripe_count": 1, "object_size": 65536, "pool_name": "cephfs_data", "pool_id": 3, "pool_namespace": "", "inheritance": "@set"} 2023-10-08T16:07:42.863 INFO:tasks.workunit.client.0.smithi133.stderr:layout:{"stripe_unit": 65536, "stripe_count": 1, "object_size": 65536, "pool_name": "cephfs_data", "pool_id": 3, "pool_namespace": "", "inheritance": "@inherited"} 2023-10-08T16:07:42.902 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.LayoutSetAndVerifyNewAndInheritedLayout (89 ms) 2023-10-08T16:07:42.902 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.LayoutSetBadJSON 2023-10-08T16:07:42.979 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.LayoutSetBadJSON (77 ms) 2023-10-08T16:07:42.979 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.LayoutSetBadPoolName 2023-10-08T16:07:43.064 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.LayoutSetBadPoolName (84 ms) 2023-10-08T16:07:43.064 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.LayoutSetBadPoolId 2023-10-08T16:07:43.144 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.LayoutSetBadPoolId (81 ms) 2023-10-08T16:07:43.144 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.LayoutSetInvalidFieldName 2023-10-08T16:07:43.224 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.LayoutSetInvalidFieldName (80 ms) 2023-10-08T16:07:43.224 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.GetAndSetDirPin 2023-10-08T16:07:43.295 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.GetAndSetDirPin (71 ms) 2023-10-08T16:07:43.295 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.GetAndSetDirDistribution 2023-10-08T16:07:43.366 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.GetAndSetDirDistribution (71 ms) 2023-10-08T16:07:43.367 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.GetAndSetDirRandom 2023-10-08T16:07:43.443 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.GetAndSetDirRandom (77 ms) 2023-10-08T16:07:43.444 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 114 tests from LibCephFS (140870 ms total) 2023-10-08T16:07:43.444 INFO:tasks.workunit.client.0.smithi133.stdout: 2023-10-08T16:07:43.444 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 1 test from Caps 2023-10-08T16:07:43.444 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] Caps.ReadZero 2023-10-08T16:07:43.726 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] Caps.ReadZero (283 ms) 2023-10-08T16:07:43.727 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 1 test from Caps (283 ms total) 2023-10-08T16:07:43.727 INFO:tasks.workunit.client.0.smithi133.stdout: 2023-10-08T16:07:43.727 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 5 tests from ACL 2023-10-08T16:07:43.727 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] ACL.SetACL 2023-10-08T16:07:43.762 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] ACL.SetACL (36 ms) 2023-10-08T16:07:43.763 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] ACL.Chmod 2023-10-08T16:07:43.809 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] ACL.Chmod (46 ms) 2023-10-08T16:07:43.809 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] ACL.DefaultACL 2023-10-08T16:07:43.940 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] ACL.DefaultACL (131 ms) 2023-10-08T16:07:43.940 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] ACL.Disabled 2023-10-08T16:07:43.969 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] ACL.Disabled (29 ms) 2023-10-08T16:07:43.969 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] ACL.SnapdirACL 2023-10-08T16:07:44.992 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] ACL.SnapdirACL (1022 ms) 2023-10-08T16:07:44.992 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 5 tests from ACL (1264 ms total) 2023-10-08T16:07:44.992 INFO:tasks.workunit.client.0.smithi133.stdout: 2023-10-08T16:07:44.992 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 3 tests from MonConfig 2023-10-08T16:07:44.992 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] MonConfig.MonAddrsMissing 2023-10-08T16:07:45.007 INFO:tasks.workunit.client.0.smithi133.stderr:failed to get an address for mon.a: error -2 2023-10-08T16:07:45.007 INFO:tasks.workunit.client.0.smithi133.stderr:failed to get an address for mon.b: error -2 2023-10-08T16:07:45.007 INFO:tasks.workunit.client.0.smithi133.stderr:failed to get an address for mon.c: error -2 2023-10-08T16:07:45.042 INFO:tasks.workunit.client.0.smithi133.stderr:unable to get monitor info from DNS SRV with service name: ceph-mon 2023-10-08T16:07:45.043 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] MonConfig.MonAddrsMissing (52 ms) 2023-10-08T16:07:45.043 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] MonConfig.MonAddrsInConfigProxy 2023-10-08T16:07:45.083 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] MonConfig.MonAddrsInConfigProxy (40 ms) 2023-10-08T16:07:45.083 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] MonConfig.MonAddrsInCct 2023-10-08T16:07:46.140 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] MonConfig.MonAddrsInCct (1057 ms) 2023-10-08T16:07:46.141 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 3 tests from MonConfig (1149 ms total) 2023-10-08T16:07:46.141 INFO:tasks.workunit.client.0.smithi133.stdout: 2023-10-08T16:07:46.141 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment tear-down 2023-10-08T16:07:46.141 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] 123 tests from 4 test suites ran. (143567 ms total) 2023-10-08T16:07:46.141 INFO:tasks.workunit.client.0.smithi133.stdout:[ PASSED ] 123 tests. 2023-10-08T16:07:46.141 INFO:tasks.workunit.client.0.smithi133.stdout: 2023-10-08T16:07:46.141 INFO:tasks.workunit.client.0.smithi133.stdout: YOU HAVE 4 DISABLED TESTS 2023-10-08T16:07:46.141 INFO:tasks.workunit.client.0.smithi133.stdout: 2023-10-08T16:07:46.236 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] Running 95 tests from 2 test suites. 2023-10-08T16:07:46.236 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment set-up. 2023-10-08T16:07:46.236 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 91 tests from LibCephFS 2023-10-08T16:07:46.237 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.OpenEmptyComponent 2023-10-08T16:07:46.381 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.OpenEmptyComponent (145 ms) 2023-10-08T16:07:46.381 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.OpenReadTruncate 2023-10-08T16:07:49.456 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:07:49.459 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:07:50.453 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.OpenReadTruncate (4071 ms) 2023-10-08T16:07:50.453 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.OpenReadWrite 2023-10-08T16:07:50.511 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.OpenReadWrite (59 ms) 2023-10-08T16:07:50.511 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.MountNonExist 2023-10-08T16:07:50.549 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.MountNonExist (37 ms) 2023-10-08T16:07:50.549 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.MountDouble 2023-10-08T16:07:50.585 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.MountDouble (36 ms) 2023-10-08T16:07:50.585 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.MountRemount 2023-10-08T16:07:50.640 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.MountRemount (55 ms) 2023-10-08T16:07:50.640 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.UnmountUnmounted 2023-10-08T16:07:50.655 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.UnmountUnmounted (15 ms) 2023-10-08T16:07:50.655 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.ReleaseUnmounted 2023-10-08T16:07:50.663 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.ReleaseUnmounted (8 ms) 2023-10-08T16:07:50.664 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.ReleaseMounted 2023-10-08T16:07:50.700 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.ReleaseMounted (36 ms) 2023-10-08T16:07:50.700 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.UnmountRelease 2023-10-08T16:07:51.730 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.UnmountRelease (1030 ms) 2023-10-08T16:07:51.731 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Mount 2023-10-08T16:07:53.796 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Mount (2066 ms) 2023-10-08T16:07:53.796 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.OpenLayout 2023-10-08T16:07:53.916 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.OpenLayout (120 ms) 2023-10-08T16:07:53.916 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.DirLs 2023-10-08T16:08:00.074 INFO:tasks.workunit.client.0.smithi133.stdout:rand: 968 2023-10-08T16:08:00.074 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.DirLs (6158 ms) 2023-10-08T16:08:00.075 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.ManyNestedDirs 2023-10-08T16:08:00.712 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.ManyNestedDirs (638 ms) 2023-10-08T16:08:00.713 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Xattrs 2023-10-08T16:08:00.803 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_a 2023-10-08T16:08:00.803 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_b 2023-10-08T16:08:00.803 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_c 2023-10-08T16:08:00.805 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_d 2023-10-08T16:08:00.805 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_e 2023-10-08T16:08:00.805 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_f 2023-10-08T16:08:00.806 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_g 2023-10-08T16:08:00.806 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_h 2023-10-08T16:08:00.806 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_i 2023-10-08T16:08:00.806 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_j 2023-10-08T16:08:00.806 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_k 2023-10-08T16:08:00.806 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_l 2023-10-08T16:08:00.806 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_m 2023-10-08T16:08:00.806 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_n 2023-10-08T16:08:00.806 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_o 2023-10-08T16:08:00.806 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_p 2023-10-08T16:08:00.806 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_q 2023-10-08T16:08:00.806 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_r 2023-10-08T16:08:00.807 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_s 2023-10-08T16:08:00.807 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_t 2023-10-08T16:08:00.807 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_u 2023-10-08T16:08:00.807 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_v 2023-10-08T16:08:00.807 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_w 2023-10-08T16:08:00.807 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_x 2023-10-08T16:08:00.807 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_y 2023-10-08T16:08:00.807 INFO:tasks.workunit.client.0.smithi133.stdout:getting attr user.test_xattr_z 2023-10-08T16:08:00.848 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Xattrs (136 ms) 2023-10-08T16:08:00.848 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Xattrs_ll 2023-10-08T16:08:00.889 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Xattrs_ll (40 ms) 2023-10-08T16:08:00.889 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.LstatSlashdot 2023-10-08T16:08:00.928 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.LstatSlashdot (39 ms) 2023-10-08T16:08:00.928 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.StatDirNlink 2023-10-08T16:08:01.242 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.StatDirNlink (314 ms) 2023-10-08T16:08:01.242 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.DoubleChmod 2023-10-08T16:08:01.322 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.DoubleChmod (80 ms) 2023-10-08T16:08:01.322 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Fchmod 2023-10-08T16:08:01.365 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Fchmod (43 ms) 2023-10-08T16:08:01.365 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Lchmod 2023-10-08T16:08:01.427 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Lchmod (62 ms) 2023-10-08T16:08:01.427 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Fchown 2023-10-08T16:08:01.478 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Fchown (51 ms) 2023-10-08T16:08:01.478 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.FlagO_PATH 2023-10-08T16:08:01.523 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.FlagO_PATH (45 ms) 2023-10-08T16:08:01.523 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Symlinks 2023-10-08T16:08:01.624 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Symlinks (101 ms) 2023-10-08T16:08:01.624 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.DirSyms 2023-10-08T16:08:01.701 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.DirSyms (77 ms) 2023-10-08T16:08:01.701 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.LoopSyms 2023-10-08T16:08:01.753 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.LoopSyms (52 ms) 2023-10-08T16:08:01.753 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.HardlinkNoOriginal 2023-10-08T16:08:01.897 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.HardlinkNoOriginal (143 ms) 2023-10-08T16:08:01.897 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.BadArgument 2023-10-08T16:08:01.951 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.BadArgument (55 ms) 2023-10-08T16:08:01.951 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.BadFileDesc 2023-10-08T16:08:01.985 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.BadFileDesc (34 ms) 2023-10-08T16:08:01.985 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.ReadEmptyFile 2023-10-08T16:08:02.031 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.ReadEmptyFile (46 ms) 2023-10-08T16:08:02.032 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.PreadvPwritev 2023-10-08T16:08:02.083 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.PreadvPwritev (52 ms) 2023-10-08T16:08:02.083 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.LlreadvLlwritev 2023-10-08T16:08:02.135 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.LlreadvLlwritev (52 ms) 2023-10-08T16:08:02.135 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.StripeUnitGran 2023-10-08T16:08:03.165 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.StripeUnitGran (1030 ms) 2023-10-08T16:08:03.165 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Rename 2023-10-08T16:08:03.235 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Rename (70 ms) 2023-10-08T16:08:03.235 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.UseUnmounted 2023-10-08T16:08:03.250 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.UseUnmounted (15 ms) 2023-10-08T16:08:03.250 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.GetPoolId 2023-10-08T16:08:03.279 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.GetPoolId (29 ms) 2023-10-08T16:08:03.279 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.GetPoolReplication 2023-10-08T16:08:03.317 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.GetPoolReplication (38 ms) 2023-10-08T16:08:03.317 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.GetExtentOsds 2023-10-08T16:08:03.362 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.GetExtentOsds (45 ms) 2023-10-08T16:08:03.362 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.GetOsdCrushLocation 2023-10-08T16:08:03.409 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.GetOsdCrushLocation (47 ms) 2023-10-08T16:08:03.409 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.GetOsdAddr 2023-10-08T16:08:04.437 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.GetOsdAddr (1027 ms) 2023-10-08T16:08:04.437 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.OpenNoClose 2023-10-08T16:08:04.529 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.OpenNoClose (93 ms) 2023-10-08T16:08:04.529 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Nlink 2023-10-08T16:08:04.613 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Nlink (83 ms) 2023-10-08T16:08:04.613 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.SlashDotDot 2023-10-08T16:08:06.666 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.SlashDotDot (2054 ms) 2023-10-08T16:08:06.666 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Btime 2023-10-08T16:08:07.717 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Btime (1051 ms) 2023-10-08T16:08:07.717 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.SetBtime 2023-10-08T16:08:07.769 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.SetBtime (52 ms) 2023-10-08T16:08:07.769 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.LazyStatx 2023-10-08T16:08:08.861 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.LazyStatx (1092 ms) 2023-10-08T16:08:08.861 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.ChangeAttr 2023-10-08T16:08:08.926 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.ChangeAttr (65 ms) 2023-10-08T16:08:08.927 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.DirChangeAttrCreateFile 2023-10-08T16:08:09.066 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.DirChangeAttrCreateFile (140 ms) 2023-10-08T16:08:09.067 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.DirChangeAttrRenameFile 2023-10-08T16:08:09.185 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.DirChangeAttrRenameFile (118 ms) 2023-10-08T16:08:09.185 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.DirChangeAttrRemoveFile 2023-10-08T16:08:09.296 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.DirChangeAttrRemoveFile (111 ms) 2023-10-08T16:08:09.296 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.SetSize 2023-10-08T16:08:09.326 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.SetSize (30 ms) 2023-10-08T16:08:09.326 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.OperationsOnRoot 2023-10-08T16:08:09.368 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.OperationsOnRoot (41 ms) 2023-10-08T16:08:09.368 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.ShutdownRace 2023-10-08T16:08:09.368 INFO:tasks.workunit.client.0.smithi133.stdout:Setting RLIMIT_NOFILE from 1024 to 16384 2023-10-08T16:08:19.729 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:08:19.732 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:08:42.851 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.ShutdownRace (33484 ms) 2023-10-08T16:08:42.852 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.TestUtime 2023-10-08T16:08:42.906 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.TestUtime (55 ms) 2023-10-08T16:08:42.906 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.TestUtimes 2023-10-08T16:08:42.977 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.TestUtimes (71 ms) 2023-10-08T16:08:42.978 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.TestFutimens 2023-10-08T16:08:43.031 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.TestFutimens (54 ms) 2023-10-08T16:08:43.032 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.OperationsOnDotDot 2023-10-08T16:08:43.102 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.OperationsOnDotDot (71 ms) 2023-10-08T16:08:43.102 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Caps_vxattr 2023-10-08T16:08:43.152 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Caps_vxattr (50 ms) 2023-10-08T16:08:43.152 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.SnapXattrs 2023-10-08T16:08:44.182 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.SnapXattrs (1030 ms) 2023-10-08T16:08:44.182 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.SnapQuota 2023-10-08T16:08:45.216 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.SnapQuota (1034 ms) 2023-10-08T16:08:45.216 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Lseek 2023-10-08T16:08:45.276 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Lseek (59 ms) 2023-10-08T16:08:45.276 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.SnapInfoOnNonSnapshot 2023-10-08T16:08:46.309 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.SnapInfoOnNonSnapshot (1034 ms) 2023-10-08T16:08:46.310 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.EmptySnapInfo 2023-10-08T16:08:47.344 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.EmptySnapInfo (1034 ms) 2023-10-08T16:08:47.344 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.SnapInfo 2023-10-08T16:08:48.379 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.SnapInfo (1035 ms) 2023-10-08T16:08:48.379 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.LookupInoMDSDir 2023-10-08T16:08:48.420 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.LookupInoMDSDir (40 ms) 2023-10-08T16:08:48.420 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.LookupVino 2023-10-08T16:08:49.776 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:08:49.779 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:08:50.524 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.LookupVino (2105 ms) 2023-10-08T16:08:50.524 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Openat 2023-10-08T16:08:50.635 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Openat (111 ms) 2023-10-08T16:08:50.636 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Statxat 2023-10-08T16:08:50.811 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Statxat (176 ms) 2023-10-08T16:08:50.811 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.StatxatATFDCWD 2023-10-08T16:08:50.894 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.StatxatATFDCWD (83 ms) 2023-10-08T16:08:50.894 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Fdopendir 2023-10-08T16:08:51.016 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Fdopendir (122 ms) 2023-10-08T16:08:51.017 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.FdopendirATFDCWD 2023-10-08T16:08:51.131 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.FdopendirATFDCWD (115 ms) 2023-10-08T16:08:51.131 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.FdopendirReaddirTestWithDelete 2023-10-08T16:08:51.229 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.FdopendirReaddirTestWithDelete (97 ms) 2023-10-08T16:08:51.229 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.FdopendirOnNonDir 2023-10-08T16:08:51.330 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.FdopendirOnNonDir (101 ms) 2023-10-08T16:08:51.330 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Mkdirat 2023-10-08T16:08:51.377 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Mkdirat (48 ms) 2023-10-08T16:08:51.377 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.MkdiratATFDCWD 2023-10-08T16:08:51.449 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.MkdiratATFDCWD (72 ms) 2023-10-08T16:08:51.449 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Readlinkat 2023-10-08T16:08:51.565 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Readlinkat (116 ms) 2023-10-08T16:08:51.565 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.ReadlinkatATFDCWD 2023-10-08T16:08:51.688 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.ReadlinkatATFDCWD (122 ms) 2023-10-08T16:08:51.688 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Symlinkat 2023-10-08T16:08:51.791 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Symlinkat (104 ms) 2023-10-08T16:08:51.791 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.SymlinkatATFDCWD 2023-10-08T16:08:51.901 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.SymlinkatATFDCWD (107 ms) 2023-10-08T16:08:51.901 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Unlinkat 2023-10-08T16:08:51.995 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Unlinkat (96 ms) 2023-10-08T16:08:51.995 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.UnlinkatATFDCWD 2023-10-08T16:08:52.114 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.UnlinkatATFDCWD (119 ms) 2023-10-08T16:08:52.114 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Chownat 2023-10-08T16:08:52.236 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Chownat (123 ms) 2023-10-08T16:08:52.236 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.ChownatATFDCWD 2023-10-08T16:08:52.343 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.ChownatATFDCWD (107 ms) 2023-10-08T16:08:52.343 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Chmodat 2023-10-08T16:08:52.463 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Chmodat (120 ms) 2023-10-08T16:08:52.463 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.ChmodatATFDCWD 2023-10-08T16:08:52.573 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.ChmodatATFDCWD (109 ms) 2023-10-08T16:08:52.573 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.Utimensat 2023-10-08T16:08:55.507 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.Utimensat (2934 ms) 2023-10-08T16:08:55.507 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.UtimensatATFDCWD 2023-10-08T16:09:00.480 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.UtimensatATFDCWD (4969 ms) 2023-10-08T16:09:00.481 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.LookupMdsPrivateInos 2023-10-08T16:09:01.019 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.LookupMdsPrivateInos (543 ms) 2023-10-08T16:09:01.019 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.SetMountTimeoutPostMount 2023-10-08T16:09:01.057 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.SetMountTimeoutPostMount (39 ms) 2023-10-08T16:09:01.057 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.SetMountTimeout 2023-10-08T16:09:01.092 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.SetMountTimeout (35 ms) 2023-10-08T16:09:01.093 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibCephFS.SnapdirAttrs 2023-10-08T16:09:02.124 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibCephFS.SnapdirAttrs (1032 ms) 2023-10-08T16:09:02.124 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 91 tests from LibCephFS (75888 ms total) 2023-10-08T16:09:02.124 INFO:tasks.workunit.client.0.smithi133.stdout: 2023-10-08T16:09:02.124 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 4 tests from AccessTest 2023-10-08T16:09:02.125 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] AccessTest.Foo 2023-10-08T16:09:02.172 INFO:tasks.workunit.client.0.smithi133.stdout:out: [{"entity":"client.libcephfs_foo_test.1892788649","key":"AQAe1CJlTVbXCRAAegmPDmNpjeTHVIenu2cpfw==","caps":{"mds":"allow rw","mon":"allow *","osd":"allow rw"}}] 2023-10-08T16:09:02.172 INFO:tasks.workunit.client.0.smithi133.stdout:key: AQAe1CJlTVbXCRAAegmPDmNpjeTHVIenu2cpfw== 2023-10-08T16:09:03.229 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] AccessTest.Foo (1104 ms) 2023-10-08T16:09:03.229 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] AccessTest.Path 2023-10-08T16:09:03.295 INFO:tasks.workunit.client.0.smithi133.stdout:out: [{"entity":"client.libcephfs_path_test.285878393","key":"AQAf1CJlt10jERAAxy0dH98grQTKUykT/S2N6A==","caps":{"mds":"allow r, allow rw path=/ceph_test_libcephfs_access.1769369645","mon":"allow r","osd":"allow rwx"}}] 2023-10-08T16:09:03.295 INFO:tasks.workunit.client.0.smithi133.stdout:key: AQAf1CJlt10jERAAxy0dH98grQTKUykT/S2N6A== 2023-10-08T16:09:06.469 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] AccessTest.Path (3239 ms) 2023-10-08T16:09:06.469 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] AccessTest.ReadOnly 2023-10-08T16:09:06.505 INFO:tasks.workunit.client.0.smithi133.stdout:out: [{"entity":"client.libcephfs_readonly_test.978270043","key":"AQAi1CJl/2TMHRAAbX89n7zZScG4fepkYozHaQ==","caps":{"mds":"allow r","mon":"allow r","osd":"allow rw"}}] 2023-10-08T16:09:06.505 INFO:tasks.workunit.client.0.smithi133.stdout:key: AQAi1CJl/2TMHRAAbX89n7zZScG4fepkYozHaQ== 2023-10-08T16:09:06.627 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] AccessTest.ReadOnly (159 ms) 2023-10-08T16:09:06.627 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] AccessTest.User 2023-10-08T16:09:06.664 INFO:tasks.workunit.client.0.smithi133.stdout:out: [{"entity":"client.libcephfs_user_test.41969701","key":"AQAi1CJlrRlNJxAAAC6xJmHeIxW0tPPSPe1FnA==","caps":{"mds":"allow rw uid=123 gids=456,789","mon":"allow *","osd":"allow rw"}}] 2023-10-08T16:09:06.664 INFO:tasks.workunit.client.0.smithi133.stdout:key: AQAi1CJlrRlNJxAAAC6xJmHeIxW0tPPSPe1FnA== 2023-10-08T16:09:06.918 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] AccessTest.User (291 ms) 2023-10-08T16:09:06.918 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 4 tests from AccessTest (4793 ms total) 2023-10-08T16:09:06.918 INFO:tasks.workunit.client.0.smithi133.stdout: 2023-10-08T16:09:06.918 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment tear-down 2023-10-08T16:09:06.919 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] 95 tests from 2 test suites ran. (80681 ms total) 2023-10-08T16:09:06.919 INFO:tasks.workunit.client.0.smithi133.stdout:[ PASSED ] 95 tests. 2023-10-08T16:09:06.931 DEBUG:teuthology.orchestra.run:got remote process result: 127 2023-10-08T16:09:06.931 INFO:tasks.workunit.client.0.smithi133.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh: 5: ceph_test_libcephfs_reclaim: not found 2023-10-08T16:09:06.932 INFO:tasks.workunit:Stopping ['libcephfs/test.sh'] on client.0... 2023-10-08T16:09:06.932 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-10-08T16:09:07.184 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test libcephfs/test.sh) on smithi133 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=abf19fc7a04fe4fceab4e98d4013ae1da7c06006 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh' 2023-10-08T16:09:07.253 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=a2c82665bc154a9dbbbc6299ced23cbe Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test libcephfs/test.sh) on smithi133 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=abf19fc7a04fe4fceab4e98d4013ae1da7c06006 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh' 2023-10-08T16:09:07.255 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-10-08T16:09:07.265 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:09:07.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.381+0000 7fe4f2060700 1 Processor -- start 2023-10-08T16:09:07.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.381+0000 7fe4f2060700 1 -- start start 2023-10-08T16:09:07.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.381+0000 7fe4f2060700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4ec0b57b0 0x7fe4ec0b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:07.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.381+0000 7fe4f2060700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe4ec0b0860 0x7fe4ec145af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:07.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.381+0000 7fe4f2060700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4ec0b2ae0 con 0x7fe4ec0b4cf0 2023-10-08T16:09:07.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.381+0000 7fe4f2060700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ec0b1090 con 0x7fe4ec0b0860 2023-10-08T16:09:07.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.381+0000 7fe4f2060700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec0b1d60 con 0x7fe4ec0b57b0 2023-10-08T16:09:07.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.381+0000 7fe4eaffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe4ec0b0860 0x7fe4ec145af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:07.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.381+0000 7fe4eb7fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4ec0b57b0 0x7fe4ec0b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:07.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.381+0000 7fe4eaffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe4ec0b0860 0x7fe4ec145af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42600/0 (socket says 172.21.15.133:42600) 2023-10-08T16:09:07.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.381+0000 7fe4eb7fe700 1 --2- 172.21.15.133:0/4202636512 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4ec0b57b0 0x7fe4ec0b5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.133:34210/0 (socket says 172.21.15.133:34210) 2023-10-08T16:09:07.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.381+0000 7fe4eaffd700 1 -- 172.21.15.133:0/4202636512 learned_addr learned my addr 172.21.15.133:0/4202636512 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:07.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.381+0000 7fe4ebfff700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fe4ec0b4cf0 0x7fe4ec142570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.133:38784/0 (socket says 172.21.15.133:38784) 2023-10-08T16:09:07.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.381+0000 7fe4eaffd700 1 -- 172.21.15.133:0/4202636512 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4ec0b57b0 msgr2=0x7fe4ec0b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:07.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.381+0000 7fe4ea7fc700 1 -- 172.21.15.133:0/4202636512 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937653994 0 0) 0x7fe4ec0b2ae0 con 0x7fe4ec0b4cf0 2023-10-08T16:09:07.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.381+0000 7fe4eaffd700 1 --2- 172.21.15.133:0/4202636512 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4ec0b57b0 0x7fe4ec0b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:07.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.381+0000 7fe4eaffd700 1 -- 172.21.15.133:0/4202636512 >> v1:172.21.15.190:6789/0 conn(0x7fe4ec0b4cf0 legacy=0x7fe4ec142570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:07.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.381+0000 7fe4eaffd700 1 -- 172.21.15.133:0/4202636512 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ec0b60c0 con 0x7fe4ec0b0860 2023-10-08T16:09:07.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.381+0000 7fe4eaffd700 1 --2- 172.21.15.133:0/4202636512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ec0b0860 0x7fe4ec145af0 secure :-1 s=READY pgs=4339 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0099b0 tx=0x7fe4dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1abec918dc0e4950 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:07.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.381+0000 7fe4ea7fc700 1 -- 172.21.15.133:0/4202636512 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc009ea0 con 0x7fe4ec0b0860 2023-10-08T16:09:07.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.381+0000 7fe4ea7fc700 1 -- 172.21.15.133:0/4202636512 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4dc00b860 con 0x7fe4ec0b0860 2023-10-08T16:09:07.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.381+0000 7fe4ea7fc700 1 -- 172.21.15.133:0/4202636512 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc00bc00 con 0x7fe4ec0b0860 2023-10-08T16:09:07.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.381+0000 7fe4f2060700 1 -- 172.21.15.133:0/4202636512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ec0b0860 msgr2=0x7fe4ec145af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:07.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.381+0000 7fe4f2060700 1 --2- 172.21.15.133:0/4202636512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ec0b0860 0x7fe4ec145af0 secure :-1 s=READY pgs=4339 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0099b0 tx=0x7fe4dc009250 comp rx=0 tx=0).stop 2023-10-08T16:09:07.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.385+0000 7fe4f2060700 1 -- 172.21.15.133:0/4202636512 shutdown_connections 2023-10-08T16:09:07.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.385+0000 7fe4f2060700 1 --2- 172.21.15.133:0/4202636512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ec0b0860 0x7fe4ec145af0 unknown :-1 s=CLOSED pgs=4339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:07.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.385+0000 7fe4f2060700 1 --2- 172.21.15.133:0/4202636512 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4ec0b57b0 0x7fe4ec0b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:07.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.385+0000 7fe4f2060700 1 -- 172.21.15.133:0/4202636512 >> 172.21.15.133:0/4202636512 conn(0x7fe4ec062ba0 msgr2=0x7fe4ec062fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:07.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.385+0000 7fe4f2060700 1 -- 172.21.15.133:0/4202636512 shutdown_connections 2023-10-08T16:09:07.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.385+0000 7fe4f2060700 1 -- 172.21.15.133:0/4202636512 wait complete. 2023-10-08T16:09:07.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.385+0000 7fe4f2060700 1 Processor -- start 2023-10-08T16:09:07.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.385+0000 7fe4f2060700 1 -- start start 2023-10-08T16:09:07.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.385+0000 7fe4f2060700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4ec0b0860 0x7fe4ec0a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:07.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.385+0000 7fe4f2060700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4ec0b4cf0 0x7fe4ec142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:07.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.385+0000 7fe4f2060700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ec0b57b0 0x7fe4ec1555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:07.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.385+0000 7fe4f2060700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec0abba0 con 0x7fe4ec0b57b0 2023-10-08T16:09:07.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.385+0000 7fe4f2060700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec1430e0 con 0x7fe4ec0b0860 2023-10-08T16:09:07.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.385+0000 7fe4f2060700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec0aa890 con 0x7fe4ec0b4cf0 2023-10-08T16:09:07.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.385+0000 7fe4ebfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ec0b57b0 0x7fe4ec1555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:07.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.385+0000 7fe4ebfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ec0b57b0 0x7fe4ec1555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42608/0 (socket says 172.21.15.133:42608) 2023-10-08T16:09:07.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.385+0000 7fe4ebfff700 1 -- 172.21.15.133:0/1042206350 learned_addr learned my addr 172.21.15.133:0/1042206350 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:07.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.385+0000 7fe4eb7fe700 1 --2- 172.21.15.133:0/1042206350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4ec0b0860 0x7fe4ec0a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:07.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.385+0000 7fe4eaffd700 1 --2- 172.21.15.133:0/1042206350 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4ec0b4cf0 0x7fe4ec142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:07.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.389+0000 7fe4ebfff700 1 -- 172.21.15.133:0/1042206350 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4ec0b4cf0 msgr2=0x7fe4ec142ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:07.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.389+0000 7fe4ebfff700 1 --2- 172.21.15.133:0/1042206350 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4ec0b4cf0 0x7fe4ec142ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:07.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.389+0000 7fe4ebfff700 1 -- 172.21.15.133:0/1042206350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4ec0b0860 msgr2=0x7fe4ec0a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:07.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.389+0000 7fe4ebfff700 1 --2- 172.21.15.133:0/1042206350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4ec0b0860 0x7fe4ec0a9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:07.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.389+0000 7fe4ebfff700 1 -- 172.21.15.133:0/1042206350 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc0094f0 con 0x7fe4ec0b57b0 2023-10-08T16:09:07.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.389+0000 7fe4eaffd700 1 --2- 172.21.15.133:0/1042206350 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4ec0b4cf0 0x7fe4ec142ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:07.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.389+0000 7fe4ebfff700 1 --2- 172.21.15.133:0/1042206350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ec0b57b0 0x7fe4ec1555a0 secure :-1 s=READY pgs=4340 cs=0 l=1 rev1=1 crypto rx=0x7fe4d400c560 tx=0x7fe4d4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:07.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.389+0000 7fe4e37fe700 1 -- 172.21.15.133:0/1042206350 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d400ce70 con 0x7fe4ec0b57b0 2023-10-08T16:09:07.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.389+0000 7fe4e37fe700 1 -- 172.21.15.133:0/1042206350 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d4005a70 con 0x7fe4ec0b57b0 2023-10-08T16:09:07.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.389+0000 7fe4f2060700 1 -- 172.21.15.133:0/1042206350 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ec0aab70 con 0x7fe4ec0b57b0 2023-10-08T16:09:07.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.389+0000 7fe4e37fe700 1 -- 172.21.15.133:0/1042206350 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4005e30 con 0x7fe4ec0b57b0 2023-10-08T16:09:07.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.389+0000 7fe4f2060700 1 -- 172.21.15.133:0/1042206350 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ec155ae0 con 0x7fe4ec0b57b0 2023-10-08T16:09:07.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.389+0000 7fe4f2060700 1 -- 172.21.15.133:0/1042206350 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4ec0aad00 con 0x7fe4ec0b57b0 2023-10-08T16:09:07.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.389+0000 7fe4e37fe700 1 -- 172.21.15.133:0/1042206350 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe4d40072e0 con 0x7fe4ec0b57b0 2023-10-08T16:09:07.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.393+0000 7fe4e37fe700 1 --2- 172.21.15.133:0/1042206350 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe4cc060580 0x7fe4cc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:07.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.393+0000 7fe4e37fe700 1 -- 172.21.15.133:0/1042206350 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fe4d407bff0 con 0x7fe4ec0b57b0 2023-10-08T16:09:07.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.393+0000 7fe4eb7fe700 1 --2- 172.21.15.133:0/1042206350 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe4cc060580 0x7fe4cc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:07.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.393+0000 7fe4eb7fe700 1 --2- 172.21.15.133:0/1042206350 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe4cc060580 0x7fe4cc062a30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe4e400f5b0 tx=0x7fe4e400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:07.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.397+0000 7fe4e37fe700 1 -- 172.21.15.133:0/1042206350 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe4d404c530 con 0x7fe4ec0b57b0 2023-10-08T16:09:07.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.553+0000 7fe4f2060700 1 -- 172.21.15.133:0/1042206350 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4ec0a95c0 con 0x7fe4ec0b57b0 2023-10-08T16:09:07.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.557+0000 7fe4e37fe700 1 -- 172.21.15.133:0/1042206350 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+15654 (secure 0 0 0) 0x7fe4d4017020 con 0x7fe4ec0b57b0 2023-10-08T16:09:07.562 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:09:07.562 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":28,"fsid":"f2546191-d59e-4805-8e1b-3d8d3d1dad86","created":"2023-10-08T16:03:52.631855+0000","modified":"2023-10-08T16:08:57.686321+0000","last_up_change":"2023-10-08T16:04:04.030581+0000","last_in_change":"2023-10-08T16:03:54.835293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:04.898316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:14.869859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:15.983795+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":27,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8c5deadf-a203-4d30-aa7f-6e2e492b6ffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6809","nonce":33493},{"type":"v1","addr":"172.21.15.133:6811","nonce":33493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":33493},{"type":"v1","addr":"172.21.15.133:6815","nonce":33493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":33493},{"type":"v1","addr":"172.21.15.133:6822","nonce":33493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":33493},{"type":"v1","addr":"172.21.15.133:6818","nonce":33493}]},"public_addr":"172.21.15.133:6811/33493","cluster_addr":"172.21.15.133:6815/33493","heartbeat_back_addr":"172.21.15.133:6822/33493","heartbeat_front_addr":"172.21.15.133:6818/33493","state":["exists","up"]},{"osd":1,"uuid":"9b081c42-c915-48c3-a1ad-410f09a78576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":33490},{"type":"v1","addr":"172.21.15.133:6801","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":33490},{"type":"v1","addr":"172.21.15.133:6803","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":33490},{"type":"v1","addr":"172.21.15.133:6807","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":33490},{"type":"v1","addr":"172.21.15.133:6805","nonce":33490}]},"public_addr":"172.21.15.133:6801/33490","cluster_addr":"172.21.15.133:6803/33490","heartbeat_back_addr":"172.21.15.133:6807/33490","heartbeat_front_addr":"172.21.15.133:6805/33490","state":["exists","up"]},{"osd":2,"uuid":"88ecda43-01cd-4644-ab0c-92c91fd38966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":33492},{"type":"v1","addr":"172.21.15.133:6825","nonce":33492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":33492},{"type":"v1","addr":"172.21.15.133:6827","nonce":33492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":33492},{"type":"v1","addr":"172.21.15.133:6831","nonce":33492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":33492},{"type":"v1","addr":"172.21.15.133:6829","nonce":33492}]},"public_addr":"172.21.15.133:6825/33492","cluster_addr":"172.21.15.133:6827/33492","heartbeat_back_addr":"172.21.15.133:6831/33492","heartbeat_front_addr":"172.21.15.133:6829/33492","state":["exists","up"]},{"osd":3,"uuid":"39faf38d-b8e2-4e11-9b3b-84dc834c977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":33491},{"type":"v1","addr":"172.21.15.133:6810","nonce":33491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":33491},{"type":"v1","addr":"172.21.15.133:6814","nonce":33491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":33491},{"type":"v1","addr":"172.21.15.133:6823","nonce":33491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":33491},{"type":"v1","addr":"172.21.15.133:6819","nonce":33491}]},"public_addr":"172.21.15.133:6810/33491","cluster_addr":"172.21.15.133:6814/33491","heartbeat_back_addr":"172.21.15.133:6823/33491","heartbeat_front_addr":"172.21.15.133:6819/33491","state":["exists","up"]},{"osd":4,"uuid":"4c097e61-1cad-4b61-9183-4e7bc486bd32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":33678},{"type":"v1","addr":"172.21.15.190:6810","nonce":33678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":33678},{"type":"v1","addr":"172.21.15.190:6814","nonce":33678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":33678},{"type":"v1","addr":"172.21.15.190:6822","nonce":33678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":33678},{"type":"v1","addr":"172.21.15.190:6818","nonce":33678}]},"public_addr":"172.21.15.190:6810/33678","cluster_addr":"172.21.15.190:6814/33678","heartbeat_back_addr":"172.21.15.190:6822/33678","heartbeat_front_addr":"172.21.15.190:6818/33678","state":["exists","up"]},{"osd":5,"uuid":"05f072e0-7bc0-40f0-8cb6-8e322c82d6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":33676},{"type":"v1","addr":"172.21.15.190:6811","nonce":33676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":33676},{"type":"v1","addr":"172.21.15.190:6815","nonce":33676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":33676},{"type":"v1","addr":"172.21.15.190:6823","nonce":33676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":33676},{"type":"v1","addr":"172.21.15.190:6819","nonce":33676}]},"public_addr":"172.21.15.190:6811/33676","cluster_addr":"172.21.15.190:6815/33676","heartbeat_back_addr":"172.21.15.190:6823/33676","heartbeat_front_addr":"172.21.15.190:6819/33676","state":["exists","up"]},{"osd":6,"uuid":"1bcce8d7-14f3-442d-b135-68c7d66cdedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":33677},{"type":"v1","addr":"172.21.15.190:6801","nonce":33677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":33677},{"type":"v1","addr":"172.21.15.190:6803","nonce":33677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":33677},{"type":"v1","addr":"172.21.15.190:6807","nonce":33677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":33677},{"type":"v1","addr":"172.21.15.190:6805","nonce":33677}]},"public_addr":"172.21.15.190:6801/33677","cluster_addr":"172.21.15.190:6803/33677","heartbeat_back_addr":"172.21.15.190:6807/33677","heartbeat_front_addr":"172.21.15.190:6805/33677","state":["exists","up"]},{"osd":7,"uuid":"9157dbf7-2bf9-43d7-a89a-a8e3dae7514c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":33686},{"type":"v1","addr":"172.21.15.190:6825","nonce":33686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":33686},{"type":"v1","addr":"172.21.15.190:6827","nonce":33686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":33686},{"type":"v1","addr":"172.21.15.190:6831","nonce":33686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":33686},{"type":"v1","addr":"172.21.15.190:6829","nonce":33686}]},"public_addr":"172.21.15.190:6825/33686","cluster_addr":"172.21.15.190:6827/33686","heartbeat_back_addr":"172.21.15.190:6831/33686","heartbeat_front_addr":"172.21.15.190:6829/33686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.886742+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.199618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.871695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.115926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.069650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.841448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.132320+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.315132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":14,"length":6}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:07.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.557+0000 7fe4f2060700 1 -- 172.21.15.133:0/1042206350 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe4cc060580 msgr2=0x7fe4cc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:07.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.557+0000 7fe4f2060700 1 --2- 172.21.15.133:0/1042206350 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe4cc060580 0x7fe4cc062a30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe4e400f5b0 tx=0x7fe4e400b040 comp rx=0 tx=0).stop 2023-10-08T16:09:07.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.557+0000 7fe4f2060700 1 -- 172.21.15.133:0/1042206350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ec0b57b0 msgr2=0x7fe4ec1555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:07.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.557+0000 7fe4f2060700 1 --2- 172.21.15.133:0/1042206350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ec0b57b0 0x7fe4ec1555a0 secure :-1 s=READY pgs=4340 cs=0 l=1 rev1=1 crypto rx=0x7fe4d400c560 tx=0x7fe4d4007f90 comp rx=0 tx=0).stop 2023-10-08T16:09:07.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.557+0000 7fe4f2060700 1 -- 172.21.15.133:0/1042206350 shutdown_connections 2023-10-08T16:09:07.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.557+0000 7fe4f2060700 1 --2- 172.21.15.133:0/1042206350 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe4cc060580 0x7fe4cc062a30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:07.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.557+0000 7fe4f2060700 1 --2- 172.21.15.133:0/1042206350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ec0b57b0 0x7fe4ec1555a0 unknown :-1 s=CLOSED pgs=4340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:07.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.557+0000 7fe4f2060700 1 --2- 172.21.15.133:0/1042206350 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4ec0b4cf0 0x7fe4ec142ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:07.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.557+0000 7fe4f2060700 1 --2- 172.21.15.133:0/1042206350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4ec0b0860 0x7fe4ec0a9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:07.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.557+0000 7fe4f2060700 1 -- 172.21.15.133:0/1042206350 >> 172.21.15.133:0/1042206350 conn(0x7fe4ec062ba0 msgr2=0x7fe4ec062f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:07.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.557+0000 7fe4f2060700 1 -- 172.21.15.133:0/1042206350 shutdown_connections 2023-10-08T16:09:07.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.557+0000 7fe4f2060700 1 -- 172.21.15.133:0/1042206350 wait complete. 2023-10-08T16:09:07.576 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:04:04.898316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:04:14.869859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:04:15.983795+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 19, 'snap_epoch': 27, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:09:07.577 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:09:07.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.685+0000 7f68fb59e700 1 Processor -- start 2023-10-08T16:09:07.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.685+0000 7f68fb59e700 1 -- start start 2023-10-08T16:09:07.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.689+0000 7f68fb59e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68fc0b2fa0 0x7f68fc14dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:07.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.689+0000 7f68fb59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68fc1463b0 con 0x7f68fc069350 2023-10-08T16:09:07.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.689+0000 7f68fb59e700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68fc146690 con 0x7f68fc145e90 2023-10-08T16:09:07.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.689+0000 7f68fb59e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc06eb00 con 0x7f68fc0b2fa0 2023-10-08T16:09:07.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.689+0000 7f68fa59c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f68fc069350 0x7f68fc0b2890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:45352/0 (socket says 172.21.15.133:45352) 2023-10-08T16:09:07.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.689+0000 7f68fa59c700 1 -- 172.21.15.133:0/2258432471 learned_addr learned my addr 172.21.15.133:0/2258432471 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:09:07.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.689+0000 7f68fad9d700 1 --2- 172.21.15.133:0/2258432471 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68fc0b2fa0 0x7f68fc14dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:07.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.689+0000 7f68fad9d700 1 -- 172.21.15.133:0/2258432471 >> v1:172.21.15.190:6789/0 conn(0x7f68fc145e90 legacy=0x7f68fc06dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:07.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.689+0000 7f68fad9d700 1 -- 172.21.15.133:0/2258432471 >> v1:172.21.15.133:6789/0 conn(0x7f68fc069350 legacy=0x7f68fc0b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:07.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.689+0000 7f68fad9d700 1 -- 172.21.15.133:0/2258432471 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc0b2330 con 0x7f68fc0b2fa0 2023-10-08T16:09:07.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.689+0000 7f68fad9d700 1 --2- 172.21.15.133:0/2258432471 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68fc0b2fa0 0x7f68fc14dd50 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f68f4009e90 tx=0x7f68f4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=243f4a095d2eaa14 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:07.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.693+0000 7f68f959a700 1 -- 172.21.15.133:0/2258432471 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f400e070 con 0x7f68fc0b2fa0 2023-10-08T16:09:07.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.693+0000 7f68f959a700 1 -- 172.21.15.133:0/2258432471 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f400bc30 con 0x7f68fc0b2fa0 2023-10-08T16:09:07.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.693+0000 7f68f959a700 1 -- 172.21.15.133:0/2258432471 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f4012430 con 0x7f68fc0b2fa0 2023-10-08T16:09:07.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.693+0000 7f68fb59e700 1 -- 172.21.15.133:0/2258432471 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68fc0b2fa0 msgr2=0x7f68fc14dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:07.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.693+0000 7f68fb59e700 1 --2- 172.21.15.133:0/2258432471 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68fc0b2fa0 0x7f68fc14dd50 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f68f4009e90 tx=0x7f68f4009780 comp rx=0 tx=0).stop 2023-10-08T16:09:07.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.693+0000 7f68fb59e700 1 -- 172.21.15.133:0/2258432471 shutdown_connections 2023-10-08T16:09:07.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.693+0000 7f68fb59e700 1 --2- 172.21.15.133:0/2258432471 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68fc0b2fa0 0x7f68fc14dd50 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:07.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.693+0000 7f68fb59e700 1 -- 172.21.15.133:0/2258432471 >> 172.21.15.133:0/2258432471 conn(0x7f68fc0679e0 msgr2=0x7f68fc068c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:07.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.693+0000 7f68fb59e700 1 -- 172.21.15.133:0/2258432471 shutdown_connections 2023-10-08T16:09:07.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.693+0000 7f68fb59e700 1 -- 172.21.15.133:0/2258432471 wait complete. 2023-10-08T16:09:07.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.697+0000 7f68fb59e700 1 Processor -- start 2023-10-08T16:09:07.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.697+0000 7f68fb59e700 1 -- start start 2023-10-08T16:09:07.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.697+0000 7f68fb59e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68fc069350 0x7f68fc147b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:07.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.697+0000 7f68fb59e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68fc0b2fa0 0x7f68fc13d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:07.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.697+0000 7f68fb59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68fc145e90 0x7f68fc142580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:07.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.697+0000 7f68fb59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc1480d0 con 0x7f68fc145e90 2023-10-08T16:09:07.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.697+0000 7f68fb59e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc13f430 con 0x7f68fc0b2fa0 2023-10-08T16:09:07.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.697+0000 7f68fb59e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc13f710 con 0x7f68fc069350 2023-10-08T16:09:07.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.697+0000 7f68fad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68fc145e90 0x7f68fc142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:07.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.697+0000 7f68fad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68fc145e90 0x7f68fc142580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42622/0 (socket says 172.21.15.133:42622) 2023-10-08T16:09:07.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.697+0000 7f68fad9d700 1 -- 172.21.15.133:0/2424372898 learned_addr learned my addr 172.21.15.133:0/2424372898 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:07.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.697+0000 7f68fa59c700 1 --2- 172.21.15.133:0/2424372898 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68fc069350 0x7f68fc147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:07.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.697+0000 7f68f9d9b700 1 --2- 172.21.15.133:0/2424372898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68fc0b2fa0 0x7f68fc13d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:07.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.697+0000 7f68fad9d700 1 -- 172.21.15.133:0/2424372898 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68fc069350 msgr2=0x7f68fc147b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:07.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.697+0000 7f68fad9d700 1 --2- 172.21.15.133:0/2424372898 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68fc069350 0x7f68fc147b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:07.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.697+0000 7f68fad9d700 1 -- 172.21.15.133:0/2424372898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68fc0b2fa0 msgr2=0x7f68fc13d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:07.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.697+0000 7f68fad9d700 1 --2- 172.21.15.133:0/2424372898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68fc0b2fa0 0x7f68fc13d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:07.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.697+0000 7f68fad9d700 1 -- 172.21.15.133:0/2424372898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f4009a20 con 0x7f68fc145e90 2023-10-08T16:09:07.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.697+0000 7f68fad9d700 1 --2- 172.21.15.133:0/2424372898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68fc145e90 0x7f68fc142580 secure :-1 s=READY pgs=4342 cs=0 l=1 rev1=1 crypto rx=0x7f68f4013000 tx=0x7f68f4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:07.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.697+0000 7f68ea7fc700 1 -- 172.21.15.133:0/2424372898 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f4012e10 con 0x7f68fc145e90 2023-10-08T16:09:07.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.697+0000 7f68ea7fc700 1 -- 172.21.15.133:0/2424372898 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f4021070 con 0x7f68fc145e90 2023-10-08T16:09:07.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.697+0000 7f68fb59e700 1 -- 172.21.15.133:0/2424372898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68fc13f0e0 con 0x7f68fc145e90 2023-10-08T16:09:07.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.697+0000 7f68fb59e700 1 -- 172.21.15.133:0/2424372898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68fc13fc30 con 0x7f68fc145e90 2023-10-08T16:09:07.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.697+0000 7f68ea7fc700 1 -- 172.21.15.133:0/2424372898 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f4026680 con 0x7f68fc145e90 2023-10-08T16:09:07.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.701+0000 7f68fb59e700 1 -- 172.21.15.133:0/2424372898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68e00052b0 con 0x7f68fc145e90 2023-10-08T16:09:07.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.701+0000 7f68ea7fc700 1 -- 172.21.15.133:0/2424372898 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f68f4023030 con 0x7f68fc145e90 2023-10-08T16:09:07.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.701+0000 7f68ea7fc700 1 --2- 172.21.15.133:0/2424372898 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f68dc060550 0x7f68dc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:07.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.701+0000 7f68ea7fc700 1 -- 172.21.15.133:0/2424372898 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f68f407eae0 con 0x7f68fc145e90 2023-10-08T16:09:07.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.701+0000 7f68fa59c700 1 --2- 172.21.15.133:0/2424372898 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f68dc060550 0x7f68dc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:07.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.701+0000 7f68fa59c700 1 --2- 172.21.15.133:0/2424372898 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f68dc060550 0x7f68dc062a00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f68ec007fd0 tx=0x7f68ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:07.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.705+0000 7f68ea7fc700 1 -- 172.21.15.133:0/2424372898 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f68f404f040 con 0x7f68fc145e90 2023-10-08T16:09:07.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.873+0000 7f68fb59e700 1 -- 172.21.15.133:0/2424372898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f68e0005ae0 con 0x7f68fc145e90 2023-10-08T16:09:07.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.873+0000 7f68ea7fc700 1 -- 172.21.15.133:0/2424372898 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f68f4052660 con 0x7f68fc145e90 2023-10-08T16:09:07.879 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-10-08T16:09:07.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.873+0000 7f68fb59e700 1 -- 172.21.15.133:0/2424372898 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f68dc060550 msgr2=0x7f68dc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:07.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.873+0000 7f68fb59e700 1 --2- 172.21.15.133:0/2424372898 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f68dc060550 0x7f68dc062a00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f68ec007fd0 tx=0x7f68ec009040 comp rx=0 tx=0).stop 2023-10-08T16:09:07.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.873+0000 7f68fb59e700 1 -- 172.21.15.133:0/2424372898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68fc145e90 msgr2=0x7f68fc142580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:07.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.873+0000 7f68fb59e700 1 --2- 172.21.15.133:0/2424372898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68fc145e90 0x7f68fc142580 secure :-1 s=READY pgs=4342 cs=0 l=1 rev1=1 crypto rx=0x7f68f4013000 tx=0x7f68f4019000 comp rx=0 tx=0).stop 2023-10-08T16:09:07.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.877+0000 7f68fb59e700 1 -- 172.21.15.133:0/2424372898 shutdown_connections 2023-10-08T16:09:07.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.877+0000 7f68fb59e700 1 --2- 172.21.15.133:0/2424372898 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f68dc060550 0x7f68dc062a00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:07.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.877+0000 7f68fb59e700 1 --2- 172.21.15.133:0/2424372898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68fc145e90 0x7f68fc142580 unknown :-1 s=CLOSED pgs=4342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:07.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.877+0000 7f68fb59e700 1 --2- 172.21.15.133:0/2424372898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68fc0b2fa0 0x7f68fc13d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:07.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.877+0000 7f68fb59e700 1 --2- 172.21.15.133:0/2424372898 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68fc069350 0x7f68fc147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:07.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.877+0000 7f68fb59e700 1 -- 172.21.15.133:0/2424372898 >> 172.21.15.133:0/2424372898 conn(0x7f68fc0679e0 msgr2=0x7f68fc06cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:07.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.877+0000 7f68fb59e700 1 -- 172.21.15.133:0/2424372898 shutdown_connections 2023-10-08T16:09:07.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:07.877+0000 7f68fb59e700 1 -- 172.21.15.133:0/2424372898 wait complete. 2023-10-08T16:09:07.893 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:09:08.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.001+0000 7f734a034700 1 Processor -- start 2023-10-08T16:09:08.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.001+0000 7f734a034700 1 -- start start 2023-10-08T16:09:08.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.001+0000 7f734a034700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f73440634e0 0x7f73440b0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.001+0000 7f734a034700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f734413c570 0x7f734414d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.001+0000 7f734a034700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73440b22c0 con 0x7f7344145af0 2023-10-08T16:09:08.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.001+0000 7f734a034700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73440b0bc0 con 0x7f73440634e0 2023-10-08T16:09:08.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.001+0000 7f734a034700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73440b1b50 con 0x7f734413c570 2023-10-08T16:09:08.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.001+0000 7f7349032700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f73440634e0 0x7f73440b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.001+0000 7f7349032700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f73440634e0 0x7f73440b0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42624/0 (socket says 172.21.15.133:42624) 2023-10-08T16:09:08.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.001+0000 7f7349032700 1 -- 172.21.15.133:0/42125084 learned_addr learned my addr 172.21.15.133:0/42125084 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:08.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.001+0000 7f7349833700 1 --2- 172.21.15.133:0/42125084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f734413c570 0x7f734414d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.005+0000 7f7349032700 1 -- 172.21.15.133:0/42125084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f734413c570 msgr2=0x7f734414d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:08.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.005+0000 7f7349032700 1 --2- 172.21.15.133:0/42125084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f734413c570 0x7f734414d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.005+0000 7f7349032700 1 -- 172.21.15.133:0/42125084 >> v1:172.21.15.190:6789/0 conn(0x7f7344145af0 legacy=0x7f734413be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:08.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.005+0000 7f7337fff700 1 -- 172.21.15.133:0/42125084 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2447805228 0 0) 0x7f73440b22c0 con 0x7f7344145af0 2023-10-08T16:09:08.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.005+0000 7f7349032700 1 -- 172.21.15.133:0/42125084 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73440b2860 con 0x7f73440634e0 2023-10-08T16:09:08.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.005+0000 7f7349032700 1 --2- 172.21.15.133:0/42125084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73440634e0 0x7f73440b0680 secure :-1 s=READY pgs=4343 cs=0 l=1 rev1=1 crypto rx=0x7f73400099b0 tx=0x7f7340009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67ad7687bc07c42 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:08.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.005+0000 7f7337fff700 1 -- 172.21.15.133:0/42125084 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7340009ea0 con 0x7f73440634e0 2023-10-08T16:09:08.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.005+0000 7f7337fff700 1 -- 172.21.15.133:0/42125084 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734000b860 con 0x7f73440634e0 2023-10-08T16:09:08.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.005+0000 7f7337fff700 1 -- 172.21.15.133:0/42125084 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734000bc00 con 0x7f73440634e0 2023-10-08T16:09:08.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.005+0000 7f734a034700 1 -- 172.21.15.133:0/42125084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73440634e0 msgr2=0x7f73440b0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:08.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.005+0000 7f734a034700 1 --2- 172.21.15.133:0/42125084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73440634e0 0x7f73440b0680 secure :-1 s=READY pgs=4343 cs=0 l=1 rev1=1 crypto rx=0x7f73400099b0 tx=0x7f7340009250 comp rx=0 tx=0).stop 2023-10-08T16:09:08.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.005+0000 7f734a034700 1 -- 172.21.15.133:0/42125084 shutdown_connections 2023-10-08T16:09:08.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.005+0000 7f734a034700 1 --2- 172.21.15.133:0/42125084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f734413c570 0x7f734414d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.005+0000 7f734a034700 1 --2- 172.21.15.133:0/42125084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73440634e0 0x7f73440b0680 unknown :-1 s=CLOSED pgs=4343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.005+0000 7f734a034700 1 -- 172.21.15.133:0/42125084 >> 172.21.15.133:0/42125084 conn(0x7f7344067cd0 msgr2=0x7f7344062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:08.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.005+0000 7f734a034700 1 -- 172.21.15.133:0/42125084 shutdown_connections 2023-10-08T16:09:08.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.005+0000 7f734a034700 1 -- 172.21.15.133:0/42125084 wait complete. 2023-10-08T16:09:08.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.005+0000 7f734a034700 1 Processor -- start 2023-10-08T16:09:08.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.005+0000 7f734a034700 1 -- start start 2023-10-08T16:09:08.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.005+0000 7f734a034700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73440634e0 0x7f7344142300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.005+0000 7f734a034700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f734413c570 0x7f73441522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.005+0000 7f734a034700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7344145af0 0x7f73441527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.005+0000 7f734a034700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7344136d20 con 0x7f734413c570 2023-10-08T16:09:08.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.005+0000 7f734a034700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7344155a20 con 0x7f73440634e0 2023-10-08T16:09:08.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.005+0000 7f734a034700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734413cb70 con 0x7f7344145af0 2023-10-08T16:09:08.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.009+0000 7f7348831700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f734413c570 0x7f73441522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.009+0000 7f7348831700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f734413c570 0x7f73441522a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42626/0 (socket says 172.21.15.133:42626) 2023-10-08T16:09:08.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.009+0000 7f7348831700 1 -- 172.21.15.133:0/4107508130 learned_addr learned my addr 172.21.15.133:0/4107508130 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:08.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.009+0000 7f7349032700 1 --2- 172.21.15.133:0/4107508130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73440634e0 0x7f7344142300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.009+0000 7f7349833700 1 --2- 172.21.15.133:0/4107508130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7344145af0 0x7f73441527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.009+0000 7f7348831700 1 -- 172.21.15.133:0/4107508130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7344145af0 msgr2=0x7f73441527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:08.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.009+0000 7f7348831700 1 --2- 172.21.15.133:0/4107508130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7344145af0 0x7f73441527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.009+0000 7f7348831700 1 -- 172.21.15.133:0/4107508130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73440634e0 msgr2=0x7f7344142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:08.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.009+0000 7f7348831700 1 --2- 172.21.15.133:0/4107508130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73440634e0 0x7f7344142300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.009+0000 7f7348831700 1 -- 172.21.15.133:0/4107508130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73400094f0 con 0x7f734413c570 2023-10-08T16:09:08.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.009+0000 7f7348831700 1 --2- 172.21.15.133:0/4107508130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f734413c570 0x7f73441522a0 secure :-1 s=READY pgs=4344 cs=0 l=1 rev1=1 crypto rx=0x7f733800c7e0 tx=0x7f7338007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:08.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.009+0000 7f73357fa700 1 -- 172.21.15.133:0/4107508130 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7338012700 con 0x7f734413c570 2023-10-08T16:09:08.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.009+0000 7f73357fa700 1 -- 172.21.15.133:0/4107508130 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7338012880 con 0x7f734413c570 2023-10-08T16:09:08.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.009+0000 7f73357fa700 1 -- 172.21.15.133:0/4107508130 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7338012c40 con 0x7f734413c570 2023-10-08T16:09:08.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.009+0000 7f734a034700 1 -- 172.21.15.133:0/4107508130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734413ce50 con 0x7f734413c570 2023-10-08T16:09:08.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.009+0000 7f734a034700 1 -- 172.21.15.133:0/4107508130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7344155fa0 con 0x7f734413c570 2023-10-08T16:09:08.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.009+0000 7f734a034700 1 -- 172.21.15.133:0/4107508130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73441561c0 con 0x7f734413c570 2023-10-08T16:09:08.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.009+0000 7f73357fa700 1 -- 172.21.15.133:0/4107508130 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f733801b400 con 0x7f734413c570 2023-10-08T16:09:08.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.013+0000 7f73357fa700 1 --2- 172.21.15.133:0/4107508130 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f7328060550 0x7f7328062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.013+0000 7f73357fa700 1 -- 172.21.15.133:0/4107508130 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f733807c430 con 0x7f734413c570 2023-10-08T16:09:08.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.013+0000 7f7349032700 1 --2- 172.21.15.133:0/4107508130 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f7328060550 0x7f7328062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.013+0000 7f7349032700 1 --2- 172.21.15.133:0/4107508130 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f7328060550 0x7f7328062a00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f73400099b0 tx=0x7f7340017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:08.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.017+0000 7f73357fa700 1 -- 172.21.15.133:0/4107508130 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f733804c990 con 0x7f734413c570 2023-10-08T16:09:08.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.177+0000 7f734a034700 1 -- 172.21.15.133:0/4107508130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f734404be40 con 0x7f734413c570 2023-10-08T16:09:08.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.177+0000 7f73357fa700 1 -- 172.21.15.133:0/4107508130 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f733804ffb0 con 0x7f734413c570 2023-10-08T16:09:08.185 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-10-08T16:09:08.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.181+0000 7f734a034700 1 -- 172.21.15.133:0/4107508130 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f7328060550 msgr2=0x7f7328062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:08.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.181+0000 7f734a034700 1 --2- 172.21.15.133:0/4107508130 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f7328060550 0x7f7328062a00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f73400099b0 tx=0x7f7340017000 comp rx=0 tx=0).stop 2023-10-08T16:09:08.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.181+0000 7f734a034700 1 -- 172.21.15.133:0/4107508130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f734413c570 msgr2=0x7f73441522a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:08.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.181+0000 7f734a034700 1 --2- 172.21.15.133:0/4107508130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f734413c570 0x7f73441522a0 secure :-1 s=READY pgs=4344 cs=0 l=1 rev1=1 crypto rx=0x7f733800c7e0 tx=0x7f7338007df0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.181+0000 7f734a034700 1 -- 172.21.15.133:0/4107508130 shutdown_connections 2023-10-08T16:09:08.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.181+0000 7f734a034700 1 --2- 172.21.15.133:0/4107508130 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f7328060550 0x7f7328062a00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.181+0000 7f734a034700 1 --2- 172.21.15.133:0/4107508130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7344145af0 0x7f73441527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.181+0000 7f734a034700 1 --2- 172.21.15.133:0/4107508130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f734413c570 0x7f73441522a0 unknown :-1 s=CLOSED pgs=4344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.181+0000 7f734a034700 1 --2- 172.21.15.133:0/4107508130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73440634e0 0x7f7344142300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.181+0000 7f734a034700 1 -- 172.21.15.133:0/4107508130 >> 172.21.15.133:0/4107508130 conn(0x7f7344067cd0 msgr2=0x7f734413b510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:08.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.181+0000 7f734a034700 1 -- 172.21.15.133:0/4107508130 shutdown_connections 2023-10-08T16:09:08.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.181+0000 7f734a034700 1 -- 172.21.15.133:0/4107508130 wait complete. 2023-10-08T16:09:08.199 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:09:08.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.309+0000 7f97a1495700 1 Processor -- start 2023-10-08T16:09:08.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.309+0000 7f97a1495700 1 -- start start 2023-10-08T16:09:08.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.309+0000 7f97a1495700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f979c13f710 0x7f979c13fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.309+0000 7f97a1495700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f979c06de10 0x7f979c06e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.309+0000 7f97a1495700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979c142fd0 con 0x7f979c0b52d0 2023-10-08T16:09:08.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.309+0000 7f97a1495700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f979c1437f0 con 0x7f979c06de10 2023-10-08T16:09:08.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.309+0000 7f97a1495700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979c13f2c0 con 0x7f979c13f710 2023-10-08T16:09:08.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.309+0000 7f97a0c94700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f979c06de10 0x7f979c06e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.309+0000 7f97a0c94700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f979c06de10 0x7f979c06e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42632/0 (socket says 172.21.15.133:42632) 2023-10-08T16:09:08.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.309+0000 7f97a0c94700 1 -- 172.21.15.133:0/450612497 learned_addr learned my addr 172.21.15.133:0/450612497 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:08.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.309+0000 7f979b7fe700 1 --2- 172.21.15.133:0/450612497 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f979c13f710 0x7f979c13fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.309+0000 7f97a0c94700 1 -- 172.21.15.133:0/450612497 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f979c13f710 msgr2=0x7f979c13fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:08.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.309+0000 7f97a0c94700 1 --2- 172.21.15.133:0/450612497 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f979c13f710 0x7f979c13fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.309+0000 7f97a0c94700 1 -- 172.21.15.133:0/450612497 >> v1:172.21.15.190:6789/0 conn(0x7f979c0b52d0 legacy=0x7f979c1428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:08.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.309+0000 7f97a0c94700 1 -- 172.21.15.133:0/450612497 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979c0ae540 con 0x7f979c06de10 2023-10-08T16:09:08.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.309+0000 7f979b7fe700 1 --2- 172.21.15.133:0/450612497 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f979c13f710 0x7f979c13fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:08.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.313+0000 7f97a0c94700 1 --2- 172.21.15.133:0/450612497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f979c06de10 0x7f979c06e270 secure :-1 s=READY pgs=4345 cs=0 l=1 rev1=1 crypto rx=0x7f9794009f20 tx=0x7f9794009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323d33b157257ca4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:08.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.313+0000 7f979affd700 1 -- 172.21.15.133:0/450612497 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979400e070 con 0x7f979c06de10 2023-10-08T16:09:08.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.313+0000 7f979affd700 1 -- 172.21.15.133:0/450612497 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979400ba40 con 0x7f979c06de10 2023-10-08T16:09:08.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.313+0000 7f979affd700 1 -- 172.21.15.133:0/450612497 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97940092e0 con 0x7f979c06de10 2023-10-08T16:09:08.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.313+0000 7f97a1495700 1 -- 172.21.15.133:0/450612497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f979c06de10 msgr2=0x7f979c06e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:08.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.313+0000 7f97a1495700 1 --2- 172.21.15.133:0/450612497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f979c06de10 0x7f979c06e270 secure :-1 s=READY pgs=4345 cs=0 l=1 rev1=1 crypto rx=0x7f9794009f20 tx=0x7f9794009840 comp rx=0 tx=0).stop 2023-10-08T16:09:08.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.313+0000 7f97a1495700 1 -- 172.21.15.133:0/450612497 shutdown_connections 2023-10-08T16:09:08.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.313+0000 7f97a1495700 1 --2- 172.21.15.133:0/450612497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f979c06de10 0x7f979c06e270 unknown :-1 s=CLOSED pgs=4345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.313+0000 7f97a1495700 1 --2- 172.21.15.133:0/450612497 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f979c13f710 0x7f979c13fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.313+0000 7f97a1495700 1 -- 172.21.15.133:0/450612497 >> 172.21.15.133:0/450612497 conn(0x7f979c068420 msgr2=0x7f979c070830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:08.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.313+0000 7f97a1495700 1 -- 172.21.15.133:0/450612497 shutdown_connections 2023-10-08T16:09:08.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.313+0000 7f97a1495700 1 -- 172.21.15.133:0/450612497 wait complete. 2023-10-08T16:09:08.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.313+0000 7f97a1495700 1 Processor -- start 2023-10-08T16:09:08.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.313+0000 7f97a1495700 1 -- start start 2023-10-08T16:09:08.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.313+0000 7f97a1495700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f979c06de10 0x7f979c06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.313+0000 7f97a1495700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f979c0b52d0 0x7f979c150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.313+0000 7f97a1495700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f979c13f710 0x7f979c153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.317+0000 7f97a1495700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979c153760 con 0x7f979c0b52d0 2023-10-08T16:09:08.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.317+0000 7f97a1495700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979c0b4320 con 0x7f979c13f710 2023-10-08T16:09:08.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.317+0000 7f97a1495700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979c1503f0 con 0x7f979c06de10 2023-10-08T16:09:08.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.317+0000 7f979b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f979c0b52d0 0x7f979c150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.317+0000 7f979bfff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f979c06de10 0x7f979c06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.317+0000 7f97a0c94700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f979c13f710 0x7f979c153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.317+0000 7f979b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f979c0b52d0 0x7f979c150880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42636/0 (socket says 172.21.15.133:42636) 2023-10-08T16:09:08.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.317+0000 7f979b7fe700 1 -- 172.21.15.133:0/960272041 learned_addr learned my addr 172.21.15.133:0/960272041 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:08.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.317+0000 7f979b7fe700 1 -- 172.21.15.133:0/960272041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f979c06de10 msgr2=0x7f979c06d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:08.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.317+0000 7f979b7fe700 1 --2- 172.21.15.133:0/960272041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f979c06de10 0x7f979c06d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.317+0000 7f979b7fe700 1 -- 172.21.15.133:0/960272041 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f979c13f710 msgr2=0x7f979c153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:08.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.317+0000 7f979b7fe700 1 --2- 172.21.15.133:0/960272041 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f979c13f710 0x7f979c153ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.317+0000 7f979b7fe700 1 -- 172.21.15.133:0/960272041 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9794009ae0 con 0x7f979c0b52d0 2023-10-08T16:09:08.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.317+0000 7f979b7fe700 1 --2- 172.21.15.133:0/960272041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f979c0b52d0 0x7f979c150880 secure :-1 s=READY pgs=4346 cs=0 l=1 rev1=1 crypto rx=0x7f978c00c850 tx=0x7f978c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:08.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.317+0000 7f9783fff700 1 -- 172.21.15.133:0/960272041 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c00a2e0 con 0x7f979c0b52d0 2023-10-08T16:09:08.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.317+0000 7f9783fff700 1 -- 172.21.15.133:0/960272041 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978c011600 con 0x7f979c0b52d0 2023-10-08T16:09:08.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.317+0000 7f97a1495700 1 -- 172.21.15.133:0/960272041 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979c13c240 con 0x7f979c0b52d0 2023-10-08T16:09:08.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.317+0000 7f9783fff700 1 -- 172.21.15.133:0/960272041 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c0119a0 con 0x7f979c0b52d0 2023-10-08T16:09:08.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.317+0000 7f97a1495700 1 -- 172.21.15.133:0/960272041 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979c13c520 con 0x7f979c0b52d0 2023-10-08T16:09:08.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.321+0000 7f9783fff700 1 -- 172.21.15.133:0/960272041 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f978c0223a0 con 0x7f979c0b52d0 2023-10-08T16:09:08.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.321+0000 7f97a1495700 1 -- 172.21.15.133:0/960272041 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f979c1501c0 con 0x7f979c0b52d0 2023-10-08T16:09:08.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.321+0000 7f9783fff700 1 --2- 172.21.15.133:0/960272041 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f9788060550 0x7f9788062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.321+0000 7f9783fff700 1 -- 172.21.15.133:0/960272041 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f978c07c9a0 con 0x7f979c0b52d0 2023-10-08T16:09:08.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.321+0000 7f979bfff700 1 --2- 172.21.15.133:0/960272041 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f9788060550 0x7f9788062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.321+0000 7f979bfff700 1 --2- 172.21.15.133:0/960272041 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f9788060550 0x7f9788062a00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f979c140000 tx=0x7f9790007ea0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:08.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.325+0000 7f9783fff700 1 -- 172.21.15.133:0/960272041 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f979c1501c0 con 0x7f979c0b52d0 2023-10-08T16:09:08.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.493+0000 7f97a1495700 1 -- 172.21.15.133:0/960272041 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f979c1501c0 con 0x7f979c0b52d0 2023-10-08T16:09:08.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.493+0000 7f9783fff700 1 -- 172.21.15.133:0/960272041 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f979c1501c0 con 0x7f979c0b52d0 2023-10-08T16:09:08.499 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-10-08T16:09:08.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.493+0000 7f97a1495700 1 -- 172.21.15.133:0/960272041 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f9788060550 msgr2=0x7f9788062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:08.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.493+0000 7f97a1495700 1 --2- 172.21.15.133:0/960272041 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f9788060550 0x7f9788062a00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f979c140000 tx=0x7f9790007ea0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.493+0000 7f97a1495700 1 -- 172.21.15.133:0/960272041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f979c0b52d0 msgr2=0x7f979c150880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:08.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.493+0000 7f97a1495700 1 --2- 172.21.15.133:0/960272041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f979c0b52d0 0x7f979c150880 secure :-1 s=READY pgs=4346 cs=0 l=1 rev1=1 crypto rx=0x7f978c00c850 tx=0x7f978c008040 comp rx=0 tx=0).stop 2023-10-08T16:09:08.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.497+0000 7f97a1495700 1 -- 172.21.15.133:0/960272041 shutdown_connections 2023-10-08T16:09:08.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.497+0000 7f97a1495700 1 --2- 172.21.15.133:0/960272041 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f9788060550 0x7f9788062a00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.497+0000 7f97a1495700 1 --2- 172.21.15.133:0/960272041 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f979c13f710 0x7f979c153ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.497+0000 7f97a1495700 1 --2- 172.21.15.133:0/960272041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f979c0b52d0 0x7f979c150880 unknown :-1 s=CLOSED pgs=4346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.497+0000 7f97a1495700 1 --2- 172.21.15.133:0/960272041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f979c06de10 0x7f979c06d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.497+0000 7f97a1495700 1 -- 172.21.15.133:0/960272041 >> 172.21.15.133:0/960272041 conn(0x7f979c068420 msgr2=0x7f979c13d330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:08.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.497+0000 7f97a1495700 1 -- 172.21.15.133:0/960272041 shutdown_connections 2023-10-08T16:09:08.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.497+0000 7f97a1495700 1 -- 172.21.15.133:0/960272041 wait complete. 2023-10-08T16:09:08.514 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-10-08T16:09:08.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.613+0000 7f8e1d43c700 1 Processor -- start 2023-10-08T16:09:08.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.613+0000 7f8e1d43c700 1 -- start start 2023-10-08T16:09:08.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.613+0000 7f8e1d43c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8e18067ce0 0x7f8e180ad360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.613+0000 7f8e1d43c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e180680b0 0x7f8e1813f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.613+0000 7f8e1d43c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8e1813f830 0x7f8e1806e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.613+0000 7f8e1d43c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e180ad8a0 con 0x7f8e18067ce0 2023-10-08T16:09:08.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.613+0000 7f8e1d43c700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e180ac5d0 con 0x7f8e1813f830 2023-10-08T16:09:08.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.613+0000 7f8e1d43c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e180aca60 con 0x7f8e180680b0 2023-10-08T16:09:08.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.613+0000 7f8e16ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8e18067ce0 0x7f8e180ad360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.613+0000 7f8e16ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8e18067ce0 0x7f8e180ad360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42644/0 (socket says 172.21.15.133:42644) 2023-10-08T16:09:08.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.613+0000 7f8e16ffd700 1 -- 172.21.15.133:0/1090925198 learned_addr learned my addr 172.21.15.133:0/1090925198 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:08.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.613+0000 7f8e167fc700 1 --2- 172.21.15.133:0/1090925198 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e180680b0 0x7f8e1813f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.613+0000 7f8e177fe700 1 --2- 172.21.15.133:0/1090925198 >> v2:172.21.15.190:3300/0 conn(0x7f8e1813f830 0x7f8e1806e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.613+0000 7f8e16ffd700 1 -- 172.21.15.133:0/1090925198 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e180680b0 msgr2=0x7f8e1813f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:08.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.613+0000 7f8e16ffd700 1 --2- 172.21.15.133:0/1090925198 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e180680b0 0x7f8e1813f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.613+0000 7f8e16ffd700 1 -- 172.21.15.133:0/1090925198 >> v2:172.21.15.190:3300/0 conn(0x7f8e1813f830 msgr2=0x7f8e1806e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:08.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.613+0000 7f8e16ffd700 1 --2- 172.21.15.133:0/1090925198 >> v2:172.21.15.190:3300/0 conn(0x7f8e1813f830 0x7f8e1806e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.613+0000 7f8e16ffd700 1 -- 172.21.15.133:0/1090925198 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e180abf80 con 0x7f8e18067ce0 2023-10-08T16:09:08.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.613+0000 7f8e16ffd700 1 --2- 172.21.15.133:0/1090925198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e18067ce0 0x7f8e180ad360 secure :-1 s=READY pgs=4347 cs=0 l=1 rev1=1 crypto rx=0x7f8e180b0d30 tx=0x7f8e00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09d6d7bdc8b8052 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:08.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.613+0000 7f8e15ffb700 1 -- 172.21.15.133:0/1090925198 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0000b640 con 0x7f8e18067ce0 2023-10-08T16:09:08.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.613+0000 7f8e15ffb700 1 -- 172.21.15.133:0/1090925198 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0000b7a0 con 0x7f8e18067ce0 2023-10-08T16:09:08.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.613+0000 7f8e15ffb700 1 -- 172.21.15.133:0/1090925198 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0000bb60 con 0x7f8e18067ce0 2023-10-08T16:09:08.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.617+0000 7f8e1d43c700 1 -- 172.21.15.133:0/1090925198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e18067ce0 msgr2=0x7f8e180ad360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:08.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.617+0000 7f8e1d43c700 1 --2- 172.21.15.133:0/1090925198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e18067ce0 0x7f8e180ad360 secure :-1 s=READY pgs=4347 cs=0 l=1 rev1=1 crypto rx=0x7f8e180b0d30 tx=0x7f8e00009250 comp rx=0 tx=0).stop 2023-10-08T16:09:08.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.617+0000 7f8e1d43c700 1 -- 172.21.15.133:0/1090925198 shutdown_connections 2023-10-08T16:09:08.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.617+0000 7f8e1d43c700 1 --2- 172.21.15.133:0/1090925198 >> v2:172.21.15.190:3300/0 conn(0x7f8e1813f830 0x7f8e1806e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.617+0000 7f8e1d43c700 1 --2- 172.21.15.133:0/1090925198 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e180680b0 0x7f8e1813f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.617+0000 7f8e1d43c700 1 --2- 172.21.15.133:0/1090925198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e18067ce0 0x7f8e180ad360 unknown :-1 s=CLOSED pgs=4347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.617+0000 7f8e1d43c700 1 -- 172.21.15.133:0/1090925198 >> 172.21.15.133:0/1090925198 conn(0x7f8e180b4ba0 msgr2=0x7f8e180b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:08.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.617+0000 7f8e1d43c700 1 -- 172.21.15.133:0/1090925198 shutdown_connections 2023-10-08T16:09:08.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.617+0000 7f8e1d43c700 1 -- 172.21.15.133:0/1090925198 wait complete. 2023-10-08T16:09:08.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.617+0000 7f8e1d43c700 1 Processor -- start 2023-10-08T16:09:08.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.617+0000 7f8e1d43c700 1 -- start start 2023-10-08T16:09:08.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.621+0000 7f8e1d43c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e18067ce0 0x7f8e1806c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.621+0000 7f8e1d43c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e180680b0 0x7f8e18132cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.621+0000 7f8e1d43c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e1813f830 0x7f8e18155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.621+0000 7f8e1d43c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1806d4c0 con 0x7f8e180680b0 2023-10-08T16:09:08.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.621+0000 7f8e1d43c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e180b2c40 con 0x7f8e18067ce0 2023-10-08T16:09:08.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.621+0000 7f8e1d43c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1806d7a0 con 0x7f8e1813f830 2023-10-08T16:09:08.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.621+0000 7f8e167fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e180680b0 0x7f8e18132cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.621+0000 7f8e167fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e180680b0 0x7f8e18132cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42646/0 (socket says 172.21.15.133:42646) 2023-10-08T16:09:08.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.621+0000 7f8e167fc700 1 -- 172.21.15.133:0/984952936 learned_addr learned my addr 172.21.15.133:0/984952936 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:08.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.621+0000 7f8e177fe700 1 --2- 172.21.15.133:0/984952936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e1813f830 0x7f8e18155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.621+0000 7f8e16ffd700 1 --2- 172.21.15.133:0/984952936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e18067ce0 0x7f8e1806c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.621+0000 7f8e167fc700 1 -- 172.21.15.133:0/984952936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e1813f830 msgr2=0x7f8e18155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:08.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.621+0000 7f8e167fc700 1 --2- 172.21.15.133:0/984952936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e1813f830 0x7f8e18155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.621+0000 7f8e167fc700 1 -- 172.21.15.133:0/984952936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e18067ce0 msgr2=0x7f8e1806c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:08.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.621+0000 7f8e167fc700 1 --2- 172.21.15.133:0/984952936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e18067ce0 0x7f8e1806c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.621+0000 7f8e167fc700 1 -- 172.21.15.133:0/984952936 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e000094f0 con 0x7f8e180680b0 2023-10-08T16:09:08.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.621+0000 7f8e167fc700 1 --2- 172.21.15.133:0/984952936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e180680b0 0x7f8e18132cb0 secure :-1 s=READY pgs=4348 cs=0 l=1 rev1=1 crypto rx=0x7f8e08009ef0 tx=0x7f8e0800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:08.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.621+0000 7f8e0effd700 1 -- 172.21.15.133:0/984952936 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0800cc50 con 0x7f8e180680b0 2023-10-08T16:09:08.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.621+0000 7f8e0effd700 1 -- 172.21.15.133:0/984952936 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0800f040 con 0x7f8e180680b0 2023-10-08T16:09:08.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.621+0000 7f8e1d43c700 1 -- 172.21.15.133:0/984952936 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e1806dc30 con 0x7f8e180680b0 2023-10-08T16:09:08.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.621+0000 7f8e0effd700 1 -- 172.21.15.133:0/984952936 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e08014480 con 0x7f8e180680b0 2023-10-08T16:09:08.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.621+0000 7f8e1d43c700 1 -- 172.21.15.133:0/984952936 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1806bd50 con 0x7f8e180680b0 2023-10-08T16:09:08.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.625+0000 7f8e0effd700 1 -- 172.21.15.133:0/984952936 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8e080147f0 con 0x7f8e180680b0 2023-10-08T16:09:08.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.625+0000 7f8e1d43c700 1 -- 172.21.15.133:0/984952936 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e1806b8d0 con 0x7f8e180680b0 2023-10-08T16:09:08.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.625+0000 7f8e0effd700 1 --2- 172.21.15.133:0/984952936 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f8df8060580 0x7f8df8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.625+0000 7f8e0effd700 1 -- 172.21.15.133:0/984952936 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f8e0807d260 con 0x7f8e180680b0 2023-10-08T16:09:08.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.625+0000 7f8e16ffd700 1 --2- 172.21.15.133:0/984952936 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f8df8060580 0x7f8df8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.625+0000 7f8e16ffd700 1 --2- 172.21.15.133:0/984952936 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f8df8060580 0x7f8df8062a30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8e180b0d30 tx=0x7f8e00017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:08.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.633+0000 7f8e0effd700 1 -- 172.21.15.133:0/984952936 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8e1806b8d0 con 0x7f8e180680b0 2023-10-08T16:09:08.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.833+0000 7f8e1d43c700 1 -- 172.21.15.133:0/984952936 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f8e1806b8d0 con 0x7f8e180680b0 2023-10-08T16:09:08.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.841+0000 7f8e0effd700 1 -- 172.21.15.133:0/984952936 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v5) v1 ==== 81+0+420635 (secure 0 0 0) 0x7f8e1806b8d0 con 0x7f8e180680b0 2023-10-08T16:09:08.853 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:09:08.853 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-10-08T16:09:08.853 INFO:teuthology.orchestra.run.smithi133.stdout: "epoch": 5, 2023-10-08T16:09:08.854 INFO:teuthology.orchestra.run.smithi133.stdout: "active_gid": 4104, 2023-10-08T16:09:08.854 INFO:teuthology.orchestra.run.smithi133.stdout: "active_name": "y", 2023-10-08T16:09:08.854 INFO:teuthology.orchestra.run.smithi133.stdout: "active_addrs": { 2023-10-08T16:09:08.854 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2023-10-08T16:09:08.854 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:08.854 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2023-10-08T16:09:08.854 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6832", 2023-10-08T16:09:08.854 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 33362 2023-10-08T16:09:08.855 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.855 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:08.855 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-10-08T16:09:08.855 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6833", 2023-10-08T16:09:08.855 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 33362 2023-10-08T16:09:08.855 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:08.855 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2023-10-08T16:09:08.856 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.856 INFO:teuthology.orchestra.run.smithi133.stdout: "active_addr": "172.21.15.133:6833/33362", 2023-10-08T16:09:08.856 INFO:teuthology.orchestra.run.smithi133.stdout: "active_change": "2023-10-08T16:03:56.819019+0000", 2023-10-08T16:09:08.856 INFO:teuthology.orchestra.run.smithi133.stdout: "active_mgr_features": 4540138320759226367, 2023-10-08T16:09:08.856 INFO:teuthology.orchestra.run.smithi133.stdout: "available": true, 2023-10-08T16:09:08.856 INFO:teuthology.orchestra.run.smithi133.stdout: "standbys": [ 2023-10-08T16:09:08.856 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:08.856 INFO:teuthology.orchestra.run.smithi133.stdout: "gid": 4102, 2023-10-08T16:09:08.857 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "x", 2023-10-08T16:09:08.857 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr_features": 4540138320759226367, 2023-10-08T16:09:08.857 INFO:teuthology.orchestra.run.smithi133.stdout: "available_modules": [ 2023-10-08T16:09:08.857 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:08.857 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "alerts", 2023-10-08T16:09:08.857 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:08.857 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:08.857 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:08.858 INFO:teuthology.orchestra.run.smithi133.stdout: "interval": { 2023-10-08T16:09:08.858 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "interval", 2023-10-08T16:09:08.858 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:08.858 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.858 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.858 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "60", 2023-10-08T16:09:08.858 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.859 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.859 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.859 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "How frequently to reexamine health status", 2023-10-08T16:09:08.859 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.859 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.859 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.859 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.859 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:08.860 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:08.860 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.860 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.860 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.860 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:08.860 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.860 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.860 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:08.861 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:08.861 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:08.861 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:08.861 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:08.861 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:08.861 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:08.861 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:08.862 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:08.862 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.862 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.862 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.862 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.862 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:08.862 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:08.862 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:08.863 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.863 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.863 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:08.863 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.863 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.863 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.863 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:08.864 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.864 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.864 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.864 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.864 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:08.864 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:08.864 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.864 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.865 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.865 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:08.865 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.865 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.865 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:08.865 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:08.865 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:08.865 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:08.866 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:08.866 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:08.866 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:08.866 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:08.866 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:08.866 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.866 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.867 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.867 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.867 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:08.867 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:08.867 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:08.867 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.867 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.867 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:08.868 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.868 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.868 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.868 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:08.868 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.868 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.868 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.869 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.869 INFO:teuthology.orchestra.run.smithi133.stdout: "smtp_destination": { 2023-10-08T16:09:08.869 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "smtp_destination", 2023-10-08T16:09:08.869 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.869 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.869 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.869 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:08.869 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.870 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.870 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.870 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Email address to send alerts to", 2023-10-08T16:09:08.870 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.870 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.870 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.870 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.871 INFO:teuthology.orchestra.run.smithi133.stdout: "smtp_from_name": { 2023-10-08T16:09:08.871 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "smtp_from_name", 2023-10-08T16:09:08.871 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.871 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.871 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.871 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "Ceph", 2023-10-08T16:09:08.871 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.871 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.872 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.872 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Email From: name", 2023-10-08T16:09:08.872 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.872 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.872 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.872 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.872 INFO:teuthology.orchestra.run.smithi133.stdout: "smtp_host": { 2023-10-08T16:09:08.872 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "smtp_host", 2023-10-08T16:09:08.873 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.873 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.873 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.873 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:08.873 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.873 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.873 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.873 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "SMTP server", 2023-10-08T16:09:08.874 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.874 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.874 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.874 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.874 INFO:teuthology.orchestra.run.smithi133.stdout: "smtp_password": { 2023-10-08T16:09:08.874 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "smtp_password", 2023-10-08T16:09:08.875 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.875 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.875 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.875 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:08.875 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.875 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.875 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.875 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Password to authenticate with", 2023-10-08T16:09:08.876 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.876 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.876 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.876 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.876 INFO:teuthology.orchestra.run.smithi133.stdout: "smtp_port": { 2023-10-08T16:09:08.876 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "smtp_port", 2023-10-08T16:09:08.876 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:08.877 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.877 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.877 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "465", 2023-10-08T16:09:08.877 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.877 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.877 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.877 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "SMTP port", 2023-10-08T16:09:08.878 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.878 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.878 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.878 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.878 INFO:teuthology.orchestra.run.smithi133.stdout: "smtp_sender": { 2023-10-08T16:09:08.878 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "smtp_sender", 2023-10-08T16:09:08.878 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.878 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.879 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.879 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:08.879 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.879 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.879 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.879 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "SMTP envelope sender", 2023-10-08T16:09:08.879 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.879 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.880 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.880 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.880 INFO:teuthology.orchestra.run.smithi133.stdout: "smtp_ssl": { 2023-10-08T16:09:08.880 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "smtp_ssl", 2023-10-08T16:09:08.880 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:08.880 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.880 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.881 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:08.881 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.881 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.881 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.881 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-08T16:09:08.881 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.881 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.882 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.882 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.882 INFO:teuthology.orchestra.run.smithi133.stdout: "smtp_user": { 2023-10-08T16:09:08.882 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "smtp_user", 2023-10-08T16:09:08.882 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.882 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.882 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.883 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:08.883 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.883 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.883 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.883 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "User to authenticate as", 2023-10-08T16:09:08.883 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.883 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.883 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.884 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:08.884 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:08.884 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.884 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:08.884 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "balancer", 2023-10-08T16:09:08.884 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:08.884 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:08.885 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:08.885 INFO:teuthology.orchestra.run.smithi133.stdout: "active": { 2023-10-08T16:09:08.885 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "active", 2023-10-08T16:09:08.885 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:08.885 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.885 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.885 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:08.885 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.886 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.886 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.886 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "automatically balance PGs across cluster", 2023-10-08T16:09:08.886 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.886 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.886 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.886 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.886 INFO:teuthology.orchestra.run.smithi133.stdout: "begin_time": { 2023-10-08T16:09:08.887 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "begin_time", 2023-10-08T16:09:08.887 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.887 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.887 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.887 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "0000", 2023-10-08T16:09:08.887 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.887 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.888 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.888 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "beginning time of day to automatically balance", 2023-10-08T16:09:08.888 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T16:09:08.888 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.888 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.888 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.888 INFO:teuthology.orchestra.run.smithi133.stdout: "begin_weekday": { 2023-10-08T16:09:08.889 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "begin_weekday", 2023-10-08T16:09:08.889 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "uint", 2023-10-08T16:09:08.889 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.889 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.889 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "0", 2023-10-08T16:09:08.889 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "0", 2023-10-08T16:09:08.889 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "7", 2023-10-08T16:09:08.889 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.890 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-08T16:09:08.890 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2023-10-08T16:09:08.890 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.890 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.890 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.890 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_compat_max_iterations": { 2023-10-08T16:09:08.890 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "crush_compat_max_iterations", 2023-10-08T16:09:08.891 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "uint", 2023-10-08T16:09:08.891 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.891 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.891 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "25", 2023-10-08T16:09:08.891 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "1", 2023-10-08T16:09:08.891 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "250", 2023-10-08T16:09:08.891 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.891 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-08T16:09:08.892 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.892 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.892 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.892 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.892 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_compat_metrics": { 2023-10-08T16:09:08.892 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "crush_compat_metrics", 2023-10-08T16:09:08.892 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.893 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.893 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.893 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "pgs,objects,bytes", 2023-10-08T16:09:08.893 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.893 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.893 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.893 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-08T16:09:08.893 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-08T16:09:08.894 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.894 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.894 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.894 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_compat_step": { 2023-10-08T16:09:08.894 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "crush_compat_step", 2023-10-08T16:09:08.894 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "float", 2023-10-08T16:09:08.894 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.894 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.895 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "0.5", 2023-10-08T16:09:08.895 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "0.001", 2023-10-08T16:09:08.895 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "0.999", 2023-10-08T16:09:08.895 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.895 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "aggressiveness of optimization", 2023-10-08T16:09:08.895 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-08T16:09:08.895 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.896 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.896 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.896 INFO:teuthology.orchestra.run.smithi133.stdout: "end_time": { 2023-10-08T16:09:08.896 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "end_time", 2023-10-08T16:09:08.896 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.896 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.896 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.896 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "2400", 2023-10-08T16:09:08.897 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.897 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.897 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.897 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "ending time of day to automatically balance", 2023-10-08T16:09:08.897 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T16:09:08.897 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.897 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.897 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.898 INFO:teuthology.orchestra.run.smithi133.stdout: "end_weekday": { 2023-10-08T16:09:08.898 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "end_weekday", 2023-10-08T16:09:08.898 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "uint", 2023-10-08T16:09:08.898 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.898 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.898 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "7", 2023-10-08T16:09:08.898 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "0", 2023-10-08T16:09:08.899 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "7", 2023-10-08T16:09:08.899 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.899 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-08T16:09:08.899 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2023-10-08T16:09:08.899 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.899 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.899 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.900 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:08.900 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:08.900 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.900 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.900 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.900 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:08.900 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.901 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.901 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:08.901 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:08.901 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:08.901 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:08.901 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:08.901 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:08.901 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:08.902 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:08.902 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:08.902 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.902 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.902 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.902 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.902 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:08.902 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:08.903 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:08.903 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.903 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.903 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:08.903 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.903 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.903 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.904 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:08.904 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.904 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.904 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.904 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.904 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:08.904 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:08.905 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.905 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.905 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.905 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:08.905 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.905 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.905 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:08.906 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:08.906 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:08.906 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:08.906 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:08.906 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:08.906 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:08.906 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:08.907 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:08.907 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.907 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.907 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.907 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.907 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:08.907 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:08.907 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:08.908 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.908 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.908 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:08.908 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.908 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.908 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.908 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:08.909 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.909 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.909 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.909 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.909 INFO:teuthology.orchestra.run.smithi133.stdout: "min_score": { 2023-10-08T16:09:08.909 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "min_score", 2023-10-08T16:09:08.909 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "float", 2023-10-08T16:09:08.909 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.910 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.910 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "0", 2023-10-08T16:09:08.910 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.910 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.910 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.910 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-08T16:09:08.910 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.911 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.911 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.911 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.911 INFO:teuthology.orchestra.run.smithi133.stdout: "mode": { 2023-10-08T16:09:08.911 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "mode", 2023-10-08T16:09:08.911 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.911 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.912 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.912 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "upmap", 2023-10-08T16:09:08.912 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.912 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.912 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:08.912 INFO:teuthology.orchestra.run.smithi133.stdout: "crush-compat", 2023-10-08T16:09:08.912 INFO:teuthology.orchestra.run.smithi133.stdout: "none", 2023-10-08T16:09:08.912 INFO:teuthology.orchestra.run.smithi133.stdout: "upmap" 2023-10-08T16:09:08.913 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:08.913 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Balancer mode", 2023-10-08T16:09:08.913 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.913 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.913 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.913 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.913 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_ids": { 2023-10-08T16:09:08.913 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "pool_ids", 2023-10-08T16:09:08.914 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.914 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.914 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.914 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:08.914 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.914 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.914 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.915 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-08T16:09:08.915 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.915 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.915 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.915 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.915 INFO:teuthology.orchestra.run.smithi133.stdout: "sleep_interval": { 2023-10-08T16:09:08.915 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "sleep_interval", 2023-10-08T16:09:08.915 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:08.916 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.916 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.916 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "60", 2023-10-08T16:09:08.916 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.916 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.916 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.916 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-08T16:09:08.917 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.917 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.917 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.917 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.917 INFO:teuthology.orchestra.run.smithi133.stdout: "upmap_max_deviation": { 2023-10-08T16:09:08.917 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "upmap_max_deviation", 2023-10-08T16:09:08.917 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:08.917 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.918 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.918 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "5", 2023-10-08T16:09:08.918 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "1", 2023-10-08T16:09:08.918 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.918 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.918 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-08T16:09:08.918 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-08T16:09:08.919 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.919 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.919 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.919 INFO:teuthology.orchestra.run.smithi133.stdout: "upmap_max_optimizations": { 2023-10-08T16:09:08.919 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "upmap_max_optimizations", 2023-10-08T16:09:08.919 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "uint", 2023-10-08T16:09:08.919 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.919 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.920 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "10", 2023-10-08T16:09:08.920 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.920 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.920 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.920 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-08T16:09:08.920 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.920 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.921 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.921 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:08.921 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:08.921 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.921 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:08.921 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "cephadm", 2023-10-08T16:09:08.921 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": false, 2023-10-08T16:09:08.921 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "loading asyncssh library:No module named 'asyncssh'", 2023-10-08T16:09:08.922 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:08.922 INFO:teuthology.orchestra.run.smithi133.stdout: "agent_down_multiplier": { 2023-10-08T16:09:08.922 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "agent_down_multiplier", 2023-10-08T16:09:08.922 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "float", 2023-10-08T16:09:08.922 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.922 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.922 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "3.0", 2023-10-08T16:09:08.923 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.923 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.923 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.923 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-08T16:09:08.923 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.923 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.923 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.923 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.924 INFO:teuthology.orchestra.run.smithi133.stdout: "agent_refresh_rate": { 2023-10-08T16:09:08.924 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "agent_refresh_rate", 2023-10-08T16:09:08.924 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:08.924 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.924 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.924 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "20", 2023-10-08T16:09:08.924 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.925 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.925 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.925 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-08T16:09:08.925 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.925 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.925 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.925 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.925 INFO:teuthology.orchestra.run.smithi133.stdout: "agent_starting_port": { 2023-10-08T16:09:08.926 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "agent_starting_port", 2023-10-08T16:09:08.926 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:08.926 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.926 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.926 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "4721", 2023-10-08T16:09:08.926 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.926 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.926 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.927 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-08T16:09:08.927 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.927 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.927 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.927 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.927 INFO:teuthology.orchestra.run.smithi133.stdout: "allow_ptrace": { 2023-10-08T16:09:08.927 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "allow_ptrace", 2023-10-08T16:09:08.928 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:08.928 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.928 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.928 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:08.928 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.928 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.928 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.929 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-08T16:09:08.929 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-08T16:09:08.929 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.929 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.929 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.929 INFO:teuthology.orchestra.run.smithi133.stdout: "autotune_interval": { 2023-10-08T16:09:08.929 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "autotune_interval", 2023-10-08T16:09:08.929 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:08.930 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.930 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.930 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "600", 2023-10-08T16:09:08.930 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.930 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.930 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.930 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-08T16:09:08.930 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.931 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.931 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.931 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.931 INFO:teuthology.orchestra.run.smithi133.stdout: "autotune_memory_target_ratio": { 2023-10-08T16:09:08.931 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "autotune_memory_target_ratio", 2023-10-08T16:09:08.931 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "float", 2023-10-08T16:09:08.931 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.932 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.932 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "0.7", 2023-10-08T16:09:08.932 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.932 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.932 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.932 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-08T16:09:08.932 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.933 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.933 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.933 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.933 INFO:teuthology.orchestra.run.smithi133.stdout: "cgroups_split": { 2023-10-08T16:09:08.933 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "cgroups_split", 2023-10-08T16:09:08.933 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:08.933 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.933 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.934 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:08.934 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.934 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.934 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.934 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-08T16:09:08.934 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.934 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.935 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.935 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.935 INFO:teuthology.orchestra.run.smithi133.stdout: "config_checks_enabled": { 2023-10-08T16:09:08.935 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "config_checks_enabled", 2023-10-08T16:09:08.935 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:08.935 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.935 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.935 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:08.936 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.936 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.936 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.936 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-08T16:09:08.936 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.936 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.936 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.936 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.937 INFO:teuthology.orchestra.run.smithi133.stdout: "config_dashboard": { 2023-10-08T16:09:08.937 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "config_dashboard", 2023-10-08T16:09:08.937 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:08.937 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.937 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.937 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:08.937 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.938 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.938 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.938 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-08T16:09:08.938 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.938 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.938 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.938 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.938 INFO:teuthology.orchestra.run.smithi133.stdout: "container_image_alertmanager": { 2023-10-08T16:09:08.939 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "container_image_alertmanager", 2023-10-08T16:09:08.939 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.939 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.939 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.939 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-08T16:09:08.939 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.939 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.940 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.940 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Prometheus container image", 2023-10-08T16:09:08.940 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.940 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.940 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.940 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.940 INFO:teuthology.orchestra.run.smithi133.stdout: "container_image_base": { 2023-10-08T16:09:08.940 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "container_image_base", 2023-10-08T16:09:08.941 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.941 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.941 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.941 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-08T16:09:08.941 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.941 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.941 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.941 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Container image name, without the tag", 2023-10-08T16:09:08.942 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.942 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.942 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.942 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.942 INFO:teuthology.orchestra.run.smithi133.stdout: "container_image_grafana": { 2023-10-08T16:09:08.942 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "container_image_grafana", 2023-10-08T16:09:08.942 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.943 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.943 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.943 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-08T16:09:08.943 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.943 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.943 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.943 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Prometheus container image", 2023-10-08T16:09:08.943 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.944 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.944 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.944 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.944 INFO:teuthology.orchestra.run.smithi133.stdout: "container_image_haproxy": { 2023-10-08T16:09:08.944 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "container_image_haproxy", 2023-10-08T16:09:08.944 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.944 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.944 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.945 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-08T16:09:08.945 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.945 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.945 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.945 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "HAproxy container image", 2023-10-08T16:09:08.945 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.945 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.946 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.946 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.946 INFO:teuthology.orchestra.run.smithi133.stdout: "container_image_keepalived": { 2023-10-08T16:09:08.946 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "container_image_keepalived", 2023-10-08T16:09:08.946 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.946 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.946 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.946 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "quay.io/ceph/keepalived:2.1.5", 2023-10-08T16:09:08.947 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.947 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.947 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.947 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Keepalived container image", 2023-10-08T16:09:08.947 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.947 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.947 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.947 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.948 INFO:teuthology.orchestra.run.smithi133.stdout: "container_image_loki": { 2023-10-08T16:09:08.948 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "container_image_loki", 2023-10-08T16:09:08.948 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.948 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.948 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.948 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-08T16:09:08.948 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.949 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.949 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.949 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Loki container image", 2023-10-08T16:09:08.949 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.949 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.949 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.949 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.949 INFO:teuthology.orchestra.run.smithi133.stdout: "container_image_node_exporter": { 2023-10-08T16:09:08.950 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "container_image_node_exporter", 2023-10-08T16:09:08.950 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.950 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.950 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.950 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-08T16:09:08.950 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.950 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.951 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.951 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Prometheus container image", 2023-10-08T16:09:08.951 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.951 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.951 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.951 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.951 INFO:teuthology.orchestra.run.smithi133.stdout: "container_image_prometheus": { 2023-10-08T16:09:08.951 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "container_image_prometheus", 2023-10-08T16:09:08.952 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.952 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.952 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.952 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-08T16:09:08.952 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.952 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.952 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.953 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Prometheus container image", 2023-10-08T16:09:08.953 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.953 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.953 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.953 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.953 INFO:teuthology.orchestra.run.smithi133.stdout: "container_image_promtail": { 2023-10-08T16:09:08.953 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "container_image_promtail", 2023-10-08T16:09:08.953 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.954 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.954 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.954 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-08T16:09:08.954 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.954 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.954 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.954 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Promtail container image", 2023-10-08T16:09:08.955 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.955 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.955 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.955 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.955 INFO:teuthology.orchestra.run.smithi133.stdout: "container_image_snmp_gateway": { 2023-10-08T16:09:08.955 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "container_image_snmp_gateway", 2023-10-08T16:09:08.955 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.955 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.956 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.956 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-08T16:09:08.956 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.956 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.956 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.956 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "SNMP Gateway container image", 2023-10-08T16:09:08.956 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.957 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.957 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.957 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.957 INFO:teuthology.orchestra.run.smithi133.stdout: "container_init": { 2023-10-08T16:09:08.957 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "container_init", 2023-10-08T16:09:08.957 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:08.957 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.957 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.958 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:08.958 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.958 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.958 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.958 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Run podman/docker with `--init`", 2023-10-08T16:09:08.958 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.958 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.958 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.959 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.959 INFO:teuthology.orchestra.run.smithi133.stdout: "daemon_cache_timeout": { 2023-10-08T16:09:08.959 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "daemon_cache_timeout", 2023-10-08T16:09:08.959 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:08.959 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.959 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.959 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "600", 2023-10-08T16:09:08.959 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.960 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.960 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.960 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-08T16:09:08.960 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.960 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.960 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.960 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.960 INFO:teuthology.orchestra.run.smithi133.stdout: "default_cephadm_command_timeout": { 2023-10-08T16:09:08.961 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "default_cephadm_command_timeout", 2023-10-08T16:09:08.961 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:08.961 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.961 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.961 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "900", 2023-10-08T16:09:08.961 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.961 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.961 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.962 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-08T16:09:08.962 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.962 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.962 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.962 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.962 INFO:teuthology.orchestra.run.smithi133.stdout: "default_registry": { 2023-10-08T16:09:08.962 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "default_registry", 2023-10-08T16:09:08.963 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.963 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.963 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.963 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "docker.io", 2023-10-08T16:09:08.963 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.963 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.963 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.963 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-08T16:09:08.964 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.964 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.964 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.964 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.964 INFO:teuthology.orchestra.run.smithi133.stdout: "device_cache_timeout": { 2023-10-08T16:09:08.964 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "device_cache_timeout", 2023-10-08T16:09:08.964 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:08.964 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.965 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.965 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "1800", 2023-10-08T16:09:08.965 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.965 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.965 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.965 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "seconds to cache device inventory", 2023-10-08T16:09:08.965 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.965 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.966 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.966 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.966 INFO:teuthology.orchestra.run.smithi133.stdout: "device_enhanced_scan": { 2023-10-08T16:09:08.966 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "device_enhanced_scan", 2023-10-08T16:09:08.966 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:08.966 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.966 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.967 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:08.967 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.967 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.967 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.967 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-08T16:09:08.967 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.967 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.967 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.968 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.968 INFO:teuthology.orchestra.run.smithi133.stdout: "facts_cache_timeout": { 2023-10-08T16:09:08.968 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "facts_cache_timeout", 2023-10-08T16:09:08.968 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:08.968 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.968 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.968 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "60", 2023-10-08T16:09:08.968 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.969 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.969 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.969 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "seconds to cache host facts data", 2023-10-08T16:09:08.969 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.969 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.969 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.969 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.969 INFO:teuthology.orchestra.run.smithi133.stdout: "host_check_interval": { 2023-10-08T16:09:08.970 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "host_check_interval", 2023-10-08T16:09:08.970 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:08.970 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.970 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.970 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "600", 2023-10-08T16:09:08.970 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.970 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.970 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.971 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "how frequently to perform a host check", 2023-10-08T16:09:08.971 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.971 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.971 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.971 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.971 INFO:teuthology.orchestra.run.smithi133.stdout: "inventory_list_all": { 2023-10-08T16:09:08.971 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "inventory_list_all", 2023-10-08T16:09:08.972 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:08.972 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.972 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.972 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:08.972 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.972 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.972 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.972 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-08T16:09:08.973 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.973 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.973 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.973 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.973 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:08.973 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:08.973 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.973 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.974 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.974 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:08.974 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.974 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.974 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:08.974 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:08.974 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:08.975 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:08.975 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:08.975 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:08.975 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:08.975 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:08.975 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:08.975 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.975 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.976 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.976 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.976 INFO:teuthology.orchestra.run.smithi133.stdout: "log_refresh_metadata": { 2023-10-08T16:09:08.976 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_refresh_metadata", 2023-10-08T16:09:08.976 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:08.976 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.976 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.977 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:08.977 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.977 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.977 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.977 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-08T16:09:08.977 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.977 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.977 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.978 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.978 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:08.978 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:08.978 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:08.978 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.978 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.978 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:08.979 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.979 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.979 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.979 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-08T16:09:08.979 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.979 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.979 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.979 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.980 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:08.980 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:08.980 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.980 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.980 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.980 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:08.980 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.980 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.981 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:08.981 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:08.981 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:08.981 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:08.981 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:08.981 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:08.981 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:08.981 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:08.982 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:08.982 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.982 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.982 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.982 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.982 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:08.982 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:08.983 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:08.983 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.983 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:08.983 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:08.983 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.983 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.983 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.983 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:08.984 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.984 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.984 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.984 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.984 INFO:teuthology.orchestra.run.smithi133.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-08T16:09:08.984 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-08T16:09:08.984 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:08.985 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.985 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.985 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:08.985 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.985 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.985 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.985 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-08T16:09:08.985 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.986 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.986 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.986 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.986 INFO:teuthology.orchestra.run.smithi133.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-08T16:09:08.986 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-08T16:09:08.986 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.986 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.986 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.987 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "*", 2023-10-08T16:09:08.987 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.987 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.987 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.987 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-08T16:09:08.987 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.987 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.987 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.988 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.988 INFO:teuthology.orchestra.run.smithi133.stdout: "max_count_per_host": { 2023-10-08T16:09:08.988 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "max_count_per_host", 2023-10-08T16:09:08.988 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:08.988 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.988 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.988 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "10", 2023-10-08T16:09:08.988 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.989 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.989 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.989 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "max number of daemons per service per host", 2023-10-08T16:09:08.989 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.989 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.989 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.989 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.990 INFO:teuthology.orchestra.run.smithi133.stdout: "max_osd_draining_count": { 2023-10-08T16:09:08.990 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "max_osd_draining_count", 2023-10-08T16:09:08.990 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:08.990 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.990 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.990 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "10", 2023-10-08T16:09:08.990 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.990 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.991 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.991 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-08T16:09:08.991 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.991 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.991 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.991 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.991 INFO:teuthology.orchestra.run.smithi133.stdout: "migration_current": { 2023-10-08T16:09:08.992 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "migration_current", 2023-10-08T16:09:08.992 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:08.992 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.992 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.992 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:08.992 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.992 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.992 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.993 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "internal - do not modify", 2023-10-08T16:09:08.993 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.993 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.993 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.993 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.993 INFO:teuthology.orchestra.run.smithi133.stdout: "mode": { 2023-10-08T16:09:08.993 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "mode", 2023-10-08T16:09:08.993 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.994 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.994 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.994 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "root", 2023-10-08T16:09:08.994 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.994 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.994 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:08.994 INFO:teuthology.orchestra.run.smithi133.stdout: "cephadm-package", 2023-10-08T16:09:08.995 INFO:teuthology.orchestra.run.smithi133.stdout: "root" 2023-10-08T16:09:08.995 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:08.995 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "mode for remote execution of cephadm", 2023-10-08T16:09:08.995 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.995 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.995 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.995 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.995 INFO:teuthology.orchestra.run.smithi133.stdout: "prometheus_alerts_path": { 2023-10-08T16:09:08.996 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "prometheus_alerts_path", 2023-10-08T16:09:08.996 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.996 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.996 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.996 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-08T16:09:08.996 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.996 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.996 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.997 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-08T16:09:08.997 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.997 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.997 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.997 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.997 INFO:teuthology.orchestra.run.smithi133.stdout: "registry_insecure": { 2023-10-08T16:09:08.997 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "registry_insecure", 2023-10-08T16:09:08.997 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:08.998 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:08.998 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:08.998 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:08.998 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:08.998 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:08.998 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:08.998 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-08T16:09:08.999 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:08.999 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:08.999 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:08.999 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:08.999 INFO:teuthology.orchestra.run.smithi133.stdout: "registry_password": { 2023-10-08T16:09:08.999 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "registry_password", 2023-10-08T16:09:08.999 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:08.999 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.000 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.000 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.000 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.000 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.000 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.000 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-08T16:09:09.000 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.000 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.001 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.001 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.001 INFO:teuthology.orchestra.run.smithi133.stdout: "registry_url": { 2023-10-08T16:09:09.001 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "registry_url", 2023-10-08T16:09:09.001 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.001 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.001 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.002 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.002 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.002 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.002 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.002 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-08T16:09:09.002 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.002 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.002 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.003 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.003 INFO:teuthology.orchestra.run.smithi133.stdout: "registry_username": { 2023-10-08T16:09:09.003 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "registry_username", 2023-10-08T16:09:09.003 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.003 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.003 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.003 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.003 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.004 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.004 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.004 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-08T16:09:09.004 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.004 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.004 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.004 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.004 INFO:teuthology.orchestra.run.smithi133.stdout: "ssh_config_file": { 2023-10-08T16:09:09.005 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "ssh_config_file", 2023-10-08T16:09:09.005 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.005 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.005 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.005 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.005 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.005 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.006 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.006 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-08T16:09:09.006 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.006 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.006 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.006 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.006 INFO:teuthology.orchestra.run.smithi133.stdout: "use_agent": { 2023-10-08T16:09:09.006 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "use_agent", 2023-10-08T16:09:09.007 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.007 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.007 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.007 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.007 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.007 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.007 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.007 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-08T16:09:09.008 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.008 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.008 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.008 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.008 INFO:teuthology.orchestra.run.smithi133.stdout: "use_repo_digest": { 2023-10-08T16:09:09.008 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "use_repo_digest", 2023-10-08T16:09:09.008 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.009 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.009 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.009 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.009 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.009 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.009 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.009 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-08T16:09:09.009 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.010 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.010 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.010 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.010 INFO:teuthology.orchestra.run.smithi133.stdout: "warn_on_failed_host_check": { 2023-10-08T16:09:09.010 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "warn_on_failed_host_check", 2023-10-08T16:09:09.010 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.010 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.010 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.011 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.011 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.011 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.011 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.011 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "raise a health warning if the host check fails", 2023-10-08T16:09:09.011 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.011 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.011 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.012 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.012 INFO:teuthology.orchestra.run.smithi133.stdout: "warn_on_stray_daemons": { 2023-10-08T16:09:09.012 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "warn_on_stray_daemons", 2023-10-08T16:09:09.012 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.012 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.012 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.012 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.013 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.013 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.013 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.013 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-08T16:09:09.013 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.013 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.013 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.013 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.014 INFO:teuthology.orchestra.run.smithi133.stdout: "warn_on_stray_hosts": { 2023-10-08T16:09:09.014 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "warn_on_stray_hosts", 2023-10-08T16:09:09.014 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.014 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.014 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.014 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.014 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.015 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.015 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.015 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-08T16:09:09.015 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.015 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.015 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.015 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.015 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.016 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.016 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.016 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "crash", 2023-10-08T16:09:09.016 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.016 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.016 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.016 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.016 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.017 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.017 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.017 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.017 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.017 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.017 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.017 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.018 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.018 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.018 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.018 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.018 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.018 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.018 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.019 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.019 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.019 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.019 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.019 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.019 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.019 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.019 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.020 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.020 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.020 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.020 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.020 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.020 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.020 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.020 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.021 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.021 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.021 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.021 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.021 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.021 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.021 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.022 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.022 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.022 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.022 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.022 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.022 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.022 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.022 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.023 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.023 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.023 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.023 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.023 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.024 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.024 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.024 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.024 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.024 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.024 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.024 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.024 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.025 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.025 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.025 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.025 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.025 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.025 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.025 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.025 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.026 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.026 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.026 INFO:teuthology.orchestra.run.smithi133.stdout: "retain_interval": { 2023-10-08T16:09:09.026 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "retain_interval", 2023-10-08T16:09:09.026 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.026 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.026 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.026 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "31536000", 2023-10-08T16:09:09.027 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.027 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.027 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.027 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-08T16:09:09.027 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.027 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.029 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.029 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.029 INFO:teuthology.orchestra.run.smithi133.stdout: "warn_recent_interval": { 2023-10-08T16:09:09.029 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "warn_recent_interval", 2023-10-08T16:09:09.029 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.029 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.030 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.030 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "1209600", 2023-10-08T16:09:09.030 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.030 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.030 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.030 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-08T16:09:09.030 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.030 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.031 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.031 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.031 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.031 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.031 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.031 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "dashboard", 2023-10-08T16:09:09.031 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.032 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.032 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.032 INFO:teuthology.orchestra.run.smithi133.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-08T16:09:09.032 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-08T16:09:09.032 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.032 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.032 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.032 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "10", 2023-10-08T16:09:09.033 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.033 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.033 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.033 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.033 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.033 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.033 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.033 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.034 INFO:teuthology.orchestra.run.smithi133.stdout: "ALERTMANAGER_API_HOST": { 2023-10-08T16:09:09.034 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-08T16:09:09.034 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.034 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.034 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.034 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.034 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.035 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.035 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.035 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.035 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.035 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.035 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.035 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.035 INFO:teuthology.orchestra.run.smithi133.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-08T16:09:09.036 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-08T16:09:09.036 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.036 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.036 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.036 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.036 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.036 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.036 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.037 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.037 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.037 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.037 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.037 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.037 INFO:teuthology.orchestra.run.smithi133.stdout: "AUDIT_API_ENABLED": { 2023-10-08T16:09:09.037 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "AUDIT_API_ENABLED", 2023-10-08T16:09:09.038 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.038 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.038 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.038 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.038 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.038 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.038 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.038 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.039 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.039 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.039 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.039 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.039 INFO:teuthology.orchestra.run.smithi133.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-08T16:09:09.039 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-08T16:09:09.039 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.039 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.040 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.040 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.040 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.040 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.040 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.040 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.040 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.040 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.041 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.041 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.041 INFO:teuthology.orchestra.run.smithi133.stdout: "ENABLE_BROWSABLE_API": { 2023-10-08T16:09:09.041 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-08T16:09:09.041 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.041 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.041 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.041 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.042 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.042 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.042 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.042 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.042 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.042 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.042 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.043 INFO:teuthology.orchestra.run.smithi133.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-08T16:09:09.043 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-08T16:09:09.043 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.043 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.043 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.043 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.044 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.044 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.044 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.044 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.044 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.044 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.044 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.045 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.045 INFO:teuthology.orchestra.run.smithi133.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-08T16:09:09.045 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-08T16:09:09.045 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.045 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.045 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.045 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.045 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.046 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.046 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.046 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.046 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.046 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.046 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.046 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.047 INFO:teuthology.orchestra.run.smithi133.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-08T16:09:09.047 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-08T16:09:09.047 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.047 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.047 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.047 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.047 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.047 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.048 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.048 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.048 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.048 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.048 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.048 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.048 INFO:teuthology.orchestra.run.smithi133.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-08T16:09:09.049 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-08T16:09:09.049 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.049 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.049 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.049 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.049 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.049 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.049 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.050 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.050 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.050 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.050 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.050 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.050 INFO:teuthology.orchestra.run.smithi133.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-08T16:09:09.050 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-08T16:09:09.051 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.051 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.051 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.051 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.051 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.051 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.051 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.051 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.052 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.052 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.052 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.052 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.052 INFO:teuthology.orchestra.run.smithi133.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-08T16:09:09.052 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-08T16:09:09.052 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.052 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.053 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.053 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.053 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.053 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.053 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.053 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.053 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.054 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.054 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.054 INFO:teuthology.orchestra.run.smithi133.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-08T16:09:09.054 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-08T16:09:09.054 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.054 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.054 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.055 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.055 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.055 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.055 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.055 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.055 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.055 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.055 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.056 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.056 INFO:teuthology.orchestra.run.smithi133.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-08T16:09:09.056 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-08T16:09:09.056 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.056 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.056 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.056 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.057 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.057 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.057 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.057 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.057 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.057 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.057 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.058 INFO:teuthology.orchestra.run.smithi133.stdout: "GRAFANA_API_PASSWORD": { 2023-10-08T16:09:09.058 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-08T16:09:09.058 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.058 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.058 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.058 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "admin", 2023-10-08T16:09:09.058 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.058 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.059 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.059 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.059 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.059 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.059 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.059 INFO:teuthology.orchestra.run.smithi133.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-08T16:09:09.059 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-08T16:09:09.060 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.060 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.060 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.060 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.060 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.060 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.060 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.061 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.061 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.061 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.061 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.061 INFO:teuthology.orchestra.run.smithi133.stdout: "GRAFANA_API_URL": { 2023-10-08T16:09:09.061 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "GRAFANA_API_URL", 2023-10-08T16:09:09.061 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.062 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.062 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.062 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.062 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.062 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.062 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.062 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.062 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.063 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.063 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.063 INFO:teuthology.orchestra.run.smithi133.stdout: "GRAFANA_API_USERNAME": { 2023-10-08T16:09:09.063 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-08T16:09:09.063 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.063 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.063 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.064 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "admin", 2023-10-08T16:09:09.064 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.064 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.064 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.064 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.064 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.064 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.064 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.065 INFO:teuthology.orchestra.run.smithi133.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-08T16:09:09.065 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-08T16:09:09.065 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.065 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.065 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.065 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.066 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.066 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.066 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.066 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.066 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.066 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.066 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.067 INFO:teuthology.orchestra.run.smithi133.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-08T16:09:09.067 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-08T16:09:09.067 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.067 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.067 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.067 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.067 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.068 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.068 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.068 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.068 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.068 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.068 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.068 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.068 INFO:teuthology.orchestra.run.smithi133.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-08T16:09:09.069 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-08T16:09:09.069 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.069 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.069 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.069 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.069 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.069 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.069 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.070 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.070 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.070 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.070 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.070 INFO:teuthology.orchestra.run.smithi133.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-08T16:09:09.070 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-08T16:09:09.070 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.071 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.071 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.071 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.071 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.071 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.071 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.071 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.072 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.072 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.072 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.072 INFO:teuthology.orchestra.run.smithi133.stdout: "PROMETHEUS_API_HOST": { 2023-10-08T16:09:09.072 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-08T16:09:09.072 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.072 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.073 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.073 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.073 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.073 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.073 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.073 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.073 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.073 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.074 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.074 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.074 INFO:teuthology.orchestra.run.smithi133.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-08T16:09:09.074 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-08T16:09:09.074 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.074 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.074 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.074 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.075 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.075 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.075 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.075 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.075 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.075 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.075 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.076 INFO:teuthology.orchestra.run.smithi133.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-08T16:09:09.076 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-08T16:09:09.076 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.076 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.076 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.076 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.076 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.077 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.077 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.077 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.077 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.077 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.077 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.077 INFO:teuthology.orchestra.run.smithi133.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-08T16:09:09.078 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-08T16:09:09.078 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.078 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.078 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.078 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.078 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.078 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.079 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.079 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.079 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.079 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.079 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.079 INFO:teuthology.orchestra.run.smithi133.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-08T16:09:09.079 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-08T16:09:09.080 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.080 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.080 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.080 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.080 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.080 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.080 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.081 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.081 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.081 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.081 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.081 INFO:teuthology.orchestra.run.smithi133.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-08T16:09:09.081 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-08T16:09:09.081 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.082 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.082 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.082 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.082 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.082 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.082 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.082 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.083 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.083 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.083 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.083 INFO:teuthology.orchestra.run.smithi133.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-08T16:09:09.083 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-08T16:09:09.083 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.083 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.084 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.084 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.084 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.084 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.084 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.084 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.084 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.084 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.085 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.085 INFO:teuthology.orchestra.run.smithi133.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-08T16:09:09.085 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-08T16:09:09.085 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.085 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.085 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.086 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.086 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.086 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.086 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.086 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.086 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.086 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.086 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.087 INFO:teuthology.orchestra.run.smithi133.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-08T16:09:09.087 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-08T16:09:09.087 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.087 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.087 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.087 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.087 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.088 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.088 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.088 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.088 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.088 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.088 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.088 INFO:teuthology.orchestra.run.smithi133.stdout: "PWD_POLICY_ENABLED": { 2023-10-08T16:09:09.089 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-08T16:09:09.089 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.089 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.089 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.089 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.089 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.089 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.090 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.090 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.090 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.090 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.090 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.090 INFO:teuthology.orchestra.run.smithi133.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-08T16:09:09.090 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-08T16:09:09.091 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.091 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.091 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.091 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-08T16:09:09.091 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.091 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.091 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.092 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.092 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.092 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.092 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.092 INFO:teuthology.orchestra.run.smithi133.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-08T16:09:09.092 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-08T16:09:09.092 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.093 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.093 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.093 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "10", 2023-10-08T16:09:09.093 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.093 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.093 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.093 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.094 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.094 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.094 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.094 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.094 INFO:teuthology.orchestra.run.smithi133.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-08T16:09:09.094 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-08T16:09:09.094 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.094 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.095 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.095 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "8", 2023-10-08T16:09:09.095 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.095 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.095 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.095 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.095 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.095 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.096 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.096 INFO:teuthology.orchestra.run.smithi133.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-08T16:09:09.096 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-08T16:09:09.096 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.096 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.096 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.097 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "45", 2023-10-08T16:09:09.097 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.097 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.097 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.097 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.097 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.097 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.097 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.098 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.098 INFO:teuthology.orchestra.run.smithi133.stdout: "RGW_API_ACCESS_KEY": { 2023-10-08T16:09:09.098 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-08T16:09:09.098 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.098 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.098 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.098 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.098 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.099 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.099 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.099 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.099 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.099 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.099 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.100 INFO:teuthology.orchestra.run.smithi133.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-08T16:09:09.100 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-08T16:09:09.100 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.100 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.100 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.100 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "admin", 2023-10-08T16:09:09.100 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.100 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.101 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.101 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.101 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.101 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.101 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.101 INFO:teuthology.orchestra.run.smithi133.stdout: "RGW_API_SECRET_KEY": { 2023-10-08T16:09:09.101 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-08T16:09:09.102 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.102 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.102 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.102 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.102 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.102 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.102 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.102 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.103 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.103 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.103 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.103 INFO:teuthology.orchestra.run.smithi133.stdout: "RGW_API_SSL_VERIFY": { 2023-10-08T16:09:09.103 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-08T16:09:09.103 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.104 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.104 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.104 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.104 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.104 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.104 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.104 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.104 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.105 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.105 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.105 INFO:teuthology.orchestra.run.smithi133.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-08T16:09:09.105 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-08T16:09:09.105 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.105 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.105 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.106 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "0", 2023-10-08T16:09:09.106 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.106 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.106 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.106 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.106 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.106 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.106 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.107 INFO:teuthology.orchestra.run.smithi133.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-08T16:09:09.107 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-08T16:09:09.107 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.107 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.107 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.107 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "10", 2023-10-08T16:09:09.107 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.108 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.108 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.108 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.108 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.108 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.108 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.108 INFO:teuthology.orchestra.run.smithi133.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-08T16:09:09.109 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-08T16:09:09.109 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.109 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.109 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.109 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "5", 2023-10-08T16:09:09.109 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.109 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.110 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.110 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.110 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.110 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.110 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.110 INFO:teuthology.orchestra.run.smithi133.stdout: "cross_origin_url": { 2023-10-08T16:09:09.110 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "cross_origin_url", 2023-10-08T16:09:09.111 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.111 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.111 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.111 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.111 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.111 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.111 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.111 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.112 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.112 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.112 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.112 INFO:teuthology.orchestra.run.smithi133.stdout: "crt_file": { 2023-10-08T16:09:09.112 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "crt_file", 2023-10-08T16:09:09.112 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.112 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.113 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.113 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.113 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.113 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.113 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.113 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.113 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.113 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.114 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.114 INFO:teuthology.orchestra.run.smithi133.stdout: "debug": { 2023-10-08T16:09:09.114 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "debug", 2023-10-08T16:09:09.114 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.114 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.114 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.114 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.115 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.115 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.115 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.115 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Enable/disable debug options", 2023-10-08T16:09:09.115 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.115 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.115 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.116 INFO:teuthology.orchestra.run.smithi133.stdout: "jwt_token_ttl": { 2023-10-08T16:09:09.116 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "jwt_token_ttl", 2023-10-08T16:09:09.116 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.116 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.116 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.116 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "28800", 2023-10-08T16:09:09.116 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.117 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.117 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.117 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.117 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.117 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.117 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.118 INFO:teuthology.orchestra.run.smithi133.stdout: "key_file": { 2023-10-08T16:09:09.118 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "key_file", 2023-10-08T16:09:09.118 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.118 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.118 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.118 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.118 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.118 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.119 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.119 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.119 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.119 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.119 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.119 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.119 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.120 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.120 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.120 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.120 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.120 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.120 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.120 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.120 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.121 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.121 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.121 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.121 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.121 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.121 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.121 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.121 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.122 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.122 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.122 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.122 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.122 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.122 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.122 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.123 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.123 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.123 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.123 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.123 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.123 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.123 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.123 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.124 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.124 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.124 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.124 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.124 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.124 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.124 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.125 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.125 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.125 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.125 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.125 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.125 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.125 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.125 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.126 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.126 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.126 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.126 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.126 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.126 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.127 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.127 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.127 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.127 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.127 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.127 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.127 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.127 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.128 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.128 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.128 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.128 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.128 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.128 INFO:teuthology.orchestra.run.smithi133.stdout: "motd": { 2023-10-08T16:09:09.128 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "motd", 2023-10-08T16:09:09.129 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.129 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.129 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.129 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.129 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.129 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.129 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.129 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "The message of the day", 2023-10-08T16:09:09.130 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.130 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.130 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.130 INFO:teuthology.orchestra.run.smithi133.stdout: "redirect_resolve_ip_addr": { 2023-10-08T16:09:09.130 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "redirect_resolve_ip_addr", 2023-10-08T16:09:09.130 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.131 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.131 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.131 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.131 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.131 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.131 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.131 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.131 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.132 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.132 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.132 INFO:teuthology.orchestra.run.smithi133.stdout: "server_addr": { 2023-10-08T16:09:09.132 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "server_addr", 2023-10-08T16:09:09.132 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.132 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.132 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.133 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "::", 2023-10-08T16:09:09.133 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.133 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.133 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.133 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.133 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.133 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.133 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.134 INFO:teuthology.orchestra.run.smithi133.stdout: "server_port": { 2023-10-08T16:09:09.134 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "server_port", 2023-10-08T16:09:09.134 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.134 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.134 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.134 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "8080", 2023-10-08T16:09:09.134 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.135 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.135 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.135 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.135 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.135 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.135 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.136 INFO:teuthology.orchestra.run.smithi133.stdout: "ssl": { 2023-10-08T16:09:09.136 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "ssl", 2023-10-08T16:09:09.136 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.136 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.136 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.136 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.136 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.136 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.137 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.137 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.137 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.137 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.137 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.137 INFO:teuthology.orchestra.run.smithi133.stdout: "ssl_server_port": { 2023-10-08T16:09:09.137 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "ssl_server_port", 2023-10-08T16:09:09.138 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.138 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.138 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.138 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "8443", 2023-10-08T16:09:09.138 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.138 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.138 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.138 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.139 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.139 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.139 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.139 INFO:teuthology.orchestra.run.smithi133.stdout: "standby_behaviour": { 2023-10-08T16:09:09.139 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "standby_behaviour", 2023-10-08T16:09:09.139 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.140 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.140 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.140 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "redirect", 2023-10-08T16:09:09.140 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.140 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.140 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.140 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.141 INFO:teuthology.orchestra.run.smithi133.stdout: "redirect" 2023-10-08T16:09:09.141 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.141 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.141 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.141 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.141 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.141 INFO:teuthology.orchestra.run.smithi133.stdout: "standby_error_status_code": { 2023-10-08T16:09:09.142 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "standby_error_status_code", 2023-10-08T16:09:09.142 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.142 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.142 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.142 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "500", 2023-10-08T16:09:09.142 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "400", 2023-10-08T16:09:09.142 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "599", 2023-10-08T16:09:09.143 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.143 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.143 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.143 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.143 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.143 INFO:teuthology.orchestra.run.smithi133.stdout: "url_prefix": { 2023-10-08T16:09:09.143 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "url_prefix", 2023-10-08T16:09:09.144 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.144 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.144 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.144 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.144 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.144 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.144 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.144 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.145 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.145 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.145 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.145 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.145 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.145 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "devicehealth", 2023-10-08T16:09:09.146 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.146 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.146 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.146 INFO:teuthology.orchestra.run.smithi133.stdout: "enable_monitoring": { 2023-10-08T16:09:09.146 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "enable_monitoring", 2023-10-08T16:09:09.146 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.146 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.147 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.147 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.147 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.147 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.147 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.147 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "monitor device health metrics", 2023-10-08T16:09:09.147 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.147 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.148 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.148 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.148 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.148 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.148 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.148 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.148 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.149 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.149 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.149 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.149 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.149 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.149 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.149 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.149 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.150 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.150 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.150 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.150 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.150 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.150 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.151 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.151 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.151 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.151 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.151 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.151 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.151 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.151 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.152 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.152 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.152 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.152 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.152 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.152 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.152 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.153 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.153 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.153 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.153 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.153 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.153 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.153 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.153 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.154 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.154 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.154 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.154 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.154 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.154 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.154 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.154 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.155 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.155 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.155 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.155 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.155 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.155 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.155 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.156 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.156 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.156 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.156 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.156 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.156 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.156 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.156 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.157 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.157 INFO:teuthology.orchestra.run.smithi133.stdout: "mark_out_threshold": { 2023-10-08T16:09:09.157 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "mark_out_threshold", 2023-10-08T16:09:09.157 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.157 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.157 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.158 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "2419200", 2023-10-08T16:09:09.158 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.158 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.158 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.158 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-08T16:09:09.158 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.158 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.158 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.159 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": { 2023-10-08T16:09:09.159 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "pool_name", 2023-10-08T16:09:09.159 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.159 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.159 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.159 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "device_health_metrics", 2023-10-08T16:09:09.159 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.160 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.160 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.160 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-08T16:09:09.160 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.160 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.160 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.161 INFO:teuthology.orchestra.run.smithi133.stdout: "retention_period": { 2023-10-08T16:09:09.161 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "retention_period", 2023-10-08T16:09:09.161 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.161 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.161 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.161 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "15552000", 2023-10-08T16:09:09.161 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.161 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.162 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.162 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "how long to retain device health metrics", 2023-10-08T16:09:09.162 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.162 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.162 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.162 INFO:teuthology.orchestra.run.smithi133.stdout: "scrape_frequency": { 2023-10-08T16:09:09.162 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "scrape_frequency", 2023-10-08T16:09:09.163 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.163 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.163 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.163 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "86400", 2023-10-08T16:09:09.163 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.163 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.163 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.163 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-08T16:09:09.164 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.164 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.164 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.164 INFO:teuthology.orchestra.run.smithi133.stdout: "self_heal": { 2023-10-08T16:09:09.164 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "self_heal", 2023-10-08T16:09:09.164 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.165 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.165 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.165 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.165 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.165 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.165 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.165 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-08T16:09:09.165 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.166 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.166 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.166 INFO:teuthology.orchestra.run.smithi133.stdout: "sleep_interval": { 2023-10-08T16:09:09.166 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "sleep_interval", 2023-10-08T16:09:09.166 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.166 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.167 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.167 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "600", 2023-10-08T16:09:09.167 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.167 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.167 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.167 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "how frequently to wake up and check device health", 2023-10-08T16:09:09.167 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.167 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.168 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.168 INFO:teuthology.orchestra.run.smithi133.stdout: "warn_threshold": { 2023-10-08T16:09:09.168 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "warn_threshold", 2023-10-08T16:09:09.168 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.168 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.168 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.168 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "7257600", 2023-10-08T16:09:09.169 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.169 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.169 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.169 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-08T16:09:09.169 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.169 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.169 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.170 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.170 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.170 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "influx", 2023-10-08T16:09:09.170 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": false, 2023-10-08T16:09:09.170 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "influxdb python module not found", 2023-10-08T16:09:09.170 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.171 INFO:teuthology.orchestra.run.smithi133.stdout: "batch_size": { 2023-10-08T16:09:09.171 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "batch_size", 2023-10-08T16:09:09.171 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.171 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.171 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.171 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "5000", 2023-10-08T16:09:09.171 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.171 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.172 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.172 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-08T16:09:09.172 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.172 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.172 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.172 INFO:teuthology.orchestra.run.smithi133.stdout: "database": { 2023-10-08T16:09:09.172 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "database", 2023-10-08T16:09:09.173 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.173 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.173 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.173 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "ceph", 2023-10-08T16:09:09.173 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.173 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.173 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.174 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-08T16:09:09.174 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.174 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.174 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.174 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.174 INFO:teuthology.orchestra.run.smithi133.stdout: "hostname": { 2023-10-08T16:09:09.174 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "hostname", 2023-10-08T16:09:09.174 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.175 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.175 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.175 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.175 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.175 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.175 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.175 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "InfluxDB server hostname", 2023-10-08T16:09:09.175 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.176 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.176 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.176 INFO:teuthology.orchestra.run.smithi133.stdout: "interval": { 2023-10-08T16:09:09.176 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "interval", 2023-10-08T16:09:09.176 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.176 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.176 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.177 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "30", 2023-10-08T16:09:09.177 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "5", 2023-10-08T16:09:09.177 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.177 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.177 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-08T16:09:09.177 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.177 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.177 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.178 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.178 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.178 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.178 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.178 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.178 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.178 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.179 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.179 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.179 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.179 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.179 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.179 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.179 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.179 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.180 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.180 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.180 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.180 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.180 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.180 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.181 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.181 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.181 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.181 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.181 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.181 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.181 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.181 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.182 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.182 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.182 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.182 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.182 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.182 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.182 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.183 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.183 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.183 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.183 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.183 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.183 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.183 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.184 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.184 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.184 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.184 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.184 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.184 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.184 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.184 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.185 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.185 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.185 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.185 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.185 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.185 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.185 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.186 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.186 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.186 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.186 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.186 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.186 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.186 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.186 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.187 INFO:teuthology.orchestra.run.smithi133.stdout: "password": { 2023-10-08T16:09:09.187 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "password", 2023-10-08T16:09:09.187 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.187 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.187 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.187 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.188 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.188 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.188 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.188 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "password of InfluxDB server user", 2023-10-08T16:09:09.188 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.188 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.188 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.189 INFO:teuthology.orchestra.run.smithi133.stdout: "port": { 2023-10-08T16:09:09.189 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "port", 2023-10-08T16:09:09.189 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.189 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.189 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.189 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "8086", 2023-10-08T16:09:09.189 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.189 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.190 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.190 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "InfluxDB server port", 2023-10-08T16:09:09.190 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.190 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.190 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.190 INFO:teuthology.orchestra.run.smithi133.stdout: "ssl": { 2023-10-08T16:09:09.190 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "ssl", 2023-10-08T16:09:09.191 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.191 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.191 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.191 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "false", 2023-10-08T16:09:09.191 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.191 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.191 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.191 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T16:09:09.192 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.192 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.192 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.192 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.192 INFO:teuthology.orchestra.run.smithi133.stdout: "threads": { 2023-10-08T16:09:09.192 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "threads", 2023-10-08T16:09:09.192 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.192 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.193 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.193 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "5", 2023-10-08T16:09:09.193 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "1", 2023-10-08T16:09:09.193 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "32", 2023-10-08T16:09:09.193 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.193 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-08T16:09:09.193 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.193 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.194 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.194 INFO:teuthology.orchestra.run.smithi133.stdout: "username": { 2023-10-08T16:09:09.194 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "username", 2023-10-08T16:09:09.194 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.194 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.194 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.195 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.195 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.195 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.195 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.195 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "username of InfluxDB server user", 2023-10-08T16:09:09.195 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.195 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.195 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.196 INFO:teuthology.orchestra.run.smithi133.stdout: "verify_ssl": { 2023-10-08T16:09:09.196 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "verify_ssl", 2023-10-08T16:09:09.196 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.196 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.196 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.196 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "true", 2023-10-08T16:09:09.196 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.197 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.197 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.197 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T16:09:09.197 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.197 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.197 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.197 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.197 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.198 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "insights", 2023-10-08T16:09:09.198 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.198 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.198 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.198 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.198 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.199 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.199 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.199 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.199 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.199 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.199 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.199 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.199 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.200 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.200 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.200 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.200 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.200 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.200 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.200 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.201 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.201 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.201 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.201 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.201 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.201 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.201 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.202 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.202 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.202 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.202 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.202 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.202 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.202 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.203 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.203 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.203 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.203 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.203 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.203 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.203 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.204 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.204 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.204 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.204 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.204 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.204 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.204 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.205 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.205 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.205 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.205 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.205 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.205 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.205 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.205 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.206 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.206 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.206 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.206 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.206 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.206 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.206 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.207 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.207 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.207 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.207 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.207 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.207 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.207 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.207 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.208 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "iostat", 2023-10-08T16:09:09.208 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.208 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.208 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.208 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.208 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.209 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.209 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.209 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.209 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.209 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.209 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.209 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.210 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.210 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.210 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.210 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.210 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.210 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.210 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.211 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.211 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.211 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.211 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.211 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.211 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.211 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.212 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.212 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.212 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.212 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.212 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.212 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.212 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.213 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.213 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.213 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.213 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.213 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.213 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.213 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.214 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.214 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.214 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.214 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.214 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.214 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.214 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.215 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.215 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.215 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.215 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.215 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.215 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.215 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.215 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.216 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.216 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.216 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.216 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.216 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.216 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.217 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.217 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.217 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.217 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.217 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.217 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.217 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.217 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.218 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.218 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.218 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "localpool", 2023-10-08T16:09:09.218 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.218 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.219 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.219 INFO:teuthology.orchestra.run.smithi133.stdout: "failure_domain": { 2023-10-08T16:09:09.219 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "failure_domain", 2023-10-08T16:09:09.219 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.219 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.219 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.219 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "host", 2023-10-08T16:09:09.219 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.220 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.220 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.220 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "failure domain for any created local pool", 2023-10-08T16:09:09.220 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-08T16:09:09.220 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.220 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.220 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.221 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.221 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.221 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.221 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.221 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.221 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.221 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.221 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.222 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.222 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.222 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.222 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.222 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.222 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.222 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.223 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.223 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.223 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.223 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.223 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.223 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.223 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.224 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.224 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.224 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.224 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.224 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.224 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.224 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.225 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.225 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.225 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.225 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.225 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.225 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.225 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.226 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.226 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.226 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.226 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.226 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.226 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.226 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.227 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.227 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.227 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.227 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.227 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.227 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.227 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.227 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.228 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.228 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.228 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.228 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.228 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.228 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.228 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.229 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.229 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.229 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.229 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.229 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.229 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.229 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.230 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": { 2023-10-08T16:09:09.230 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "min_size", 2023-10-08T16:09:09.230 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.230 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.230 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.230 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.230 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.231 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.231 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.231 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "default min_size for any created local pool", 2023-10-08T16:09:09.231 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-08T16:09:09.231 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.231 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.231 INFO:teuthology.orchestra.run.smithi133.stdout: "num_rep": { 2023-10-08T16:09:09.232 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "num_rep", 2023-10-08T16:09:09.232 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.232 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.232 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.232 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "3", 2023-10-08T16:09:09.232 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.232 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.232 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.233 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "default replica count for any created local pool", 2023-10-08T16:09:09.233 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.233 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.233 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.233 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": { 2023-10-08T16:09:09.233 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "pg_num", 2023-10-08T16:09:09.233 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.234 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.234 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.234 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "128", 2023-10-08T16:09:09.234 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.234 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.234 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.234 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "default pg_num for any created local pool", 2023-10-08T16:09:09.234 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.235 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.235 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.235 INFO:teuthology.orchestra.run.smithi133.stdout: "prefix": { 2023-10-08T16:09:09.235 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "prefix", 2023-10-08T16:09:09.235 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.235 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.235 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.236 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.236 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.236 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.236 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.236 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "name prefix for any created local pool", 2023-10-08T16:09:09.236 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.236 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.237 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.237 INFO:teuthology.orchestra.run.smithi133.stdout: "subtree": { 2023-10-08T16:09:09.237 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "subtree", 2023-10-08T16:09:09.237 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.237 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.237 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.237 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "rack", 2023-10-08T16:09:09.238 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.238 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.238 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.238 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-08T16:09:09.238 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-08T16:09:09.238 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.238 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.239 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.239 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.239 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "mirroring", 2023-10-08T16:09:09.239 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.239 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.239 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.240 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.240 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.240 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.240 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.240 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.240 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.240 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.240 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.241 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.241 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.241 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.241 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.241 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.241 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.241 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.241 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.242 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.242 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.242 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.242 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.242 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.242 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.242 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.243 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.243 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.243 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.243 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.243 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.243 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.243 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.243 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.244 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.244 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.244 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.244 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.244 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.244 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.244 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.245 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.245 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.245 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.245 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.245 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.245 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.245 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.245 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.246 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.246 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.246 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.246 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.246 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.246 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.246 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.247 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.247 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.247 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.247 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.247 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.247 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.247 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.248 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.248 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.248 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.248 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.248 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.248 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.248 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.248 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.249 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "nfs", 2023-10-08T16:09:09.249 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.249 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.249 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.249 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.249 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.250 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.250 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.250 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.250 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.250 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.250 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.250 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.250 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.251 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.251 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.251 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.251 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.251 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.251 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.251 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.252 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.252 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.252 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.252 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.252 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.252 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.252 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.253 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.253 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.253 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.253 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.253 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.253 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.253 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.254 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.254 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.254 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.254 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.254 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.254 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.254 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.255 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.255 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.255 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.255 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.255 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.255 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.255 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.255 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.256 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.256 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.256 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.256 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.256 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.256 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.256 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.257 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.257 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.257 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.257 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.257 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.257 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.257 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.257 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.258 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.258 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.258 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.258 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.258 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.258 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.258 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.258 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.259 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.259 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.259 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "orchestrator", 2023-10-08T16:09:09.259 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.259 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.259 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.259 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.259 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.260 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.260 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.260 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.260 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.260 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.260 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.260 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.260 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.261 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.261 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.261 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.261 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.261 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.261 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.261 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.262 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.262 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.262 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.262 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.262 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.262 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.262 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.263 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.263 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.263 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.263 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.263 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.263 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.263 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.263 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.264 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.264 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.264 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.264 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.264 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.264 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.264 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.265 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.265 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.265 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.265 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.265 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.265 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.265 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.265 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.266 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.266 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.266 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.266 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.266 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.266 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.266 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.266 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.267 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.267 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.267 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.267 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.267 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.267 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.267 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.268 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.268 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.268 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.268 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.268 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.268 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.268 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.269 INFO:teuthology.orchestra.run.smithi133.stdout: "orchestrator": { 2023-10-08T16:09:09.269 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "orchestrator", 2023-10-08T16:09:09.269 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.269 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.269 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.269 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.269 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.269 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.270 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.270 INFO:teuthology.orchestra.run.smithi133.stdout: "cephadm", 2023-10-08T16:09:09.270 INFO:teuthology.orchestra.run.smithi133.stdout: "rook", 2023-10-08T16:09:09.270 INFO:teuthology.orchestra.run.smithi133.stdout: "test_orchestrator" 2023-10-08T16:09:09.270 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.270 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Orchestrator backend", 2023-10-08T16:09:09.270 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.270 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.271 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.271 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.271 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.271 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.271 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.271 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "osd_perf_query", 2023-10-08T16:09:09.271 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.272 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.272 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.272 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.272 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.272 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.272 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.272 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.272 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.273 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.273 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.273 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.273 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.273 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.273 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.273 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.273 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.274 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.274 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.274 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.274 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.274 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.274 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.274 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.274 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.275 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.275 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.275 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.275 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.275 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.275 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.275 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.276 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.276 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.276 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.276 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.276 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.276 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.276 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.276 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.277 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.277 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.277 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.277 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.277 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.277 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.277 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.277 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.278 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.278 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.278 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.278 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.278 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.278 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.278 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.279 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.279 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.279 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.279 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.279 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.279 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.279 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.279 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.280 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.280 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.280 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.280 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.280 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.280 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.280 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.280 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.281 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.281 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.281 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.281 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.281 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.281 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "osd_support", 2023-10-08T16:09:09.281 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.282 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.282 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.282 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.282 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.282 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.282 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.282 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.282 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.283 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.283 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.283 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.283 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.283 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.283 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.283 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.283 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.284 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.284 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.284 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.284 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.284 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.284 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.284 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.284 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.285 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.285 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.285 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.285 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.285 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.285 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.285 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.286 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.286 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.286 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.286 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.286 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.286 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.286 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.286 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.287 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.287 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.287 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.287 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.287 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.287 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.287 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.287 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.288 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.288 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.288 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.288 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.288 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.288 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.288 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.289 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.289 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.289 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.289 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.289 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.289 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.289 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.289 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.290 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.290 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.290 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.290 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.290 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.290 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.290 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.290 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.291 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.291 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.291 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.291 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.291 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.291 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "pg_autoscaler", 2023-10-08T16:09:09.291 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.291 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.292 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.292 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.292 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.292 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.292 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.292 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.292 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.292 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.293 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.293 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.293 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.293 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.293 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.293 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.293 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.294 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.294 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.294 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.294 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.294 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.295 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.295 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.295 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.295 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.295 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.295 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.295 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.295 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.296 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.296 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.296 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.296 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.296 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.296 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.296 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.296 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.297 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.297 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.297 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.297 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.297 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.297 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.297 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.297 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.298 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.298 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.298 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.298 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.298 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.298 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.298 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.299 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.299 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.299 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.299 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.299 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.299 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.299 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.299 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.300 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.300 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.300 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.300 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.300 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.300 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.300 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.300 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.301 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.301 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.301 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.301 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.301 INFO:teuthology.orchestra.run.smithi133.stdout: "sleep_interval": { 2023-10-08T16:09:09.301 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "sleep_interval", 2023-10-08T16:09:09.301 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.301 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.302 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.302 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "60", 2023-10-08T16:09:09.302 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.302 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.302 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.302 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.302 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.303 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.303 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.303 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.303 INFO:teuthology.orchestra.run.smithi133.stdout: "threshold": { 2023-10-08T16:09:09.303 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "threshold", 2023-10-08T16:09:09.303 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "float", 2023-10-08T16:09:09.303 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.303 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.304 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "3.0", 2023-10-08T16:09:09.304 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "1.0", 2023-10-08T16:09:09.304 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.304 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.304 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "scaling threshold", 2023-10-08T16:09:09.304 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-08T16:09:09.304 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.304 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.305 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.305 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.305 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.305 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.305 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "progress", 2023-10-08T16:09:09.305 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.305 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.305 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.306 INFO:teuthology.orchestra.run.smithi133.stdout: "allow_pg_recovery_event": { 2023-10-08T16:09:09.306 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "allow_pg_recovery_event", 2023-10-08T16:09:09.306 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.306 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.306 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.306 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.306 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.307 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.307 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.307 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-08T16:09:09.307 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.307 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.307 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.307 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.307 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": { 2023-10-08T16:09:09.308 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "enabled", 2023-10-08T16:09:09.308 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.308 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.308 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.308 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.308 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.308 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.308 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.309 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.309 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.309 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.309 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.309 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.309 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.309 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.309 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.310 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.310 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.310 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.310 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.310 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.310 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.310 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.311 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.311 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.311 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.311 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.311 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.311 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.311 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.311 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.312 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.312 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.312 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.312 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.312 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.312 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.312 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.312 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.313 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.313 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.313 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.313 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.313 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.313 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.313 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.313 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.314 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.314 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.314 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.314 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.314 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.314 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.314 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.315 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.315 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.315 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.315 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.315 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.315 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.315 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.315 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.316 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.316 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.316 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.316 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.316 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.316 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.316 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.316 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.317 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.317 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.317 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.317 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.317 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.317 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.317 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.317 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.318 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.318 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.318 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.318 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.318 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.318 INFO:teuthology.orchestra.run.smithi133.stdout: "max_completed_events": { 2023-10-08T16:09:09.318 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "max_completed_events", 2023-10-08T16:09:09.318 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.319 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.319 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.319 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "50", 2023-10-08T16:09:09.319 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.319 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.319 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.319 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "number of past completed events to remember", 2023-10-08T16:09:09.320 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.320 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.320 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.320 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.320 INFO:teuthology.orchestra.run.smithi133.stdout: "sleep_interval": { 2023-10-08T16:09:09.320 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "sleep_interval", 2023-10-08T16:09:09.320 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.320 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.321 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.321 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "5", 2023-10-08T16:09:09.321 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.321 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.321 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.321 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "how long the module is going to sleep", 2023-10-08T16:09:09.321 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.321 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.322 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.322 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.322 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.322 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.322 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.322 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "prometheus", 2023-10-08T16:09:09.322 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.322 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.323 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.323 INFO:teuthology.orchestra.run.smithi133.stdout: "cache": { 2023-10-08T16:09:09.323 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "cache", 2023-10-08T16:09:09.323 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.323 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.323 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.323 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.323 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.324 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.324 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.324 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.324 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.324 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.324 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.324 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.325 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.325 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.325 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.325 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.325 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.325 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.325 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.325 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.326 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.326 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.326 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.326 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.326 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.326 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.326 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.326 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.327 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.327 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.327 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.327 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.327 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.327 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.327 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.328 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.328 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.328 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.328 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.328 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.328 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.328 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.328 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.329 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.329 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.329 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.329 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.329 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.329 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.329 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.329 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.330 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.330 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.330 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.330 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.330 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.330 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.330 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.330 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.331 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.331 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.331 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.331 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.331 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.331 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.331 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.332 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.332 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.332 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.332 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.332 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.332 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.332 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.332 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.333 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.333 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.333 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.333 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.333 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.333 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.333 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.333 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.334 INFO:teuthology.orchestra.run.smithi133.stdout: "rbd_stats_pools": { 2023-10-08T16:09:09.334 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "rbd_stats_pools", 2023-10-08T16:09:09.334 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.334 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.334 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.334 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.334 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.334 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.335 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.335 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.335 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.335 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.335 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.335 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.335 INFO:teuthology.orchestra.run.smithi133.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-08T16:09:09.335 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-08T16:09:09.336 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.336 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.336 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.336 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "300", 2023-10-08T16:09:09.336 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.336 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.336 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.337 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.337 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.337 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.337 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.337 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.337 INFO:teuthology.orchestra.run.smithi133.stdout: "scrape_interval": { 2023-10-08T16:09:09.337 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "scrape_interval", 2023-10-08T16:09:09.337 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "float", 2023-10-08T16:09:09.338 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.338 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.338 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "15.0", 2023-10-08T16:09:09.338 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.338 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.338 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.338 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.338 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.339 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.339 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.339 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.339 INFO:teuthology.orchestra.run.smithi133.stdout: "server_addr": { 2023-10-08T16:09:09.339 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "server_addr", 2023-10-08T16:09:09.339 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.339 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.339 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.340 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "::", 2023-10-08T16:09:09.340 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.340 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.340 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.340 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-08T16:09:09.340 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.340 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.341 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.341 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.341 INFO:teuthology.orchestra.run.smithi133.stdout: "server_port": { 2023-10-08T16:09:09.341 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "server_port", 2023-10-08T16:09:09.341 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.341 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.341 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.341 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "9283", 2023-10-08T16:09:09.342 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.342 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.342 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.342 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-08T16:09:09.342 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.342 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.342 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.343 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.343 INFO:teuthology.orchestra.run.smithi133.stdout: "stale_cache_strategy": { 2023-10-08T16:09:09.343 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "stale_cache_strategy", 2023-10-08T16:09:09.343 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.343 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.343 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.343 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "log", 2023-10-08T16:09:09.343 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.344 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.344 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.344 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.344 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.344 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.344 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.344 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.344 INFO:teuthology.orchestra.run.smithi133.stdout: "standby_behaviour": { 2023-10-08T16:09:09.345 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "standby_behaviour", 2023-10-08T16:09:09.345 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.345 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.345 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.345 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "default", 2023-10-08T16:09:09.345 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.345 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.346 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.346 INFO:teuthology.orchestra.run.smithi133.stdout: "default", 2023-10-08T16:09:09.346 INFO:teuthology.orchestra.run.smithi133.stdout: "error" 2023-10-08T16:09:09.346 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.346 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.346 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.346 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.346 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.347 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.347 INFO:teuthology.orchestra.run.smithi133.stdout: "standby_error_status_code": { 2023-10-08T16:09:09.347 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "standby_error_status_code", 2023-10-08T16:09:09.347 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.347 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.347 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.347 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "500", 2023-10-08T16:09:09.347 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "400", 2023-10-08T16:09:09.348 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "599", 2023-10-08T16:09:09.348 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.348 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.348 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.348 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.348 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.348 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.348 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.349 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.349 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.349 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "rbd_support", 2023-10-08T16:09:09.349 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.349 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.349 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.349 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.349 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.350 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.350 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.350 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.350 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.350 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.350 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.350 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.351 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.351 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.351 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.351 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.351 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.351 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.351 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.351 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.352 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.352 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.352 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.352 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.352 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.352 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.352 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.352 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.353 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.353 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.353 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.353 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.353 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.353 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.353 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.353 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.354 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.354 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.354 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.354 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.354 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.354 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.354 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.354 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.355 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.355 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.355 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.355 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.355 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.355 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.355 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.355 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.356 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.356 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.356 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.356 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.356 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.356 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.356 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.357 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.357 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.357 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.357 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.357 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.357 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.357 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.357 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.358 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.358 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.358 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.358 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.358 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.358 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.358 INFO:teuthology.orchestra.run.smithi133.stdout: "max_concurrent_snap_create": { 2023-10-08T16:09:09.358 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "max_concurrent_snap_create", 2023-10-08T16:09:09.359 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.359 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.359 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.359 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "10", 2023-10-08T16:09:09.359 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.359 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.359 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.359 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.360 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.360 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.360 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.360 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.360 INFO:teuthology.orchestra.run.smithi133.stdout: "mirror_snapshot_schedule": { 2023-10-08T16:09:09.360 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "mirror_snapshot_schedule", 2023-10-08T16:09:09.360 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.360 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.361 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.361 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.361 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.361 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.361 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.361 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.361 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.362 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.362 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.362 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.362 INFO:teuthology.orchestra.run.smithi133.stdout: "trash_purge_schedule": { 2023-10-08T16:09:09.362 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "trash_purge_schedule", 2023-10-08T16:09:09.362 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.362 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.362 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.363 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.363 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.363 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.363 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.363 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.363 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.363 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.364 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.364 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.364 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.364 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.364 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.364 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "restful", 2023-10-08T16:09:09.365 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.365 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.365 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.365 INFO:teuthology.orchestra.run.smithi133.stdout: "enable_auth": { 2023-10-08T16:09:09.365 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "enable_auth", 2023-10-08T16:09:09.365 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.365 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.365 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.366 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.366 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.366 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.366 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.366 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.366 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.366 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.367 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.367 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.367 INFO:teuthology.orchestra.run.smithi133.stdout: "key_file": { 2023-10-08T16:09:09.367 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "key_file", 2023-10-08T16:09:09.367 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.367 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.367 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.367 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.368 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.368 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.368 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.368 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.368 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.368 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.368 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.368 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.369 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.369 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.369 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.369 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.369 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.369 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.369 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.369 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.370 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.370 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.370 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.370 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.370 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.370 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.370 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.370 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.371 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.371 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.371 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.371 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.371 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.371 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.371 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.372 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.372 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.372 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.372 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.372 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.372 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.372 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.372 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.373 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.373 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.373 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.373 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.373 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.373 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.373 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.374 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.374 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.374 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.374 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.374 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.374 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.374 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.374 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.375 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.375 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.375 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.375 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.375 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.375 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.375 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.375 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.376 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.376 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.376 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.376 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.376 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.376 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.376 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.376 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.377 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.377 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.377 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.377 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.377 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.377 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.377 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.377 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.378 INFO:teuthology.orchestra.run.smithi133.stdout: "server_addr": { 2023-10-08T16:09:09.378 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "server_addr", 2023-10-08T16:09:09.378 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.378 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.378 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.378 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.378 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.379 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.379 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.379 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.379 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.379 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.379 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.379 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.380 INFO:teuthology.orchestra.run.smithi133.stdout: "server_port": { 2023-10-08T16:09:09.380 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "server_port", 2023-10-08T16:09:09.380 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.380 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.380 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.380 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.380 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.380 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.381 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.381 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.381 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.381 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.381 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.381 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.381 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.381 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.382 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.382 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "selftest", 2023-10-08T16:09:09.382 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.382 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.382 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.382 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.382 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.383 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.383 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.383 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.383 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.383 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.383 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.383 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.383 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.384 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.384 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.384 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.384 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.384 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.384 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.384 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.384 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.385 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.385 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.385 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.385 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.385 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.385 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.385 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.385 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.386 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.386 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.386 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.386 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.386 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.386 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.386 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.386 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.387 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.387 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.387 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.387 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.387 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.387 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.387 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.388 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.388 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.388 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.388 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.388 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.388 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.388 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.388 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.389 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.389 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.389 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.389 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.389 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.389 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.389 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.390 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.390 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.390 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.390 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.390 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.390 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.390 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.390 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.391 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.391 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.391 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.391 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.391 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.391 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.391 INFO:teuthology.orchestra.run.smithi133.stdout: "roption1": { 2023-10-08T16:09:09.392 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "roption1", 2023-10-08T16:09:09.392 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.392 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.392 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.392 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.392 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.392 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.392 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.393 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.393 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.393 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.393 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.393 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.393 INFO:teuthology.orchestra.run.smithi133.stdout: "roption2": { 2023-10-08T16:09:09.393 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "roption2", 2023-10-08T16:09:09.394 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.394 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.394 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.394 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "xyz", 2023-10-08T16:09:09.394 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.394 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.394 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.394 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.395 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.395 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.395 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.395 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.395 INFO:teuthology.orchestra.run.smithi133.stdout: "rwoption1": { 2023-10-08T16:09:09.395 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "rwoption1", 2023-10-08T16:09:09.395 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.395 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.396 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.396 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.396 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.396 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.396 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.396 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.396 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.397 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.397 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.397 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.397 INFO:teuthology.orchestra.run.smithi133.stdout: "rwoption2": { 2023-10-08T16:09:09.397 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "rwoption2", 2023-10-08T16:09:09.397 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.397 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.397 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.398 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.398 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.398 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.398 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.398 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.398 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.398 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.398 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.399 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.399 INFO:teuthology.orchestra.run.smithi133.stdout: "rwoption3": { 2023-10-08T16:09:09.399 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "rwoption3", 2023-10-08T16:09:09.399 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "float", 2023-10-08T16:09:09.399 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.399 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.399 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.400 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.400 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.400 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.400 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.400 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.400 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.400 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.400 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.401 INFO:teuthology.orchestra.run.smithi133.stdout: "rwoption4": { 2023-10-08T16:09:09.401 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "rwoption4", 2023-10-08T16:09:09.401 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.401 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.401 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.401 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.401 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.402 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.402 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.402 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.402 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.402 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.402 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.403 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.403 INFO:teuthology.orchestra.run.smithi133.stdout: "rwoption5": { 2023-10-08T16:09:09.403 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "rwoption5", 2023-10-08T16:09:09.403 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.403 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.403 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.403 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.403 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.404 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.404 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.404 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.404 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.404 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.404 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.404 INFO:teuthology.orchestra.run.smithi133.stdout: "rwoption6": { 2023-10-08T16:09:09.405 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "rwoption6", 2023-10-08T16:09:09.405 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.405 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.405 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.405 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.405 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.405 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.405 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.406 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.406 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.406 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.406 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.406 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.406 INFO:teuthology.orchestra.run.smithi133.stdout: "rwoption7": { 2023-10-08T16:09:09.406 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "rwoption7", 2023-10-08T16:09:09.407 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.407 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.407 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.407 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.407 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "1", 2023-10-08T16:09:09.407 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "42", 2023-10-08T16:09:09.407 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.407 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.408 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.408 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.408 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.408 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.408 INFO:teuthology.orchestra.run.smithi133.stdout: "testkey": { 2023-10-08T16:09:09.408 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "testkey", 2023-10-08T16:09:09.408 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.409 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.409 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.409 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.409 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.409 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.409 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.409 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.409 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.410 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.410 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.410 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.410 INFO:teuthology.orchestra.run.smithi133.stdout: "testlkey": { 2023-10-08T16:09:09.410 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "testlkey", 2023-10-08T16:09:09.410 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.410 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.411 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.411 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.411 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.411 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.411 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.411 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.411 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.411 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.412 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.412 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.412 INFO:teuthology.orchestra.run.smithi133.stdout: "testnewline": { 2023-10-08T16:09:09.412 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "testnewline", 2023-10-08T16:09:09.412 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.412 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.412 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.413 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.413 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.413 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.413 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.413 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.413 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.413 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.413 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.414 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.414 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.414 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.414 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.414 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "snap_schedule", 2023-10-08T16:09:09.415 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.415 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.415 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.415 INFO:teuthology.orchestra.run.smithi133.stdout: "allow_m_granularity": { 2023-10-08T16:09:09.415 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "allow_m_granularity", 2023-10-08T16:09:09.415 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.415 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.416 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.416 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.416 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.416 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.416 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.416 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "allow minute scheduled snapshots", 2023-10-08T16:09:09.416 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.416 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.417 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.417 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.417 INFO:teuthology.orchestra.run.smithi133.stdout: "dump_on_update": { 2023-10-08T16:09:09.417 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "dump_on_update", 2023-10-08T16:09:09.417 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.417 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.417 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.417 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.418 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.418 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.418 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.418 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "dump database to debug log on update", 2023-10-08T16:09:09.418 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.418 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.418 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.419 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.419 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.419 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.419 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.419 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.419 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.419 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.419 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.420 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.420 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.420 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.420 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.420 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.420 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.420 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.420 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.421 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.421 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.421 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.421 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.421 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.421 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.421 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.422 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.422 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.422 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.422 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.422 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.422 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.422 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.422 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.423 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.423 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.423 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.423 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.423 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.423 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.423 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.423 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.424 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.424 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.424 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.424 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.424 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.424 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.424 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.424 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.425 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.425 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.425 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.425 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.425 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.425 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.425 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.426 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.426 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.426 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.426 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.426 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.426 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.426 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.427 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.427 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.427 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.427 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.427 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.427 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.427 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.428 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.428 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.428 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.428 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.428 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.428 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.428 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "stats", 2023-10-08T16:09:09.428 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.429 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.429 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.429 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.429 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.429 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.429 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.429 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.429 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.430 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.430 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.430 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.430 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.430 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.430 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.430 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.433 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.433 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.433 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.433 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.434 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.434 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.434 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.434 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.434 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.434 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.435 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.435 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.435 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.435 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.435 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.435 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.435 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.435 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.436 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.436 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.436 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.436 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.436 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.436 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.436 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.436 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.437 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.437 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.437 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.437 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.437 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.437 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.437 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.437 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.438 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.438 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.438 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.438 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.438 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.438 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.438 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.438 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.439 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.439 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.439 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.439 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.439 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.439 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.439 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.439 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.440 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.440 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.440 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.440 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.440 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.440 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.440 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.440 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.441 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.441 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "status", 2023-10-08T16:09:09.441 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.441 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.441 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.441 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.441 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.442 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.442 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.442 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.442 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.442 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.442 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.442 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.443 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.443 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.443 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.443 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.443 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.443 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.443 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.443 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.444 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.444 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.444 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.444 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.444 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.444 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.444 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.444 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.445 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.445 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.445 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.445 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.445 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.445 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.445 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.445 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.446 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.446 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.446 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.446 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.446 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.446 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.446 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.447 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.447 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.447 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.447 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.447 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.447 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.447 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.447 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.448 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.448 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.448 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.448 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.448 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.448 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.448 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.449 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.449 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.449 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.449 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.449 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.449 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.449 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.449 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.450 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.450 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.450 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.450 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.450 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.450 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.450 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.451 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.451 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.451 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.451 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "telegraf", 2023-10-08T16:09:09.451 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.451 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.451 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.451 INFO:teuthology.orchestra.run.smithi133.stdout: "address": { 2023-10-08T16:09:09.452 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "address", 2023-10-08T16:09:09.452 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.452 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.452 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.452 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-08T16:09:09.452 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.452 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.453 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.453 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.453 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.453 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.453 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.453 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.453 INFO:teuthology.orchestra.run.smithi133.stdout: "interval": { 2023-10-08T16:09:09.453 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "interval", 2023-10-08T16:09:09.454 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.454 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.454 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.454 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "15", 2023-10-08T16:09:09.454 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.454 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.454 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.454 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.455 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.455 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.455 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.455 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.455 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.455 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.455 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.456 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.456 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.456 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.456 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.456 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.456 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.456 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.456 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.457 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.457 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.457 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.457 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.457 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.457 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.457 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.458 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.458 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.458 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.458 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.458 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.458 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.458 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.458 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.459 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.459 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.459 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.459 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.459 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.459 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.459 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.460 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.460 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.460 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.460 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.460 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.460 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.460 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.461 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.461 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.461 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.461 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.461 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.461 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.461 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.461 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.462 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.462 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.462 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.462 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.462 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.462 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.462 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.462 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.463 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.463 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.463 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.463 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.463 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.463 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.463 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.463 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.464 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.464 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.464 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.464 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.464 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.464 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.465 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.465 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "telemetry", 2023-10-08T16:09:09.465 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.465 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.465 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.465 INFO:teuthology.orchestra.run.smithi133.stdout: "channel_basic": { 2023-10-08T16:09:09.465 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "channel_basic", 2023-10-08T16:09:09.465 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.466 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.466 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.466 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.466 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.466 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.466 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.466 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-08T16:09:09.467 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.467 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.467 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.467 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.467 INFO:teuthology.orchestra.run.smithi133.stdout: "channel_crash": { 2023-10-08T16:09:09.467 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "channel_crash", 2023-10-08T16:09:09.467 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.467 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.468 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.468 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.468 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.468 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.468 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.468 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-08T16:09:09.468 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.469 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.469 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.469 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.469 INFO:teuthology.orchestra.run.smithi133.stdout: "channel_device": { 2023-10-08T16:09:09.469 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "channel_device", 2023-10-08T16:09:09.469 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.469 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.469 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.470 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.470 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.470 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.470 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.470 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-08T16:09:09.470 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.470 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.471 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.471 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.471 INFO:teuthology.orchestra.run.smithi133.stdout: "channel_ident": { 2023-10-08T16:09:09.471 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "channel_ident", 2023-10-08T16:09:09.471 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.471 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.471 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.472 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.472 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.472 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.472 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.472 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-08T16:09:09.472 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.472 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.472 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.473 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.473 INFO:teuthology.orchestra.run.smithi133.stdout: "channel_perf": { 2023-10-08T16:09:09.473 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "channel_perf", 2023-10-08T16:09:09.473 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.473 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.473 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.473 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.473 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.474 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.474 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.474 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-08T16:09:09.474 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.474 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.474 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.474 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.475 INFO:teuthology.orchestra.run.smithi133.stdout: "contact": { 2023-10-08T16:09:09.475 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "contact", 2023-10-08T16:09:09.475 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.475 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.475 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.475 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.475 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.475 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.476 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.476 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.476 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.476 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.476 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.476 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.476 INFO:teuthology.orchestra.run.smithi133.stdout: "description": { 2023-10-08T16:09:09.476 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "description", 2023-10-08T16:09:09.477 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.477 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.477 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.477 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.477 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.477 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.477 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.478 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.478 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.478 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.478 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.478 INFO:teuthology.orchestra.run.smithi133.stdout: "device_url": { 2023-10-08T16:09:09.478 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "device_url", 2023-10-08T16:09:09.478 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.479 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.479 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.479 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-08T16:09:09.479 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.479 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.479 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.479 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.480 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.480 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.480 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.480 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": { 2023-10-08T16:09:09.480 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "enabled", 2023-10-08T16:09:09.480 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.480 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.481 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.481 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.481 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.481 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.481 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.481 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.481 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.482 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.482 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.482 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.482 INFO:teuthology.orchestra.run.smithi133.stdout: "interval": { 2023-10-08T16:09:09.482 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "interval", 2023-10-08T16:09:09.482 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.482 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.483 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.483 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "24", 2023-10-08T16:09:09.483 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "8", 2023-10-08T16:09:09.483 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.483 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.483 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.483 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.483 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.484 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.484 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.484 INFO:teuthology.orchestra.run.smithi133.stdout: "last_opt_revision": { 2023-10-08T16:09:09.484 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "last_opt_revision", 2023-10-08T16:09:09.484 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.484 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.484 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.485 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "1", 2023-10-08T16:09:09.485 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.485 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.485 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.485 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.485 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.485 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.485 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.486 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.486 INFO:teuthology.orchestra.run.smithi133.stdout: "leaderboard": { 2023-10-08T16:09:09.486 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "leaderboard", 2023-10-08T16:09:09.486 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.486 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.486 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.486 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.487 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.487 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.487 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.487 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.487 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.487 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.487 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.487 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.488 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.488 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.488 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.488 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.488 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.488 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.488 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.489 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.489 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.489 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.489 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.489 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.489 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.489 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.489 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.490 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.490 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.490 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.490 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.490 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.490 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.490 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.491 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.491 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.491 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.491 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.491 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.491 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.491 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.491 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.492 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.492 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.492 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.492 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.492 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.492 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.492 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.493 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.493 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.493 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.493 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.493 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.493 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.493 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.494 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.494 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.494 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.494 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.494 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.494 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.494 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.495 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.495 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.495 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.495 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.495 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.495 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.495 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.496 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.496 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.496 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.496 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.496 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.496 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.496 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.496 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.497 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.497 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.497 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.497 INFO:teuthology.orchestra.run.smithi133.stdout: "organization": { 2023-10-08T16:09:09.497 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "organization", 2023-10-08T16:09:09.497 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.497 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.498 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.498 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.498 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.498 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.498 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.498 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.498 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.498 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.499 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.499 INFO:teuthology.orchestra.run.smithi133.stdout: "proxy": { 2023-10-08T16:09:09.499 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "proxy", 2023-10-08T16:09:09.499 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.499 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.499 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.499 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.500 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.500 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.500 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.500 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.500 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.500 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.500 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.501 INFO:teuthology.orchestra.run.smithi133.stdout: "url": { 2023-10-08T16:09:09.501 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "url", 2023-10-08T16:09:09.501 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.501 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.501 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.501 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-08T16:09:09.501 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.502 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.502 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.502 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.502 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.502 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.502 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.502 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.503 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.503 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.503 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.503 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "test_orchestrator", 2023-10-08T16:09:09.503 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.503 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.503 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.503 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.504 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.504 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.504 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.504 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.504 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.504 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.504 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.504 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.505 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.505 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.505 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.505 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.505 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.505 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.505 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.506 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.506 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.506 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.506 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.506 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.506 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.507 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.507 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.507 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.507 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.507 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.507 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.507 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.507 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.508 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.508 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.508 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.508 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.508 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.508 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.509 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.509 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.509 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.509 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.509 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.509 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.509 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.509 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.510 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.510 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.510 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.510 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.510 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.510 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.510 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.510 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.511 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.511 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.511 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.511 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.511 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.511 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.512 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.512 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.512 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.512 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.512 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.512 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.512 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.512 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.513 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.513 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.513 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "volumes", 2023-10-08T16:09:09.513 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.513 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.513 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.514 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.514 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.514 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.514 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.514 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.514 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.514 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.514 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.515 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.515 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.515 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.515 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.515 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.515 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.515 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.515 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.516 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.516 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.516 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.516 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.516 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.516 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.516 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.516 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.517 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.517 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.517 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.517 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.517 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.517 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.517 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.518 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.518 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.518 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.518 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.518 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.518 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.518 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.518 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.519 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.519 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.519 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.519 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.519 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.519 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.519 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.520 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.520 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.520 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.520 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.520 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.520 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.520 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.520 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.521 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.521 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.521 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.521 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.521 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.521 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.521 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.521 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.522 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.522 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.522 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.522 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.522 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.522 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.522 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.522 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.523 INFO:teuthology.orchestra.run.smithi133.stdout: "max_concurrent_clones": { 2023-10-08T16:09:09.523 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "max_concurrent_clones", 2023-10-08T16:09:09.523 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.523 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.523 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.523 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "4", 2023-10-08T16:09:09.523 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.523 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.524 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.524 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-08T16:09:09.524 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.524 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.524 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.524 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.524 INFO:teuthology.orchestra.run.smithi133.stdout: "snapshot_clone_delay": { 2023-10-08T16:09:09.525 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "snapshot_clone_delay", 2023-10-08T16:09:09.525 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.525 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.525 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.525 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "0", 2023-10-08T16:09:09.525 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.525 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.525 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.526 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-08T16:09:09.526 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.526 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.526 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.526 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.526 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.526 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.526 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.527 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "zabbix", 2023-10-08T16:09:09.527 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.527 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.527 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.527 INFO:teuthology.orchestra.run.smithi133.stdout: "discovery_interval": { 2023-10-08T16:09:09.527 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "discovery_interval", 2023-10-08T16:09:09.527 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "uint", 2023-10-08T16:09:09.527 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.528 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.528 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "100", 2023-10-08T16:09:09.528 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.528 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.528 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.528 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.528 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.529 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.529 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.529 INFO:teuthology.orchestra.run.smithi133.stdout: "identifier": { 2023-10-08T16:09:09.529 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "identifier", 2023-10-08T16:09:09.529 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.529 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.529 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.530 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.530 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.530 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.530 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.530 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.530 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.530 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.530 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.531 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.531 INFO:teuthology.orchestra.run.smithi133.stdout: "interval": { 2023-10-08T16:09:09.531 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "interval", 2023-10-08T16:09:09.531 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.531 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.531 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.531 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "60", 2023-10-08T16:09:09.531 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.532 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.532 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.532 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.532 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.532 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.532 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.532 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.532 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.533 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.533 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.533 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.533 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.533 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.533 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.533 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.534 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.534 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.534 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.534 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.534 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.534 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.534 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.534 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.535 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.535 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.535 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.535 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.535 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.535 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.535 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.536 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.536 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.536 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.536 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.536 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.536 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.536 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.536 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.537 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.537 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.537 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.537 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.537 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.537 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.538 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.538 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.538 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.538 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.538 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.538 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.538 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.538 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.539 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.539 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.539 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.539 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.539 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.539 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.539 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.539 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.540 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.540 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.540 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.540 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.540 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.540 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.540 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.541 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.541 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.541 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.541 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.541 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.541 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.541 INFO:teuthology.orchestra.run.smithi133.stdout: "zabbix_host": { 2023-10-08T16:09:09.542 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "zabbix_host", 2023-10-08T16:09:09.542 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.542 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.542 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.542 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.542 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.542 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.543 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.543 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.543 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.543 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.543 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.543 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.543 INFO:teuthology.orchestra.run.smithi133.stdout: "zabbix_port": { 2023-10-08T16:09:09.544 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "zabbix_port", 2023-10-08T16:09:09.544 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.544 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.544 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.544 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "10051", 2023-10-08T16:09:09.544 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.544 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.544 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.545 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.545 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.545 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.545 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.545 INFO:teuthology.orchestra.run.smithi133.stdout: "zabbix_sender": { 2023-10-08T16:09:09.545 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "zabbix_sender", 2023-10-08T16:09:09.545 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.546 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.546 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.546 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-08T16:09:09.546 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.546 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.546 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.546 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.546 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.547 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.547 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.547 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.547 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.547 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.547 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2023-10-08T16:09:09.547 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.548 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.548 INFO:teuthology.orchestra.run.smithi133.stdout: "modules": [ 2023-10-08T16:09:09.548 INFO:teuthology.orchestra.run.smithi133.stdout: "iostat", 2023-10-08T16:09:09.548 INFO:teuthology.orchestra.run.smithi133.stdout: "nfs", 2023-10-08T16:09:09.548 INFO:teuthology.orchestra.run.smithi133.stdout: "restful" 2023-10-08T16:09:09.548 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.548 INFO:teuthology.orchestra.run.smithi133.stdout: "available_modules": [ 2023-10-08T16:09:09.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.549 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "alerts", 2023-10-08T16:09:09.549 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.549 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.549 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.549 INFO:teuthology.orchestra.run.smithi133.stdout: "interval": { 2023-10-08T16:09:09.549 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "interval", 2023-10-08T16:09:09.549 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.549 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.550 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.550 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "60", 2023-10-08T16:09:09.550 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.550 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.550 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.550 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "How frequently to reexamine health status", 2023-10-08T16:09:09.550 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.550 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.551 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.551 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.551 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.551 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.551 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.551 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.551 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.551 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.552 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.552 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.552 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.552 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.552 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.552 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.552 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.552 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.553 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.553 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.553 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.553 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.553 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.553 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.553 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.554 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.554 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.554 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.554 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.554 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.554 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.554 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.555 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.555 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.555 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.555 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.555 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.555 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.555 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.556 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.556 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.556 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.556 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.556 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.556 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.556 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.556 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.557 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.557 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.557 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.557 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.557 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.557 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.557 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.557 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.558 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.558 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.558 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.558 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.558 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.558 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.558 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.559 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.559 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.559 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.559 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.559 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.559 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.559 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.559 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.560 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.560 INFO:teuthology.orchestra.run.smithi133.stdout: "smtp_destination": { 2023-10-08T16:09:09.560 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "smtp_destination", 2023-10-08T16:09:09.560 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.560 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.560 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.560 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.561 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.561 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.561 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.561 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Email address to send alerts to", 2023-10-08T16:09:09.561 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.561 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.561 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.561 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.562 INFO:teuthology.orchestra.run.smithi133.stdout: "smtp_from_name": { 2023-10-08T16:09:09.562 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "smtp_from_name", 2023-10-08T16:09:09.562 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.562 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.562 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.562 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "Ceph", 2023-10-08T16:09:09.562 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.563 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.563 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.563 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Email From: name", 2023-10-08T16:09:09.563 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.563 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.563 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.563 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.563 INFO:teuthology.orchestra.run.smithi133.stdout: "smtp_host": { 2023-10-08T16:09:09.564 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "smtp_host", 2023-10-08T16:09:09.564 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.564 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.564 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.564 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.564 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.564 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.564 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.565 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "SMTP server", 2023-10-08T16:09:09.565 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.565 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.565 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.565 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.565 INFO:teuthology.orchestra.run.smithi133.stdout: "smtp_password": { 2023-10-08T16:09:09.565 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "smtp_password", 2023-10-08T16:09:09.565 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.566 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.566 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.566 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.566 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.566 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.566 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.566 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Password to authenticate with", 2023-10-08T16:09:09.566 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.567 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.567 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.567 INFO:teuthology.orchestra.run.smithi133.stdout: "smtp_port": { 2023-10-08T16:09:09.567 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "smtp_port", 2023-10-08T16:09:09.567 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.567 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.567 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.568 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "465", 2023-10-08T16:09:09.568 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.568 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.568 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.568 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "SMTP port", 2023-10-08T16:09:09.568 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.568 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.568 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.569 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.569 INFO:teuthology.orchestra.run.smithi133.stdout: "smtp_sender": { 2023-10-08T16:09:09.569 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "smtp_sender", 2023-10-08T16:09:09.569 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.569 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.569 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.569 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.569 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.570 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.570 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.570 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "SMTP envelope sender", 2023-10-08T16:09:09.570 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.570 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.570 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.571 INFO:teuthology.orchestra.run.smithi133.stdout: "smtp_ssl": { 2023-10-08T16:09:09.571 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "smtp_ssl", 2023-10-08T16:09:09.571 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.571 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.571 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.571 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.571 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.571 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.572 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.572 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-08T16:09:09.572 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.572 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.572 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.572 INFO:teuthology.orchestra.run.smithi133.stdout: "smtp_user": { 2023-10-08T16:09:09.573 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "smtp_user", 2023-10-08T16:09:09.573 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.573 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.573 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.573 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.573 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.573 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.573 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.574 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "User to authenticate as", 2023-10-08T16:09:09.574 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.574 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.574 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.574 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.574 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.575 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "balancer", 2023-10-08T16:09:09.575 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.575 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.575 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.575 INFO:teuthology.orchestra.run.smithi133.stdout: "active": { 2023-10-08T16:09:09.575 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "active", 2023-10-08T16:09:09.575 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.576 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.576 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.576 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.576 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.576 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.576 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.576 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "automatically balance PGs across cluster", 2023-10-08T16:09:09.576 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.577 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.577 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.577 INFO:teuthology.orchestra.run.smithi133.stdout: "begin_time": { 2023-10-08T16:09:09.577 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "begin_time", 2023-10-08T16:09:09.577 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.577 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.577 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.578 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "0000", 2023-10-08T16:09:09.578 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.578 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.578 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.578 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "beginning time of day to automatically balance", 2023-10-08T16:09:09.578 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T16:09:09.578 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.579 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.579 INFO:teuthology.orchestra.run.smithi133.stdout: "begin_weekday": { 2023-10-08T16:09:09.579 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "begin_weekday", 2023-10-08T16:09:09.579 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "uint", 2023-10-08T16:09:09.579 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.579 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.579 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "0", 2023-10-08T16:09:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "0", 2023-10-08T16:09:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "7", 2023-10-08T16:09:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-08T16:09:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2023-10-08T16:09:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_compat_max_iterations": { 2023-10-08T16:09:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "crush_compat_max_iterations", 2023-10-08T16:09:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "uint", 2023-10-08T16:09:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "25", 2023-10-08T16:09:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "1", 2023-10-08T16:09:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "250", 2023-10-08T16:09:09.582 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.582 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-08T16:09:09.582 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.582 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.582 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.582 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_compat_metrics": { 2023-10-08T16:09:09.583 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "crush_compat_metrics", 2023-10-08T16:09:09.583 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.583 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.583 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.583 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "pgs,objects,bytes", 2023-10-08T16:09:09.583 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.583 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.583 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-08T16:09:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-08T16:09:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_compat_step": { 2023-10-08T16:09:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "crush_compat_step", 2023-10-08T16:09:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "float", 2023-10-08T16:09:09.585 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.585 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.585 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "0.5", 2023-10-08T16:09:09.585 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "0.001", 2023-10-08T16:09:09.585 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "0.999", 2023-10-08T16:09:09.585 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.585 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "aggressiveness of optimization", 2023-10-08T16:09:09.585 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-08T16:09:09.586 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.586 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.586 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.586 INFO:teuthology.orchestra.run.smithi133.stdout: "end_time": { 2023-10-08T16:09:09.586 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "end_time", 2023-10-08T16:09:09.586 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.586 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.587 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.587 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "2400", 2023-10-08T16:09:09.587 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.587 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.587 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.587 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "ending time of day to automatically balance", 2023-10-08T16:09:09.588 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T16:09:09.588 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.588 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.588 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.588 INFO:teuthology.orchestra.run.smithi133.stdout: "end_weekday": { 2023-10-08T16:09:09.588 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "end_weekday", 2023-10-08T16:09:09.588 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "uint", 2023-10-08T16:09:09.588 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "7", 2023-10-08T16:09:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "0", 2023-10-08T16:09:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "7", 2023-10-08T16:09:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-08T16:09:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2023-10-08T16:09:09.590 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.590 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.590 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.590 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.590 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.590 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.590 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.594 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.594 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.594 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.594 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.594 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.594 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.596 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.596 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.596 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.596 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.596 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.596 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.596 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.596 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.597 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.597 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.597 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.597 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.597 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.597 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.597 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.598 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.598 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.598 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.598 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.598 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.598 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.598 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.598 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.599 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.599 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.599 INFO:teuthology.orchestra.run.smithi133.stdout: "min_score": { 2023-10-08T16:09:09.599 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "min_score", 2023-10-08T16:09:09.599 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "float", 2023-10-08T16:09:09.599 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.599 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.600 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "0", 2023-10-08T16:09:09.600 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.600 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.600 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.600 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-08T16:09:09.600 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.600 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.600 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.601 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.601 INFO:teuthology.orchestra.run.smithi133.stdout: "mode": { 2023-10-08T16:09:09.601 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "mode", 2023-10-08T16:09:09.601 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.601 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.601 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.601 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "upmap", 2023-10-08T16:09:09.602 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.602 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.602 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.602 INFO:teuthology.orchestra.run.smithi133.stdout: "crush-compat", 2023-10-08T16:09:09.602 INFO:teuthology.orchestra.run.smithi133.stdout: "none", 2023-10-08T16:09:09.602 INFO:teuthology.orchestra.run.smithi133.stdout: "upmap" 2023-10-08T16:09:09.602 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.603 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Balancer mode", 2023-10-08T16:09:09.603 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.603 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.603 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.603 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_ids": { 2023-10-08T16:09:09.603 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "pool_ids", 2023-10-08T16:09:09.603 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.604 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.604 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.604 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.604 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.604 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.604 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.604 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-08T16:09:09.604 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.605 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.605 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.605 INFO:teuthology.orchestra.run.smithi133.stdout: "sleep_interval": { 2023-10-08T16:09:09.605 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "sleep_interval", 2023-10-08T16:09:09.605 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.605 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.605 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.606 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "60", 2023-10-08T16:09:09.606 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.606 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.606 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.606 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-08T16:09:09.606 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.606 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.606 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.607 INFO:teuthology.orchestra.run.smithi133.stdout: "upmap_max_deviation": { 2023-10-08T16:09:09.607 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "upmap_max_deviation", 2023-10-08T16:09:09.607 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.607 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.607 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.607 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "5", 2023-10-08T16:09:09.607 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "1", 2023-10-08T16:09:09.608 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.608 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.608 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-08T16:09:09.608 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-08T16:09:09.608 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.608 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.608 INFO:teuthology.orchestra.run.smithi133.stdout: "upmap_max_optimizations": { 2023-10-08T16:09:09.609 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "upmap_max_optimizations", 2023-10-08T16:09:09.609 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "uint", 2023-10-08T16:09:09.609 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.609 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.609 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "10", 2023-10-08T16:09:09.609 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.609 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.609 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.610 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-08T16:09:09.610 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.610 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.610 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.610 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.610 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.611 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "cephadm", 2023-10-08T16:09:09.611 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": false, 2023-10-08T16:09:09.611 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "loading asyncssh library:No module named 'asyncssh'", 2023-10-08T16:09:09.611 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.611 INFO:teuthology.orchestra.run.smithi133.stdout: "agent_down_multiplier": { 2023-10-08T16:09:09.611 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "agent_down_multiplier", 2023-10-08T16:09:09.611 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "float", 2023-10-08T16:09:09.612 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.612 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.612 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "3.0", 2023-10-08T16:09:09.612 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.612 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.612 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.612 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-08T16:09:09.612 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.613 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.613 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.613 INFO:teuthology.orchestra.run.smithi133.stdout: "agent_refresh_rate": { 2023-10-08T16:09:09.613 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "agent_refresh_rate", 2023-10-08T16:09:09.613 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.613 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.613 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.614 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "20", 2023-10-08T16:09:09.614 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.614 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.614 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.614 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-08T16:09:09.614 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.614 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.615 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.615 INFO:teuthology.orchestra.run.smithi133.stdout: "agent_starting_port": { 2023-10-08T16:09:09.615 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "agent_starting_port", 2023-10-08T16:09:09.615 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.615 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.615 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.615 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "4721", 2023-10-08T16:09:09.616 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.616 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.616 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.616 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-08T16:09:09.616 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.616 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.616 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.617 INFO:teuthology.orchestra.run.smithi133.stdout: "allow_ptrace": { 2023-10-08T16:09:09.617 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "allow_ptrace", 2023-10-08T16:09:09.617 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.617 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.617 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.617 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.617 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.617 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.618 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.618 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-08T16:09:09.618 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-08T16:09:09.618 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.618 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.618 INFO:teuthology.orchestra.run.smithi133.stdout: "autotune_interval": { 2023-10-08T16:09:09.619 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "autotune_interval", 2023-10-08T16:09:09.619 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.619 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.619 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.619 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "600", 2023-10-08T16:09:09.619 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.619 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.619 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.620 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-08T16:09:09.620 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.620 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.620 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.620 INFO:teuthology.orchestra.run.smithi133.stdout: "autotune_memory_target_ratio": { 2023-10-08T16:09:09.620 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "autotune_memory_target_ratio", 2023-10-08T16:09:09.620 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "float", 2023-10-08T16:09:09.621 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.621 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.621 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "0.7", 2023-10-08T16:09:09.621 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.621 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.621 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.621 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-08T16:09:09.621 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.622 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.622 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.622 INFO:teuthology.orchestra.run.smithi133.stdout: "cgroups_split": { 2023-10-08T16:09:09.622 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "cgroups_split", 2023-10-08T16:09:09.622 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.622 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-08T16:09:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.624 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.624 INFO:teuthology.orchestra.run.smithi133.stdout: "config_checks_enabled": { 2023-10-08T16:09:09.624 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "config_checks_enabled", 2023-10-08T16:09:09.624 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.624 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.624 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.624 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.625 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.625 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.625 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.625 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-08T16:09:09.625 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.625 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.625 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.626 INFO:teuthology.orchestra.run.smithi133.stdout: "config_dashboard": { 2023-10-08T16:09:09.626 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "config_dashboard", 2023-10-08T16:09:09.626 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.626 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.626 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.626 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.626 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.627 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.627 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.627 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-08T16:09:09.627 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.627 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.627 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.627 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.627 INFO:teuthology.orchestra.run.smithi133.stdout: "container_image_alertmanager": { 2023-10-08T16:09:09.628 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "container_image_alertmanager", 2023-10-08T16:09:09.628 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.628 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.628 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.628 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-08T16:09:09.628 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.628 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.629 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.629 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Prometheus container image", 2023-10-08T16:09:09.629 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.629 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.629 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.629 INFO:teuthology.orchestra.run.smithi133.stdout: "container_image_base": { 2023-10-08T16:09:09.629 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "container_image_base", 2023-10-08T16:09:09.630 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.630 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.630 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.630 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-08T16:09:09.630 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.630 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.630 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.630 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Container image name, without the tag", 2023-10-08T16:09:09.631 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.631 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.631 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.631 INFO:teuthology.orchestra.run.smithi133.stdout: "container_image_grafana": { 2023-10-08T16:09:09.631 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "container_image_grafana", 2023-10-08T16:09:09.631 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.631 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.632 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.632 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-08T16:09:09.632 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.632 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.632 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.632 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Prometheus container image", 2023-10-08T16:09:09.632 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.632 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.633 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.633 INFO:teuthology.orchestra.run.smithi133.stdout: "container_image_haproxy": { 2023-10-08T16:09:09.633 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "container_image_haproxy", 2023-10-08T16:09:09.633 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.633 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.633 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.633 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-08T16:09:09.634 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.634 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.634 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.634 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "HAproxy container image", 2023-10-08T16:09:09.634 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.634 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.634 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.635 INFO:teuthology.orchestra.run.smithi133.stdout: "container_image_keepalived": { 2023-10-08T16:09:09.635 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "container_image_keepalived", 2023-10-08T16:09:09.635 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.635 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.635 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.635 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "quay.io/ceph/keepalived:2.1.5", 2023-10-08T16:09:09.635 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.636 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.636 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.636 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Keepalived container image", 2023-10-08T16:09:09.636 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.636 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.636 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.636 INFO:teuthology.orchestra.run.smithi133.stdout: "container_image_loki": { 2023-10-08T16:09:09.637 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "container_image_loki", 2023-10-08T16:09:09.637 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.637 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.637 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.637 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-08T16:09:09.637 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.637 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.637 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.638 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Loki container image", 2023-10-08T16:09:09.638 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.638 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.638 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.638 INFO:teuthology.orchestra.run.smithi133.stdout: "container_image_node_exporter": { 2023-10-08T16:09:09.638 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "container_image_node_exporter", 2023-10-08T16:09:09.639 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.639 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.639 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.639 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-08T16:09:09.639 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.639 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.639 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.639 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Prometheus container image", 2023-10-08T16:09:09.640 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.640 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.640 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.640 INFO:teuthology.orchestra.run.smithi133.stdout: "container_image_prometheus": { 2023-10-08T16:09:09.640 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "container_image_prometheus", 2023-10-08T16:09:09.640 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.640 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.641 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.641 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-08T16:09:09.641 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.641 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.641 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.641 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Prometheus container image", 2023-10-08T16:09:09.641 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.641 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.642 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.642 INFO:teuthology.orchestra.run.smithi133.stdout: "container_image_promtail": { 2023-10-08T16:09:09.642 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "container_image_promtail", 2023-10-08T16:09:09.642 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.642 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.642 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.642 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-08T16:09:09.643 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.643 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.643 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.643 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Promtail container image", 2023-10-08T16:09:09.643 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.643 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.643 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.644 INFO:teuthology.orchestra.run.smithi133.stdout: "container_image_snmp_gateway": { 2023-10-08T16:09:09.644 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "container_image_snmp_gateway", 2023-10-08T16:09:09.644 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.644 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.644 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.644 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-08T16:09:09.644 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.645 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.645 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.645 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "SNMP Gateway container image", 2023-10-08T16:09:09.645 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.645 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.645 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.645 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.645 INFO:teuthology.orchestra.run.smithi133.stdout: "container_init": { 2023-10-08T16:09:09.646 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "container_init", 2023-10-08T16:09:09.646 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.646 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.646 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.646 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.646 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.646 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.646 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.647 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Run podman/docker with `--init`", 2023-10-08T16:09:09.647 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.647 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.647 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.647 INFO:teuthology.orchestra.run.smithi133.stdout: "daemon_cache_timeout": { 2023-10-08T16:09:09.647 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "daemon_cache_timeout", 2023-10-08T16:09:09.647 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.648 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.648 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.648 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "600", 2023-10-08T16:09:09.648 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.648 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.648 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.648 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-08T16:09:09.648 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.649 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.649 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.649 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.649 INFO:teuthology.orchestra.run.smithi133.stdout: "default_cephadm_command_timeout": { 2023-10-08T16:09:09.649 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "default_cephadm_command_timeout", 2023-10-08T16:09:09.649 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.649 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.649 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.650 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "900", 2023-10-08T16:09:09.650 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.650 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.650 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.650 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-08T16:09:09.650 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.650 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.651 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.651 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.651 INFO:teuthology.orchestra.run.smithi133.stdout: "default_registry": { 2023-10-08T16:09:09.651 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "default_registry", 2023-10-08T16:09:09.651 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.651 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.651 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.651 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "docker.io", 2023-10-08T16:09:09.652 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.652 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.652 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.652 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-08T16:09:09.652 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.652 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.652 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.653 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.653 INFO:teuthology.orchestra.run.smithi133.stdout: "device_cache_timeout": { 2023-10-08T16:09:09.653 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "device_cache_timeout", 2023-10-08T16:09:09.653 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.653 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.653 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.653 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "1800", 2023-10-08T16:09:09.653 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.654 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.654 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.654 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "seconds to cache device inventory", 2023-10-08T16:09:09.654 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.654 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.654 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.654 INFO:teuthology.orchestra.run.smithi133.stdout: "device_enhanced_scan": { 2023-10-08T16:09:09.655 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "device_enhanced_scan", 2023-10-08T16:09:09.655 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.655 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.655 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.655 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.655 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.655 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.656 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.656 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-08T16:09:09.656 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.656 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.656 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.656 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.656 INFO:teuthology.orchestra.run.smithi133.stdout: "facts_cache_timeout": { 2023-10-08T16:09:09.656 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "facts_cache_timeout", 2023-10-08T16:09:09.657 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.657 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.657 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.657 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "60", 2023-10-08T16:09:09.657 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.657 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.657 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.657 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "seconds to cache host facts data", 2023-10-08T16:09:09.658 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.658 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.658 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.658 INFO:teuthology.orchestra.run.smithi133.stdout: "host_check_interval": { 2023-10-08T16:09:09.658 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "host_check_interval", 2023-10-08T16:09:09.658 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.658 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.659 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.659 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "600", 2023-10-08T16:09:09.659 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.659 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.659 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.659 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "how frequently to perform a host check", 2023-10-08T16:09:09.659 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.660 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.660 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.660 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.660 INFO:teuthology.orchestra.run.smithi133.stdout: "inventory_list_all": { 2023-10-08T16:09:09.660 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "inventory_list_all", 2023-10-08T16:09:09.660 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.660 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.660 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.661 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.661 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.661 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.661 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.661 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-08T16:09:09.661 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.661 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.661 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.662 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.662 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.662 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.662 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.662 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.662 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.662 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.663 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.663 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.663 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.663 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.663 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.663 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.663 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.664 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.664 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.664 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.664 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.664 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.664 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.664 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.664 INFO:teuthology.orchestra.run.smithi133.stdout: "log_refresh_metadata": { 2023-10-08T16:09:09.665 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_refresh_metadata", 2023-10-08T16:09:09.665 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.665 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.665 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.665 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.665 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.665 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.665 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.666 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-08T16:09:09.666 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.666 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.666 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.666 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.666 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.666 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.666 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.667 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.667 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.667 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.667 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.667 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.667 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.667 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-08T16:09:09.668 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.668 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.668 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.668 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.668 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.668 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.668 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.668 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.669 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.669 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.669 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.669 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.669 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.669 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.669 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.669 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.670 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.670 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.670 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.670 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.670 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.670 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.670 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.671 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.671 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.671 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.671 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.671 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.671 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.671 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.672 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.672 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.672 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.672 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.672 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.672 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.672 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.672 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.673 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.673 INFO:teuthology.orchestra.run.smithi133.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-08T16:09:09.673 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-08T16:09:09.673 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.673 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.673 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.673 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.673 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.674 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.674 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.674 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-08T16:09:09.674 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.674 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.674 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.674 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.674 INFO:teuthology.orchestra.run.smithi133.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-08T16:09:09.675 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-08T16:09:09.675 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.675 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.675 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.675 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "*", 2023-10-08T16:09:09.675 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.675 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.675 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.676 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-08T16:09:09.676 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.676 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.676 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.676 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.676 INFO:teuthology.orchestra.run.smithi133.stdout: "max_count_per_host": { 2023-10-08T16:09:09.676 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "max_count_per_host", 2023-10-08T16:09:09.677 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.677 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.677 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.677 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "10", 2023-10-08T16:09:09.677 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.677 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.677 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.677 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "max number of daemons per service per host", 2023-10-08T16:09:09.678 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.678 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.678 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.678 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.678 INFO:teuthology.orchestra.run.smithi133.stdout: "max_osd_draining_count": { 2023-10-08T16:09:09.678 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "max_osd_draining_count", 2023-10-08T16:09:09.678 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.678 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.679 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.679 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "10", 2023-10-08T16:09:09.679 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.679 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.679 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.679 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-08T16:09:09.679 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.679 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.680 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.680 INFO:teuthology.orchestra.run.smithi133.stdout: "migration_current": { 2023-10-08T16:09:09.680 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "migration_current", 2023-10-08T16:09:09.680 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.680 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.680 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.681 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.681 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.681 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.681 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.681 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "internal - do not modify", 2023-10-08T16:09:09.681 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.681 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.681 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.682 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.682 INFO:teuthology.orchestra.run.smithi133.stdout: "mode": { 2023-10-08T16:09:09.682 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "mode", 2023-10-08T16:09:09.682 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.682 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.682 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.682 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "root", 2023-10-08T16:09:09.683 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.683 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.683 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.683 INFO:teuthology.orchestra.run.smithi133.stdout: "cephadm-package", 2023-10-08T16:09:09.683 INFO:teuthology.orchestra.run.smithi133.stdout: "root" 2023-10-08T16:09:09.683 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.683 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "mode for remote execution of cephadm", 2023-10-08T16:09:09.684 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.684 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.684 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.684 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.684 INFO:teuthology.orchestra.run.smithi133.stdout: "prometheus_alerts_path": { 2023-10-08T16:09:09.684 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "prometheus_alerts_path", 2023-10-08T16:09:09.684 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.684 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.685 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.685 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-08T16:09:09.685 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.685 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.685 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.685 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-08T16:09:09.685 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.685 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.686 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.686 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.686 INFO:teuthology.orchestra.run.smithi133.stdout: "registry_insecure": { 2023-10-08T16:09:09.686 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "registry_insecure", 2023-10-08T16:09:09.686 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.686 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.686 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.687 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.687 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.687 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.687 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.687 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-08T16:09:09.687 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.687 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.687 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.688 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.688 INFO:teuthology.orchestra.run.smithi133.stdout: "registry_password": { 2023-10-08T16:09:09.688 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "registry_password", 2023-10-08T16:09:09.688 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.688 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.688 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.688 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.688 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.689 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.689 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.689 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-08T16:09:09.689 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.689 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.689 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.689 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.689 INFO:teuthology.orchestra.run.smithi133.stdout: "registry_url": { 2023-10-08T16:09:09.690 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "registry_url", 2023-10-08T16:09:09.690 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.690 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.690 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.690 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.690 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.690 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.691 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.691 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-08T16:09:09.691 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.691 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.691 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.691 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.691 INFO:teuthology.orchestra.run.smithi133.stdout: "registry_username": { 2023-10-08T16:09:09.691 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "registry_username", 2023-10-08T16:09:09.692 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.692 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.692 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.692 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.692 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.692 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.692 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.692 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-08T16:09:09.693 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.693 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.693 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.693 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.693 INFO:teuthology.orchestra.run.smithi133.stdout: "ssh_config_file": { 2023-10-08T16:09:09.693 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "ssh_config_file", 2023-10-08T16:09:09.693 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.693 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.694 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.694 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.694 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.694 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.694 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.694 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-08T16:09:09.694 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.694 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.695 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.695 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.695 INFO:teuthology.orchestra.run.smithi133.stdout: "use_agent": { 2023-10-08T16:09:09.695 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "use_agent", 2023-10-08T16:09:09.695 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.695 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.695 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.696 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.696 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.696 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.696 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.696 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-08T16:09:09.696 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.696 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.696 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.697 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.697 INFO:teuthology.orchestra.run.smithi133.stdout: "use_repo_digest": { 2023-10-08T16:09:09.697 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "use_repo_digest", 2023-10-08T16:09:09.697 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.697 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.697 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.697 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.697 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.698 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.698 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.698 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-08T16:09:09.698 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.698 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.698 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.698 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.699 INFO:teuthology.orchestra.run.smithi133.stdout: "warn_on_failed_host_check": { 2023-10-08T16:09:09.699 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "warn_on_failed_host_check", 2023-10-08T16:09:09.699 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.699 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.699 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.699 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.699 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.699 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.700 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.700 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "raise a health warning if the host check fails", 2023-10-08T16:09:09.700 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.700 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.700 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.700 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.700 INFO:teuthology.orchestra.run.smithi133.stdout: "warn_on_stray_daemons": { 2023-10-08T16:09:09.700 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "warn_on_stray_daemons", 2023-10-08T16:09:09.701 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.701 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.701 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.701 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.701 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.701 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.701 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.702 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-08T16:09:09.702 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.702 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.702 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.702 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.702 INFO:teuthology.orchestra.run.smithi133.stdout: "warn_on_stray_hosts": { 2023-10-08T16:09:09.702 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "warn_on_stray_hosts", 2023-10-08T16:09:09.702 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.703 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.703 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.703 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.703 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.703 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.703 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.703 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-08T16:09:09.703 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.704 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.704 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.704 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.704 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.704 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.704 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.704 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "crash", 2023-10-08T16:09:09.705 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.705 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.705 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.705 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.705 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.705 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.705 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.705 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.706 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.706 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.706 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.706 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.706 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.706 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.706 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.706 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.707 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.707 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.707 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.707 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.707 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.707 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.707 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.708 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.708 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.708 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.708 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.708 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.708 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.708 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.708 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.709 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.709 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.709 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.709 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.709 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.709 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.710 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.710 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.710 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.710 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.710 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.710 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.710 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.711 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.711 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.711 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.711 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.711 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.711 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.711 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.711 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.712 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.712 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.712 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.712 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.712 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.712 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.712 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.712 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.713 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.713 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.713 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.713 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.713 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.713 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.713 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.714 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.714 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.714 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.714 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.714 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.714 INFO:teuthology.orchestra.run.smithi133.stdout: "retain_interval": { 2023-10-08T16:09:09.714 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "retain_interval", 2023-10-08T16:09:09.714 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.715 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.715 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.715 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "31536000", 2023-10-08T16:09:09.715 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.715 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.715 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.715 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-08T16:09:09.715 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.716 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.716 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.716 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.716 INFO:teuthology.orchestra.run.smithi133.stdout: "warn_recent_interval": { 2023-10-08T16:09:09.716 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "warn_recent_interval", 2023-10-08T16:09:09.716 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.716 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.717 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.717 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "1209600", 2023-10-08T16:09:09.717 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.717 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.717 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.717 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-08T16:09:09.717 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.717 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.718 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.718 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.718 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.718 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.718 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.718 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "dashboard", 2023-10-08T16:09:09.718 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.719 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.719 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.719 INFO:teuthology.orchestra.run.smithi133.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-08T16:09:09.719 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-08T16:09:09.719 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.719 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.719 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.719 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "10", 2023-10-08T16:09:09.720 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.720 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.720 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.720 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.720 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.720 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.720 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.721 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.721 INFO:teuthology.orchestra.run.smithi133.stdout: "ALERTMANAGER_API_HOST": { 2023-10-08T16:09:09.721 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-08T16:09:09.721 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.721 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.721 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.721 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.721 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.722 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.722 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.722 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.722 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.722 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.722 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.722 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.723 INFO:teuthology.orchestra.run.smithi133.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-08T16:09:09.723 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-08T16:09:09.723 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.723 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.723 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.723 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.723 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.723 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.724 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.724 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.724 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.724 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.724 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.724 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.724 INFO:teuthology.orchestra.run.smithi133.stdout: "AUDIT_API_ENABLED": { 2023-10-08T16:09:09.725 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "AUDIT_API_ENABLED", 2023-10-08T16:09:09.725 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.725 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.725 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.725 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.725 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.725 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.726 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.726 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.726 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.726 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.726 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.726 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.726 INFO:teuthology.orchestra.run.smithi133.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-08T16:09:09.726 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-08T16:09:09.727 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.727 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.727 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.727 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.727 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.727 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.727 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.728 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.728 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.728 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.728 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.728 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.728 INFO:teuthology.orchestra.run.smithi133.stdout: "ENABLE_BROWSABLE_API": { 2023-10-08T16:09:09.728 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-08T16:09:09.728 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.729 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.729 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.729 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.729 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.729 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.729 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.729 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.729 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.730 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.730 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.730 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.730 INFO:teuthology.orchestra.run.smithi133.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-08T16:09:09.730 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-08T16:09:09.730 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.730 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.731 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.731 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.731 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.731 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.731 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.731 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.731 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.731 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.732 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.732 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.732 INFO:teuthology.orchestra.run.smithi133.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-08T16:09:09.732 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-08T16:09:09.732 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.732 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.732 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.732 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.733 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.733 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.733 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.733 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.733 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.733 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.733 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.734 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.734 INFO:teuthology.orchestra.run.smithi133.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-08T16:09:09.734 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-08T16:09:09.734 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.734 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.734 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.734 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.735 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.735 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.735 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.735 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.735 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.735 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.735 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.735 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.736 INFO:teuthology.orchestra.run.smithi133.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-08T16:09:09.736 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-08T16:09:09.736 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.736 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.736 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.736 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.736 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.737 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.737 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.737 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.737 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.737 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.737 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.737 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.737 INFO:teuthology.orchestra.run.smithi133.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-08T16:09:09.738 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-08T16:09:09.738 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.738 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.738 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.738 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.738 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.738 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.739 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.739 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.739 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.739 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.739 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.739 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.739 INFO:teuthology.orchestra.run.smithi133.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-08T16:09:09.740 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-08T16:09:09.740 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.740 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.740 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.740 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.740 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.740 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.740 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.741 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.741 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.741 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.741 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.741 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.741 INFO:teuthology.orchestra.run.smithi133.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-08T16:09:09.741 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-08T16:09:09.742 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.742 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.742 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.742 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.742 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.742 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.742 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.742 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.743 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.743 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.743 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.743 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.743 INFO:teuthology.orchestra.run.smithi133.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-08T16:09:09.743 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-08T16:09:09.743 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.744 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.744 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.744 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.744 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.744 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.744 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.744 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.744 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.745 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.745 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.745 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.745 INFO:teuthology.orchestra.run.smithi133.stdout: "GRAFANA_API_PASSWORD": { 2023-10-08T16:09:09.745 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-08T16:09:09.745 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.745 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.746 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.746 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "admin", 2023-10-08T16:09:09.746 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.746 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.746 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.746 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.746 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.747 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.747 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.747 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.747 INFO:teuthology.orchestra.run.smithi133.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-08T16:09:09.747 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-08T16:09:09.747 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.747 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.747 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.748 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.748 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.748 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.748 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.748 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.748 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.748 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.748 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.749 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.749 INFO:teuthology.orchestra.run.smithi133.stdout: "GRAFANA_API_URL": { 2023-10-08T16:09:09.749 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "GRAFANA_API_URL", 2023-10-08T16:09:09.749 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.749 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.749 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.749 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.750 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.750 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.750 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.750 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.750 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.750 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.750 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.750 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.751 INFO:teuthology.orchestra.run.smithi133.stdout: "GRAFANA_API_USERNAME": { 2023-10-08T16:09:09.751 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-08T16:09:09.751 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.751 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.751 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.751 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "admin", 2023-10-08T16:09:09.751 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.751 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.752 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.752 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.752 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.752 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.752 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.752 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.752 INFO:teuthology.orchestra.run.smithi133.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-08T16:09:09.753 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-08T16:09:09.753 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.753 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.753 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.753 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.753 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.753 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.753 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.754 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.754 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.754 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.754 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.754 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.754 INFO:teuthology.orchestra.run.smithi133.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-08T16:09:09.754 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-08T16:09:09.754 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.755 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.755 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.755 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.755 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.755 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.755 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.755 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.756 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.756 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.756 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.756 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.756 INFO:teuthology.orchestra.run.smithi133.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-08T16:09:09.756 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-08T16:09:09.756 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.757 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.757 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.757 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.757 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.757 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.757 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.757 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.757 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.758 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.758 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.758 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.758 INFO:teuthology.orchestra.run.smithi133.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-08T16:09:09.758 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-08T16:09:09.758 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.758 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.759 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.759 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.759 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.759 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.759 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.759 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.759 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.759 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.760 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.760 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.760 INFO:teuthology.orchestra.run.smithi133.stdout: "PROMETHEUS_API_HOST": { 2023-10-08T16:09:09.760 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-08T16:09:09.760 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.760 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.760 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.760 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.761 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.761 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.761 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.761 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.761 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.761 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.761 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.761 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.762 INFO:teuthology.orchestra.run.smithi133.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-08T16:09:09.762 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-08T16:09:09.762 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.762 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.762 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.762 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.762 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.762 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.763 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.763 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.763 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.763 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.763 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.763 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.763 INFO:teuthology.orchestra.run.smithi133.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-08T16:09:09.764 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-08T16:09:09.764 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.764 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.764 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.764 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.764 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.764 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.764 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.765 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.765 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.765 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.765 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.765 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.765 INFO:teuthology.orchestra.run.smithi133.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-08T16:09:09.765 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-08T16:09:09.765 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.766 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.766 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.766 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.766 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.766 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.766 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.766 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.766 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.767 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.767 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.767 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.767 INFO:teuthology.orchestra.run.smithi133.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-08T16:09:09.767 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-08T16:09:09.767 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.767 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.767 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.768 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.768 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.768 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.768 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.768 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.768 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.768 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.769 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.769 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.769 INFO:teuthology.orchestra.run.smithi133.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-08T16:09:09.769 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-08T16:09:09.769 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.769 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.769 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.769 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.770 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.770 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.770 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.770 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.770 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.770 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.770 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.771 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.771 INFO:teuthology.orchestra.run.smithi133.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-08T16:09:09.771 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-08T16:09:09.771 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.771 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.771 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.771 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.771 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.772 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.772 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.772 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.772 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.772 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.772 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.772 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.773 INFO:teuthology.orchestra.run.smithi133.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-08T16:09:09.773 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-08T16:09:09.773 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.773 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.773 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.773 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.773 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.773 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.774 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.774 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.774 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.774 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.774 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.774 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.774 INFO:teuthology.orchestra.run.smithi133.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-08T16:09:09.775 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-08T16:09:09.775 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.775 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.775 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.775 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.775 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.775 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.776 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.776 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.776 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.776 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.776 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.776 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.776 INFO:teuthology.orchestra.run.smithi133.stdout: "PWD_POLICY_ENABLED": { 2023-10-08T16:09:09.776 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-08T16:09:09.777 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.777 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.777 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.777 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.777 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.777 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.777 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.778 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.778 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.778 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.778 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.778 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.778 INFO:teuthology.orchestra.run.smithi133.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-08T16:09:09.778 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-08T16:09:09.779 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.779 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.779 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.779 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-08T16:09:09.779 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.779 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.779 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.780 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.780 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.780 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.780 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.780 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.780 INFO:teuthology.orchestra.run.smithi133.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-08T16:09:09.780 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-08T16:09:09.781 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.781 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.781 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.781 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "10", 2023-10-08T16:09:09.781 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.781 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.781 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.781 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.782 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.782 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.782 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.782 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.782 INFO:teuthology.orchestra.run.smithi133.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-08T16:09:09.782 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-08T16:09:09.782 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.782 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.783 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.783 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "8", 2023-10-08T16:09:09.783 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.783 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.783 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.783 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.783 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.783 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.784 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.784 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.784 INFO:teuthology.orchestra.run.smithi133.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-08T16:09:09.784 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-08T16:09:09.784 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.784 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.784 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.784 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "45", 2023-10-08T16:09:09.785 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.785 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.785 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.785 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.785 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.785 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.785 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.785 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.786 INFO:teuthology.orchestra.run.smithi133.stdout: "RGW_API_ACCESS_KEY": { 2023-10-08T16:09:09.786 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-08T16:09:09.786 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.786 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.786 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.786 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.786 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.786 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.787 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.787 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.787 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.787 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.787 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.787 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.787 INFO:teuthology.orchestra.run.smithi133.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-08T16:09:09.788 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-08T16:09:09.788 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.788 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.788 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.788 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "admin", 2023-10-08T16:09:09.788 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.788 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.788 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.789 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.789 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.789 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.789 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.789 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.789 INFO:teuthology.orchestra.run.smithi133.stdout: "RGW_API_SECRET_KEY": { 2023-10-08T16:09:09.789 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-08T16:09:09.789 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.790 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.790 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.790 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.790 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.790 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.790 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.790 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.791 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.791 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.791 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.791 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.791 INFO:teuthology.orchestra.run.smithi133.stdout: "RGW_API_SSL_VERIFY": { 2023-10-08T16:09:09.791 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-08T16:09:09.791 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.791 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.792 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.792 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.792 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.792 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.792 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.792 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.792 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.792 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.793 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.793 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.793 INFO:teuthology.orchestra.run.smithi133.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-08T16:09:09.793 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-08T16:09:09.793 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.793 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.793 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.794 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "0", 2023-10-08T16:09:09.794 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.794 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.794 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.794 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.794 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.794 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.794 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.795 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.795 INFO:teuthology.orchestra.run.smithi133.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-08T16:09:09.795 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-08T16:09:09.795 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.795 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.795 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.795 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "10", 2023-10-08T16:09:09.795 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.796 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.796 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.796 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.796 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.796 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.796 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.796 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.796 INFO:teuthology.orchestra.run.smithi133.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-08T16:09:09.797 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-08T16:09:09.797 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.797 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.797 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.797 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "5", 2023-10-08T16:09:09.797 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.797 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.797 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.798 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.798 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.798 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.798 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.798 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.798 INFO:teuthology.orchestra.run.smithi133.stdout: "cross_origin_url": { 2023-10-08T16:09:09.798 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "cross_origin_url", 2023-10-08T16:09:09.799 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.799 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.799 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.799 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.799 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.799 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.799 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.799 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.800 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.800 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.800 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.800 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.800 INFO:teuthology.orchestra.run.smithi133.stdout: "crt_file": { 2023-10-08T16:09:09.800 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "crt_file", 2023-10-08T16:09:09.800 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.800 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.801 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.801 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.801 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.801 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.801 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.801 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.801 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.801 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.802 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.802 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.802 INFO:teuthology.orchestra.run.smithi133.stdout: "debug": { 2023-10-08T16:09:09.802 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "debug", 2023-10-08T16:09:09.802 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.802 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.802 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.803 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.803 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.803 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.803 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.803 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Enable/disable debug options", 2023-10-08T16:09:09.803 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.803 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.803 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.804 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.804 INFO:teuthology.orchestra.run.smithi133.stdout: "jwt_token_ttl": { 2023-10-08T16:09:09.804 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "jwt_token_ttl", 2023-10-08T16:09:09.804 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.804 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.804 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.804 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "28800", 2023-10-08T16:09:09.804 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.805 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.805 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.805 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.805 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.805 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.805 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.805 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.805 INFO:teuthology.orchestra.run.smithi133.stdout: "key_file": { 2023-10-08T16:09:09.806 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "key_file", 2023-10-08T16:09:09.806 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.806 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.806 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.806 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.806 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.806 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.807 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.807 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.807 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.807 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.807 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.807 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.807 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.807 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.808 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.808 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.808 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.808 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.808 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.808 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.808 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.808 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.809 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.809 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.809 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.809 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.809 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.809 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.809 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.810 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.810 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.810 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.810 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.810 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.810 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.810 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.810 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.811 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.811 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.811 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.811 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.811 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.811 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.811 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.811 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.812 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.812 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.812 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.812 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.812 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.812 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.812 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.813 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.813 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.813 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.813 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.813 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.813 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.813 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.813 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.814 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.814 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.814 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.814 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.814 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.814 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.814 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.815 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.815 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.815 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.815 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.815 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.815 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.815 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.815 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.816 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.816 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.816 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.816 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.816 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.816 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.816 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.817 INFO:teuthology.orchestra.run.smithi133.stdout: "motd": { 2023-10-08T16:09:09.817 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "motd", 2023-10-08T16:09:09.817 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.817 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.817 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.817 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.817 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.818 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.818 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.818 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "The message of the day", 2023-10-08T16:09:09.818 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.818 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.818 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.818 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.818 INFO:teuthology.orchestra.run.smithi133.stdout: "redirect_resolve_ip_addr": { 2023-10-08T16:09:09.819 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "redirect_resolve_ip_addr", 2023-10-08T16:09:09.819 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.819 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.819 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.819 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.819 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.819 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.819 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.820 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.820 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.820 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.820 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.820 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.820 INFO:teuthology.orchestra.run.smithi133.stdout: "server_addr": { 2023-10-08T16:09:09.820 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "server_addr", 2023-10-08T16:09:09.821 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.821 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.821 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.821 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "::", 2023-10-08T16:09:09.821 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.821 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.821 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.821 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.822 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.822 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.822 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.822 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.822 INFO:teuthology.orchestra.run.smithi133.stdout: "server_port": { 2023-10-08T16:09:09.822 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "server_port", 2023-10-08T16:09:09.822 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.822 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.823 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.823 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "8080", 2023-10-08T16:09:09.823 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.823 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.823 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.823 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.823 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.823 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.824 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.824 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.824 INFO:teuthology.orchestra.run.smithi133.stdout: "ssl": { 2023-10-08T16:09:09.824 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "ssl", 2023-10-08T16:09:09.824 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.824 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.824 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.824 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.825 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.825 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.825 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.825 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.825 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.825 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.825 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.825 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.826 INFO:teuthology.orchestra.run.smithi133.stdout: "ssl_server_port": { 2023-10-08T16:09:09.826 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "ssl_server_port", 2023-10-08T16:09:09.826 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.826 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.826 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.826 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "8443", 2023-10-08T16:09:09.826 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.827 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.827 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.827 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.827 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.827 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.827 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.827 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.827 INFO:teuthology.orchestra.run.smithi133.stdout: "standby_behaviour": { 2023-10-08T16:09:09.828 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "standby_behaviour", 2023-10-08T16:09:09.828 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.828 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.828 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.828 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "redirect", 2023-10-08T16:09:09.828 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.828 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.828 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.829 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.829 INFO:teuthology.orchestra.run.smithi133.stdout: "redirect" 2023-10-08T16:09:09.829 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.829 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.829 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.829 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.829 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.830 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.830 INFO:teuthology.orchestra.run.smithi133.stdout: "standby_error_status_code": { 2023-10-08T16:09:09.830 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "standby_error_status_code", 2023-10-08T16:09:09.830 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.830 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.830 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.830 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "500", 2023-10-08T16:09:09.830 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "400", 2023-10-08T16:09:09.831 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "599", 2023-10-08T16:09:09.831 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.831 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.831 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.831 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.831 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.831 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.831 INFO:teuthology.orchestra.run.smithi133.stdout: "url_prefix": { 2023-10-08T16:09:09.832 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "url_prefix", 2023-10-08T16:09:09.832 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.832 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.832 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.832 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.832 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.832 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.832 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.833 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.833 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.833 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.833 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.833 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.833 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.833 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.834 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.834 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "devicehealth", 2023-10-08T16:09:09.834 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.834 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.834 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.834 INFO:teuthology.orchestra.run.smithi133.stdout: "enable_monitoring": { 2023-10-08T16:09:09.834 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "enable_monitoring", 2023-10-08T16:09:09.834 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.835 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.835 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.835 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.835 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.835 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.835 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.835 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "monitor device health metrics", 2023-10-08T16:09:09.836 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.836 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.836 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.836 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.836 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.836 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.836 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.836 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.837 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.837 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.837 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.837 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.837 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.837 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.837 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.837 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.838 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.838 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.838 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.838 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.838 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.838 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.838 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.838 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.839 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.839 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.839 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.839 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.839 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.839 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.839 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.839 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.840 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.840 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.840 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.840 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.840 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.840 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.840 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.840 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.841 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.841 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.841 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.841 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.841 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.841 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.841 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.841 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.842 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.842 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.842 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.842 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.842 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.842 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.842 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.843 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.843 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.843 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.843 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.843 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.843 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.843 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.843 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.845 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.845 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.845 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.845 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.845 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.846 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.846 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.846 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.846 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.846 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.846 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.846 INFO:teuthology.orchestra.run.smithi133.stdout: "mark_out_threshold": { 2023-10-08T16:09:09.847 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "mark_out_threshold", 2023-10-08T16:09:09.847 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.847 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.847 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.847 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "2419200", 2023-10-08T16:09:09.847 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.847 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.847 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.848 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-08T16:09:09.848 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.848 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.848 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.848 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.848 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": { 2023-10-08T16:09:09.848 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "pool_name", 2023-10-08T16:09:09.849 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.849 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.849 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.849 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "device_health_metrics", 2023-10-08T16:09:09.849 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.849 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.849 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.849 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-08T16:09:09.850 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.850 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.850 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.850 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.850 INFO:teuthology.orchestra.run.smithi133.stdout: "retention_period": { 2023-10-08T16:09:09.850 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "retention_period", 2023-10-08T16:09:09.850 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.851 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.851 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.851 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "15552000", 2023-10-08T16:09:09.851 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.851 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.851 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.851 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "how long to retain device health metrics", 2023-10-08T16:09:09.851 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.852 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.852 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.852 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.852 INFO:teuthology.orchestra.run.smithi133.stdout: "scrape_frequency": { 2023-10-08T16:09:09.852 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "scrape_frequency", 2023-10-08T16:09:09.852 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.852 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.853 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.853 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "86400", 2023-10-08T16:09:09.853 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.853 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.853 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.853 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-08T16:09:09.853 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.853 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.854 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.854 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.854 INFO:teuthology.orchestra.run.smithi133.stdout: "self_heal": { 2023-10-08T16:09:09.854 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "self_heal", 2023-10-08T16:09:09.854 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.854 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.854 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.854 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.855 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.855 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.855 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.855 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-08T16:09:09.855 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.855 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.855 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.856 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.856 INFO:teuthology.orchestra.run.smithi133.stdout: "sleep_interval": { 2023-10-08T16:09:09.856 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "sleep_interval", 2023-10-08T16:09:09.856 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.856 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.856 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.856 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "600", 2023-10-08T16:09:09.856 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.857 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.857 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.857 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "how frequently to wake up and check device health", 2023-10-08T16:09:09.857 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.857 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.857 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.857 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.858 INFO:teuthology.orchestra.run.smithi133.stdout: "warn_threshold": { 2023-10-08T16:09:09.858 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "warn_threshold", 2023-10-08T16:09:09.858 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.858 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.858 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.858 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "7257600", 2023-10-08T16:09:09.858 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.858 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.859 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.859 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-08T16:09:09.859 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.859 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.859 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.859 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.859 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.860 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.860 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.860 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "influx", 2023-10-08T16:09:09.860 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": false, 2023-10-08T16:09:09.860 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "influxdb python module not found", 2023-10-08T16:09:09.860 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.860 INFO:teuthology.orchestra.run.smithi133.stdout: "batch_size": { 2023-10-08T16:09:09.860 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "batch_size", 2023-10-08T16:09:09.861 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.861 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.861 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.861 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "5000", 2023-10-08T16:09:09.861 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.861 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.861 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.861 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-08T16:09:09.862 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.862 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.862 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.862 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.862 INFO:teuthology.orchestra.run.smithi133.stdout: "database": { 2023-10-08T16:09:09.862 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "database", 2023-10-08T16:09:09.862 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.863 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.863 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.863 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "ceph", 2023-10-08T16:09:09.863 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.863 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.863 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.863 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-08T16:09:09.863 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.864 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.864 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.864 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.864 INFO:teuthology.orchestra.run.smithi133.stdout: "hostname": { 2023-10-08T16:09:09.864 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "hostname", 2023-10-08T16:09:09.864 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.864 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.864 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.865 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.865 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.865 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.865 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.865 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "InfluxDB server hostname", 2023-10-08T16:09:09.865 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.865 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.865 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.866 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.866 INFO:teuthology.orchestra.run.smithi133.stdout: "interval": { 2023-10-08T16:09:09.866 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "interval", 2023-10-08T16:09:09.866 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.866 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.866 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.866 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "30", 2023-10-08T16:09:09.867 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "5", 2023-10-08T16:09:09.867 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.867 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.867 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-08T16:09:09.867 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.867 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.867 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.867 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.868 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.868 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.868 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.868 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.868 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.868 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.868 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.868 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.869 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.869 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.869 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.869 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.869 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.869 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.869 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.869 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.870 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.870 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.870 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.870 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.870 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.870 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.870 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.871 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.871 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.871 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.871 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.871 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.871 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.871 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.871 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.872 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.872 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.872 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.872 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.872 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.872 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.872 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.872 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.873 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.873 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.873 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.873 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.873 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.873 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.873 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.873 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.874 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.874 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.874 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.874 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.874 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.874 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.874 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.875 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.875 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.875 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.875 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.875 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.875 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.875 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.875 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.876 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.876 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.876 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.876 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.876 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.876 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.876 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.876 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.877 INFO:teuthology.orchestra.run.smithi133.stdout: "password": { 2023-10-08T16:09:09.877 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "password", 2023-10-08T16:09:09.877 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.877 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.877 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.877 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.877 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.877 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.878 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.878 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "password of InfluxDB server user", 2023-10-08T16:09:09.878 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.878 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.878 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.878 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.878 INFO:teuthology.orchestra.run.smithi133.stdout: "port": { 2023-10-08T16:09:09.879 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "port", 2023-10-08T16:09:09.879 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.879 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.879 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.879 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "8086", 2023-10-08T16:09:09.879 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.879 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.879 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.880 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "InfluxDB server port", 2023-10-08T16:09:09.880 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.880 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.880 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.880 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.880 INFO:teuthology.orchestra.run.smithi133.stdout: "ssl": { 2023-10-08T16:09:09.880 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "ssl", 2023-10-08T16:09:09.880 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.881 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.881 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.881 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "false", 2023-10-08T16:09:09.881 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.881 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.881 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.881 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T16:09:09.881 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.882 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.882 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.882 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.882 INFO:teuthology.orchestra.run.smithi133.stdout: "threads": { 2023-10-08T16:09:09.882 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "threads", 2023-10-08T16:09:09.882 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.883 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.883 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.883 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "5", 2023-10-08T16:09:09.883 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "1", 2023-10-08T16:09:09.884 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "32", 2023-10-08T16:09:09.884 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.884 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-08T16:09:09.884 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.884 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.884 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.884 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.884 INFO:teuthology.orchestra.run.smithi133.stdout: "username": { 2023-10-08T16:09:09.885 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "username", 2023-10-08T16:09:09.885 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.885 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.885 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.885 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.885 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.885 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.886 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.886 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "username of InfluxDB server user", 2023-10-08T16:09:09.886 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.886 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.886 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.886 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.886 INFO:teuthology.orchestra.run.smithi133.stdout: "verify_ssl": { 2023-10-08T16:09:09.886 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "verify_ssl", 2023-10-08T16:09:09.887 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.887 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.887 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.887 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "true", 2023-10-08T16:09:09.887 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.887 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.887 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.887 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T16:09:09.888 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.888 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.888 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.888 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.888 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.888 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.888 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.889 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "insights", 2023-10-08T16:09:09.889 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.889 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.889 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.889 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.889 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.889 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.889 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.890 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.890 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.890 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.890 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.890 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.890 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.890 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.890 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.891 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.891 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.891 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.891 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.891 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.891 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.891 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.892 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.892 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.892 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.892 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.892 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.892 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.892 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.892 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.893 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.893 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.893 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.893 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.893 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.893 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.893 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.893 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.894 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.894 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.894 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.894 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.894 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.894 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.894 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.894 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.895 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.895 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.895 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.895 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.895 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.895 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.895 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.895 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.896 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.896 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.896 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.896 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.896 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.896 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.896 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.897 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.897 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.897 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.897 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.897 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.897 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.897 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.897 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.898 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.898 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.898 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.898 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.898 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.898 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.898 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.898 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "iostat", 2023-10-08T16:09:09.899 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.899 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.899 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.899 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.899 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.899 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.900 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.900 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.900 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.900 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.900 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.900 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.900 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.900 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.901 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.901 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.901 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.901 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.901 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.901 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.901 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.901 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.902 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.902 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.902 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.902 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.902 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.902 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.902 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.903 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.903 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.903 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.903 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.903 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.903 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.903 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.903 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.904 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.904 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.904 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.904 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.904 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.904 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.904 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.904 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.905 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.905 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.905 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.905 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.905 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.905 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.905 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.905 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.906 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.906 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.906 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.906 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.906 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.906 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.906 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.907 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.907 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.907 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.907 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.907 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.907 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.907 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.908 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.908 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.908 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.908 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.908 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.908 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.908 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.908 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.909 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.909 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "localpool", 2023-10-08T16:09:09.909 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.909 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.909 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.909 INFO:teuthology.orchestra.run.smithi133.stdout: "failure_domain": { 2023-10-08T16:09:09.909 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "failure_domain", 2023-10-08T16:09:09.909 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.910 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.910 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.910 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "host", 2023-10-08T16:09:09.910 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.910 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.910 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.911 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "failure domain for any created local pool", 2023-10-08T16:09:09.911 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-08T16:09:09.911 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.911 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.911 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.911 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.911 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.911 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.912 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.912 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.912 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.912 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.912 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.912 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.912 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.912 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.913 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.913 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.913 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.913 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.913 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.913 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.913 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.913 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.914 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.914 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.914 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.914 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.914 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.914 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.914 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.914 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.915 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.915 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.915 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.915 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.915 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.915 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.915 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.915 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.916 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.916 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.916 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.916 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.916 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.916 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.916 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.916 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.917 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.917 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.917 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.917 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.917 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.917 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.917 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.918 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.918 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.918 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.918 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.918 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.918 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.918 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.919 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.919 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.919 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.919 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.919 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.919 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.919 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.920 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.920 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.920 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.920 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.920 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.920 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.920 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": { 2023-10-08T16:09:09.920 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "min_size", 2023-10-08T16:09:09.921 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.921 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.921 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.921 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.921 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.921 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.921 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.922 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "default min_size for any created local pool", 2023-10-08T16:09:09.922 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-08T16:09:09.922 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.922 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.922 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.922 INFO:teuthology.orchestra.run.smithi133.stdout: "num_rep": { 2023-10-08T16:09:09.922 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "num_rep", 2023-10-08T16:09:09.922 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.923 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.923 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.923 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "3", 2023-10-08T16:09:09.923 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.923 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.923 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.923 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "default replica count for any created local pool", 2023-10-08T16:09:09.923 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.924 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.924 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.924 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.924 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": { 2023-10-08T16:09:09.924 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "pg_num", 2023-10-08T16:09:09.924 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:09.924 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.924 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.925 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "128", 2023-10-08T16:09:09.925 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.925 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.925 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.925 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "default pg_num for any created local pool", 2023-10-08T16:09:09.925 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.925 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.925 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.926 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.926 INFO:teuthology.orchestra.run.smithi133.stdout: "prefix": { 2023-10-08T16:09:09.926 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "prefix", 2023-10-08T16:09:09.926 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.926 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.926 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.926 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.927 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.927 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.927 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.927 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "name prefix for any created local pool", 2023-10-08T16:09:09.927 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.927 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.927 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.927 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.928 INFO:teuthology.orchestra.run.smithi133.stdout: "subtree": { 2023-10-08T16:09:09.928 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "subtree", 2023-10-08T16:09:09.928 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.928 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.928 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.928 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "rack", 2023-10-08T16:09:09.928 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.928 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.929 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.929 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-08T16:09:09.929 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-08T16:09:09.929 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.929 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.929 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.929 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.929 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.930 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.930 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "mirroring", 2023-10-08T16:09:09.930 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.930 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.930 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.930 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.930 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.931 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.931 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.931 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.931 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.931 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.931 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.931 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.931 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.932 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.932 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.932 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.932 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.932 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.932 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.932 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.932 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.933 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.933 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.933 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.933 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.933 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.933 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.933 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.933 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.934 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.934 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.934 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.934 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.934 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.934 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.934 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.935 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.935 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.935 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.935 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.935 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.935 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.935 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.935 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.936 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.936 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.936 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.936 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.936 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.936 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.936 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.936 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.937 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.937 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.937 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.937 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.937 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.937 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.937 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.937 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.938 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.938 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.938 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.938 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.938 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.938 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.938 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.938 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.939 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.939 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.939 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.939 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.939 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.939 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.939 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.939 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.940 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "nfs", 2023-10-08T16:09:09.940 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.940 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.940 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.940 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.940 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.940 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.941 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.941 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.941 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.941 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.941 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.941 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.941 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.941 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.942 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.942 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.942 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.942 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.942 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.942 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.942 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.942 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.943 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.943 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.943 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.943 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.943 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.943 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.943 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.943 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.944 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.944 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.944 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.944 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.944 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.944 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.944 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.944 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.945 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.945 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.945 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.945 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.945 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.945 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.945 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.945 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.946 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.946 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.946 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.946 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.946 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.946 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.946 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.947 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.947 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.947 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.947 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.947 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.947 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.947 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.947 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.948 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.948 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.948 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.948 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.948 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.948 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.948 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.948 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.949 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.949 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.949 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.949 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.949 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.949 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.949 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.949 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "orchestrator", 2023-10-08T16:09:09.950 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.950 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.950 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.950 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.950 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.950 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.950 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.951 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.951 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.951 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.951 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.951 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.951 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.951 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.952 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.952 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.952 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.952 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.952 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.952 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.952 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.952 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.953 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.953 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.953 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.953 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.953 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.953 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.953 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.953 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.954 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.954 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.954 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.954 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.954 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.954 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.954 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.954 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.955 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.955 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.955 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.955 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.955 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.955 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.955 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.955 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.956 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.956 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.956 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.956 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.956 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.956 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.956 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.956 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.957 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.957 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.957 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.957 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.957 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.957 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.957 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.957 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.958 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.958 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.958 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.958 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.958 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.958 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.958 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.959 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.959 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.959 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.959 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.959 INFO:teuthology.orchestra.run.smithi133.stdout: "orchestrator": { 2023-10-08T16:09:09.959 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "orchestrator", 2023-10-08T16:09:09.959 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.959 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.960 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.960 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.960 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.960 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.960 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.960 INFO:teuthology.orchestra.run.smithi133.stdout: "cephadm", 2023-10-08T16:09:09.960 INFO:teuthology.orchestra.run.smithi133.stdout: "rook", 2023-10-08T16:09:09.960 INFO:teuthology.orchestra.run.smithi133.stdout: "test_orchestrator" 2023-10-08T16:09:09.961 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.961 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Orchestrator backend", 2023-10-08T16:09:09.961 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.961 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.961 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.961 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.961 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.961 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.962 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.962 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "osd_perf_query", 2023-10-08T16:09:09.962 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.962 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.962 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.962 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.962 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.962 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.963 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.963 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.963 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.963 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.963 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.963 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.963 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.963 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.964 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.964 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.964 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.964 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.964 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.964 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.964 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.964 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.965 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.965 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.965 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.965 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.965 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.965 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.965 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.966 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.966 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.966 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.966 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.966 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.966 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.966 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.966 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.967 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.967 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.967 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.967 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.967 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.967 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.967 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.967 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.968 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.968 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.968 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.968 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.968 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.968 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.968 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.968 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.969 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.969 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.969 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.969 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.969 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.969 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.969 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.969 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.970 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.970 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.970 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.970 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.970 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.970 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.970 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.971 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.971 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.971 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.971 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.971 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.971 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.971 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.971 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.972 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "osd_support", 2023-10-08T16:09:09.972 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.972 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.972 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.972 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.972 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.972 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.972 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.973 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.973 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.973 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.973 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.973 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.973 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.973 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.973 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.974 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.974 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.974 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.974 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.974 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.974 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.974 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.974 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.975 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.975 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.975 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.975 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.975 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.975 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.975 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.976 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.976 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.976 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.976 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.976 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.976 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.976 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.976 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.977 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.977 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.977 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.977 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.977 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.977 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.977 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.977 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.978 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.978 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.978 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.978 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.978 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.978 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.978 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.979 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.979 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.979 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.979 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.979 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.979 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.979 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.980 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.980 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.980 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.980 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.980 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.980 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.980 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.980 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.981 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.981 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.981 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.981 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.981 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.981 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.981 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.981 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.982 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "pg_autoscaler", 2023-10-08T16:09:09.982 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.982 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.982 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.982 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:09.982 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:09.982 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.983 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.983 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.983 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:09.983 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.983 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.983 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.983 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.983 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.984 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.984 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.984 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.984 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.984 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.984 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.984 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.984 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.985 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.985 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.985 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:09.985 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:09.985 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.985 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.985 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.986 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.986 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.986 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.986 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.986 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.986 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.986 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.986 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.987 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.987 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:09.987 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:09.987 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:09.987 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.987 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.987 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:09.988 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.988 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.988 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:09.988 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:09.988 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:09.988 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:09.988 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:09.989 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:09.989 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:09.989 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:09.989 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.989 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.989 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.989 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.989 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.990 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:09.990 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:09.990 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.990 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.990 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.990 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.990 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.990 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.991 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.991 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.991 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.991 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.991 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.991 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.991 INFO:teuthology.orchestra.run.smithi133.stdout: "sleep_interval": { 2023-10-08T16:09:09.991 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "sleep_interval", 2023-10-08T16:09:09.992 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:09.992 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.992 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.992 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "60", 2023-10-08T16:09:09.992 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.992 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.992 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.992 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.993 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.993 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.993 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.993 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.993 INFO:teuthology.orchestra.run.smithi133.stdout: "threshold": { 2023-10-08T16:09:09.993 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "threshold", 2023-10-08T16:09:09.993 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "float", 2023-10-08T16:09:09.994 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.994 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.994 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "3.0", 2023-10-08T16:09:09.994 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "1.0", 2023-10-08T16:09:09.994 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.994 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.994 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "scaling threshold", 2023-10-08T16:09:09.994 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-08T16:09:09.995 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.995 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.995 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.995 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:09.995 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.995 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:09.995 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "progress", 2023-10-08T16:09:09.995 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:09.996 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:09.996 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:09.996 INFO:teuthology.orchestra.run.smithi133.stdout: "allow_pg_recovery_event": { 2023-10-08T16:09:09.996 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "allow_pg_recovery_event", 2023-10-08T16:09:09.996 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.996 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.996 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:09.996 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:09.997 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.997 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.997 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.997 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-08T16:09:09.997 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.997 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.997 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.998 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.998 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": { 2023-10-08T16:09:09.998 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "enabled", 2023-10-08T16:09:09.998 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:09.998 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:09.998 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:09.998 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:09.998 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:09.999 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:09.999 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:09.999 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:09.999 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:09.999 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:09.999 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:09.999 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:09.999 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:10.000 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:10.000 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.000 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.000 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.000 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.000 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.000 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.000 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:10.001 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:10.001 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:10.001 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:10.001 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:10.001 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:10.001 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:10.001 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:10.002 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.002 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.002 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.002 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.002 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.002 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:10.002 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:10.003 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.003 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.003 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.003 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.003 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.003 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.003 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.003 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.004 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.004 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.004 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.004 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.004 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:10.004 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:10.004 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.005 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.005 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.005 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:10.005 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.005 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.005 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:10.005 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:10.005 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:10.006 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:10.006 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:10.006 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:10.006 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:10.006 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:10.006 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.006 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.007 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.007 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.007 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.007 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:10.007 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:10.007 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.007 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.007 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.008 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.008 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.008 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.008 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.008 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.008 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.008 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.009 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.009 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.009 INFO:teuthology.orchestra.run.smithi133.stdout: "max_completed_events": { 2023-10-08T16:09:10.009 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "max_completed_events", 2023-10-08T16:09:10.009 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:10.009 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.009 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.009 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "50", 2023-10-08T16:09:10.010 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.010 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.010 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.010 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "number of past completed events to remember", 2023-10-08T16:09:10.010 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.010 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.010 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.010 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.011 INFO:teuthology.orchestra.run.smithi133.stdout: "sleep_interval": { 2023-10-08T16:09:10.011 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "sleep_interval", 2023-10-08T16:09:10.011 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:10.011 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.011 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.011 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "5", 2023-10-08T16:09:10.011 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.012 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.012 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.012 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "how long the module is going to sleep", 2023-10-08T16:09:10.012 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.012 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.012 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.012 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:10.012 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:10.013 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.013 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:10.013 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "prometheus", 2023-10-08T16:09:10.013 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:10.013 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:10.013 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:10.013 INFO:teuthology.orchestra.run.smithi133.stdout: "cache": { 2023-10-08T16:09:10.014 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "cache", 2023-10-08T16:09:10.014 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.014 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.014 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.014 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:10.014 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.014 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.015 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.015 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.015 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.015 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.015 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.015 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.015 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:10.016 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:10.016 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.016 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.016 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.016 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.016 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.016 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.016 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:10.017 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:10.017 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:10.017 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:10.017 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:10.017 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:10.017 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:10.017 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:10.017 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.018 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.018 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.018 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.018 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.018 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:10.018 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:10.018 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.019 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.019 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.019 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.019 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.019 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.019 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.019 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.019 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.020 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.020 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.020 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.020 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:10.020 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:10.020 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.020 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.020 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.021 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:10.021 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.021 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.021 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:10.021 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:10.021 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:10.021 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:10.022 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:10.022 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:10.022 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:10.022 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:10.022 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.022 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.022 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.022 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.023 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.023 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:10.023 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:10.023 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.023 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.023 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.023 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.023 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.024 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.024 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.024 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.024 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.024 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.024 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.024 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.025 INFO:teuthology.orchestra.run.smithi133.stdout: "rbd_stats_pools": { 2023-10-08T16:09:10.025 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "rbd_stats_pools", 2023-10-08T16:09:10.025 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.025 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.025 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.025 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.025 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.025 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.026 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.026 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.026 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.026 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.026 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.026 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.026 INFO:teuthology.orchestra.run.smithi133.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-08T16:09:10.026 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-08T16:09:10.027 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:10.027 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.027 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.027 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "300", 2023-10-08T16:09:10.027 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.027 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.027 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.027 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.028 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.028 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.028 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.028 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.028 INFO:teuthology.orchestra.run.smithi133.stdout: "scrape_interval": { 2023-10-08T16:09:10.028 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "scrape_interval", 2023-10-08T16:09:10.028 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "float", 2023-10-08T16:09:10.028 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.029 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.029 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "15.0", 2023-10-08T16:09:10.029 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.029 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.029 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.029 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.029 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.030 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.030 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.030 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.030 INFO:teuthology.orchestra.run.smithi133.stdout: "server_addr": { 2023-10-08T16:09:10.030 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "server_addr", 2023-10-08T16:09:10.030 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.030 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.030 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.031 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "::", 2023-10-08T16:09:10.031 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.031 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.031 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.031 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-08T16:09:10.031 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.031 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.031 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.032 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.032 INFO:teuthology.orchestra.run.smithi133.stdout: "server_port": { 2023-10-08T16:09:10.032 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "server_port", 2023-10-08T16:09:10.032 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:10.032 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.032 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.032 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "9283", 2023-10-08T16:09:10.033 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.033 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.033 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.033 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-08T16:09:10.033 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.033 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.033 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.033 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.034 INFO:teuthology.orchestra.run.smithi133.stdout: "stale_cache_strategy": { 2023-10-08T16:09:10.034 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "stale_cache_strategy", 2023-10-08T16:09:10.034 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.034 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.034 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.034 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "log", 2023-10-08T16:09:10.034 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.034 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.035 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.035 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.035 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.035 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.035 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.035 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.035 INFO:teuthology.orchestra.run.smithi133.stdout: "standby_behaviour": { 2023-10-08T16:09:10.035 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "standby_behaviour", 2023-10-08T16:09:10.036 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.036 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.036 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.036 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "default", 2023-10-08T16:09:10.036 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.036 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.036 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:10.036 INFO:teuthology.orchestra.run.smithi133.stdout: "default", 2023-10-08T16:09:10.037 INFO:teuthology.orchestra.run.smithi133.stdout: "error" 2023-10-08T16:09:10.037 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:10.037 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.037 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.037 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.037 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.037 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.037 INFO:teuthology.orchestra.run.smithi133.stdout: "standby_error_status_code": { 2023-10-08T16:09:10.038 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "standby_error_status_code", 2023-10-08T16:09:10.038 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:10.038 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.038 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.038 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "500", 2023-10-08T16:09:10.038 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "400", 2023-10-08T16:09:10.038 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "599", 2023-10-08T16:09:10.039 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.039 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.039 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.039 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.039 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.039 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:10.039 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:10.039 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.040 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:10.040 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "rbd_support", 2023-10-08T16:09:10.040 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:10.040 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:10.040 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:10.040 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:10.040 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:10.040 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.041 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.041 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.041 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.041 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.041 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.041 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:10.041 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:10.041 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:10.042 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:10.042 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:10.042 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:10.042 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:10.042 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:10.042 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.042 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.043 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.043 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.043 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:10.043 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:10.043 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.043 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.043 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.044 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.044 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.044 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.044 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.044 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.044 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.044 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.044 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.045 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.045 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:10.045 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:10.045 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.045 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.045 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.045 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:10.045 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.046 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.046 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:10.046 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:10.046 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:10.046 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:10.046 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:10.046 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:10.047 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:10.047 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:10.047 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.049 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.049 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.049 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.049 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:10.050 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:10.050 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.050 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.050 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.050 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.050 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.050 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.050 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.051 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.051 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.051 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.051 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.051 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.051 INFO:teuthology.orchestra.run.smithi133.stdout: "max_concurrent_snap_create": { 2023-10-08T16:09:10.051 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "max_concurrent_snap_create", 2023-10-08T16:09:10.051 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:10.052 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.052 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.052 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "10", 2023-10-08T16:09:10.052 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.052 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.052 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.052 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.052 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.053 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.053 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.053 INFO:teuthology.orchestra.run.smithi133.stdout: "mirror_snapshot_schedule": { 2023-10-08T16:09:10.053 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "mirror_snapshot_schedule", 2023-10-08T16:09:10.053 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.053 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.054 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.054 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.054 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.054 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.054 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.054 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.054 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.054 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.055 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.055 INFO:teuthology.orchestra.run.smithi133.stdout: "trash_purge_schedule": { 2023-10-08T16:09:10.055 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "trash_purge_schedule", 2023-10-08T16:09:10.055 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.055 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.055 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.055 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.056 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.056 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.056 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.056 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.056 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.056 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.056 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.057 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:10.057 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:10.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:10.057 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "restful", 2023-10-08T16:09:10.057 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:10.057 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:10.057 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:10.058 INFO:teuthology.orchestra.run.smithi133.stdout: "enable_auth": { 2023-10-08T16:09:10.058 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "enable_auth", 2023-10-08T16:09:10.058 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.058 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.058 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.058 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:10.058 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.058 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.059 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.059 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.059 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.059 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.059 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.059 INFO:teuthology.orchestra.run.smithi133.stdout: "key_file": { 2023-10-08T16:09:10.059 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "key_file", 2023-10-08T16:09:10.060 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.060 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.060 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.060 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.060 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.060 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.060 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.060 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.061 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.061 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.061 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.061 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:10.061 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:10.061 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.062 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.062 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.062 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.062 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.062 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.062 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:10.062 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:10.062 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:10.063 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:10.063 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:10.063 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:10.063 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:10.063 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:10.063 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.063 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.063 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.064 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.064 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:10.064 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:10.064 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.064 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.064 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.065 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.065 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.065 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.065 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.065 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.065 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.065 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.065 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.066 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:10.066 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:10.066 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.066 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.066 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.066 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:10.066 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.067 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.067 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:10.067 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:10.067 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:10.067 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:10.067 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:10.067 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:10.068 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:10.068 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:10.068 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.068 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.068 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.068 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.068 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.068 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:10.069 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:10.069 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.069 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.069 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.069 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.069 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.069 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.070 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.070 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.070 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.070 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.070 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.070 INFO:teuthology.orchestra.run.smithi133.stdout: "server_addr": { 2023-10-08T16:09:10.070 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "server_addr", 2023-10-08T16:09:10.071 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.071 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.071 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.071 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.071 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.071 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.071 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.071 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.072 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.072 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.072 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.072 INFO:teuthology.orchestra.run.smithi133.stdout: "server_port": { 2023-10-08T16:09:10.072 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "server_port", 2023-10-08T16:09:10.072 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.072 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.073 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.073 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.073 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.073 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.073 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.073 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.073 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.074 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.074 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.074 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:10.074 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:10.074 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.074 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:10.074 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "selftest", 2023-10-08T16:09:10.074 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:10.075 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:10.075 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:10.075 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:10.075 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:10.075 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.075 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.075 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.075 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.076 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.076 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.076 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:10.076 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:10.076 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:10.076 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:10.076 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:10.076 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:10.077 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:10.077 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:10.077 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.077 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.077 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.077 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.078 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:10.078 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:10.078 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.078 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.078 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.078 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.078 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.078 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.079 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.079 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.079 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.079 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.079 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.079 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:10.080 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:10.080 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.080 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.080 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.080 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:10.080 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.080 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.080 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:10.081 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:10.081 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:10.081 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:10.081 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:10.081 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:10.081 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:10.081 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:10.081 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.082 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.082 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.082 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.082 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:10.082 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:10.082 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.082 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.083 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.083 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.083 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.083 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.083 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.083 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.083 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.084 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.084 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.084 INFO:teuthology.orchestra.run.smithi133.stdout: "roption1": { 2023-10-08T16:09:10.084 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "roption1", 2023-10-08T16:09:10.084 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.084 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.084 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.085 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.085 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.085 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.085 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.085 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.085 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.085 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.085 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.086 INFO:teuthology.orchestra.run.smithi133.stdout: "roption2": { 2023-10-08T16:09:10.086 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "roption2", 2023-10-08T16:09:10.086 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.086 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.086 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.086 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "xyz", 2023-10-08T16:09:10.087 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.087 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.087 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.087 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.087 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.087 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.087 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.088 INFO:teuthology.orchestra.run.smithi133.stdout: "rwoption1": { 2023-10-08T16:09:10.088 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "rwoption1", 2023-10-08T16:09:10.088 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.088 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.088 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.088 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.088 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.088 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.089 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.089 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.089 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.089 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.089 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.089 INFO:teuthology.orchestra.run.smithi133.stdout: "rwoption2": { 2023-10-08T16:09:10.090 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "rwoption2", 2023-10-08T16:09:10.090 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:10.090 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.090 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.090 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.090 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.090 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.090 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.091 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.091 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.091 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.091 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.091 INFO:teuthology.orchestra.run.smithi133.stdout: "rwoption3": { 2023-10-08T16:09:10.091 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "rwoption3", 2023-10-08T16:09:10.091 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "float", 2023-10-08T16:09:10.092 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.092 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.092 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.092 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.092 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.092 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.092 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.092 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.093 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.093 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.093 INFO:teuthology.orchestra.run.smithi133.stdout: "rwoption4": { 2023-10-08T16:09:10.093 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "rwoption4", 2023-10-08T16:09:10.093 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.093 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.094 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.094 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.094 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.094 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.094 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.094 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.094 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.094 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.095 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.095 INFO:teuthology.orchestra.run.smithi133.stdout: "rwoption5": { 2023-10-08T16:09:10.095 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "rwoption5", 2023-10-08T16:09:10.095 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.095 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.095 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.095 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.096 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.096 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.096 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.096 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.096 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.096 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.096 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.097 INFO:teuthology.orchestra.run.smithi133.stdout: "rwoption6": { 2023-10-08T16:09:10.097 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "rwoption6", 2023-10-08T16:09:10.097 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.097 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.097 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.097 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:10.097 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.098 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.098 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.098 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.098 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.098 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.098 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.098 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.098 INFO:teuthology.orchestra.run.smithi133.stdout: "rwoption7": { 2023-10-08T16:09:10.099 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "rwoption7", 2023-10-08T16:09:10.099 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:10.099 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.099 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.099 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.099 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "1", 2023-10-08T16:09:10.099 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "42", 2023-10-08T16:09:10.099 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.100 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.100 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.100 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.100 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.100 INFO:teuthology.orchestra.run.smithi133.stdout: "testkey": { 2023-10-08T16:09:10.100 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "testkey", 2023-10-08T16:09:10.100 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.101 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.101 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.101 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.101 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.101 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.101 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.101 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.102 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.102 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.102 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.102 INFO:teuthology.orchestra.run.smithi133.stdout: "testlkey": { 2023-10-08T16:09:10.102 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "testlkey", 2023-10-08T16:09:10.102 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.102 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.103 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.103 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.103 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.103 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.103 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.103 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.103 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.103 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.104 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.104 INFO:teuthology.orchestra.run.smithi133.stdout: "testnewline": { 2023-10-08T16:09:10.104 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "testnewline", 2023-10-08T16:09:10.104 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.104 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.104 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.104 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.105 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.105 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.105 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.105 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.105 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.105 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.105 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.105 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:10.106 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:10.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:10.106 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "snap_schedule", 2023-10-08T16:09:10.106 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:10.106 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:10.106 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:10.107 INFO:teuthology.orchestra.run.smithi133.stdout: "allow_m_granularity": { 2023-10-08T16:09:10.107 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "allow_m_granularity", 2023-10-08T16:09:10.107 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.107 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.107 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.107 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.107 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.107 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.108 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.108 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "allow minute scheduled snapshots", 2023-10-08T16:09:10.108 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.108 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.108 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.108 INFO:teuthology.orchestra.run.smithi133.stdout: "dump_on_update": { 2023-10-08T16:09:10.109 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "dump_on_update", 2023-10-08T16:09:10.109 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.109 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.109 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.109 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.109 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.109 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.109 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.110 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "dump database to debug log on update", 2023-10-08T16:09:10.110 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.110 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.110 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.110 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:10.110 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:10.110 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.111 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.111 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.111 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.111 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.111 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.111 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:10.111 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:10.111 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:10.112 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:10.112 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:10.112 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:10.112 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:10.112 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:10.112 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.112 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.113 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.113 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.113 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:10.113 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:10.113 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.113 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.113 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.114 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.114 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.114 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.114 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.114 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.114 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.114 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.114 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.115 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:10.115 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:10.115 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.115 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.115 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.115 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:10.115 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.116 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.116 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:10.116 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:10.116 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:10.116 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:10.116 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:10.116 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:10.117 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:10.117 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:10.117 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.117 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.117 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.117 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.117 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:10.118 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:10.118 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.118 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.118 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.118 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.118 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.118 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.118 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.119 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.119 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.119 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.119 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.119 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:10.119 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:10.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:10.120 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "stats", 2023-10-08T16:09:10.120 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:10.120 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:10.120 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:10.120 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:10.120 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:10.120 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.121 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.121 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.121 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.121 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.121 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.121 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:10.121 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:10.121 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:10.122 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:10.122 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:10.122 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:10.122 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:10.122 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:10.122 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.122 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.123 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.123 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.123 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:10.123 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:10.123 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.123 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.123 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.124 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.124 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.124 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.124 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.124 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.124 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.124 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.124 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.125 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:10.125 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:10.125 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.125 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.125 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.125 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:10.125 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.126 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.126 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:10.126 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:10.126 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:10.126 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:10.126 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:10.126 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:10.127 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:10.127 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:10.127 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.127 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.127 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.127 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.127 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.127 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:10.128 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:10.128 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.128 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.128 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.128 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.128 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.128 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.128 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.129 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.129 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.129 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.129 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.129 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:10.129 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:10.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:10.130 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "status", 2023-10-08T16:09:10.130 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:10.130 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:10.130 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:10.130 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:10.130 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:10.130 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.130 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.131 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.131 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.131 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.131 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.131 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:10.131 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:10.131 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:10.132 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:10.132 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:10.132 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:10.132 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:10.132 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:10.132 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.132 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.132 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.133 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.133 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:10.133 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:10.133 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.133 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.133 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.133 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.134 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.134 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.134 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.134 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.134 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.134 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.134 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.135 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:10.135 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:10.135 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.135 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.135 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.135 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:10.135 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.135 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.136 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:10.136 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:10.136 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:10.136 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:10.136 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:10.136 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:10.136 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:10.136 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:10.137 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.137 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.137 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.137 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.137 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:10.137 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:10.138 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.138 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.138 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.138 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.138 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.138 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.138 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.138 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.139 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.139 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.139 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.139 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:10.139 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:10.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:10.139 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "telegraf", 2023-10-08T16:09:10.140 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:10.140 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:10.140 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:10.140 INFO:teuthology.orchestra.run.smithi133.stdout: "address": { 2023-10-08T16:09:10.140 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "address", 2023-10-08T16:09:10.140 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.140 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.141 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.141 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-08T16:09:10.141 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.141 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.141 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.141 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.141 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.141 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.142 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.142 INFO:teuthology.orchestra.run.smithi133.stdout: "interval": { 2023-10-08T16:09:10.142 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "interval", 2023-10-08T16:09:10.142 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:10.142 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.142 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.142 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "15", 2023-10-08T16:09:10.143 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.143 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.143 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.143 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.143 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.143 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.143 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.144 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:10.144 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:10.144 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.144 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.144 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.144 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.144 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.144 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.145 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:10.145 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:10.145 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:10.145 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:10.145 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:10.145 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:10.145 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:10.145 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:10.146 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.146 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.146 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.146 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.146 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:10.146 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:10.147 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.147 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.147 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.147 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.147 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.147 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.147 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.147 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.148 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.148 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.148 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.148 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:10.148 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:10.148 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.148 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.149 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.149 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:10.149 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.149 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.149 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:10.149 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:10.149 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:10.150 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:10.150 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:10.150 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:10.150 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:10.150 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:10.150 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.150 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.150 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.151 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.151 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:10.151 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:10.151 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.151 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.151 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.151 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.152 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.152 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.152 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.152 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.152 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.152 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.152 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.152 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:10.153 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:10.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:10.153 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "telemetry", 2023-10-08T16:09:10.153 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:10.153 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:10.153 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:10.153 INFO:teuthology.orchestra.run.smithi133.stdout: "channel_basic": { 2023-10-08T16:09:10.154 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "channel_basic", 2023-10-08T16:09:10.154 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.154 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.154 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.154 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:10.154 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.154 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.155 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.155 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-08T16:09:10.155 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.155 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.155 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.155 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.155 INFO:teuthology.orchestra.run.smithi133.stdout: "channel_crash": { 2023-10-08T16:09:10.155 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "channel_crash", 2023-10-08T16:09:10.156 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.156 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.156 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.156 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:10.156 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.156 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.156 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.156 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-08T16:09:10.157 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.157 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.157 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.157 INFO:teuthology.orchestra.run.smithi133.stdout: "channel_device": { 2023-10-08T16:09:10.157 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "channel_device", 2023-10-08T16:09:10.157 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.158 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.158 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.158 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "True", 2023-10-08T16:09:10.158 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.158 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.158 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.158 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-08T16:09:10.158 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.159 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.159 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.159 INFO:teuthology.orchestra.run.smithi133.stdout: "channel_ident": { 2023-10-08T16:09:10.159 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "channel_ident", 2023-10-08T16:09:10.159 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.159 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.159 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.160 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.160 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.160 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.160 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.160 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-08T16:09:10.160 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.160 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.160 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.161 INFO:teuthology.orchestra.run.smithi133.stdout: "channel_perf": { 2023-10-08T16:09:10.161 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "channel_perf", 2023-10-08T16:09:10.161 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.161 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.161 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.161 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.161 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.162 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.162 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.162 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-08T16:09:10.162 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.162 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.162 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.163 INFO:teuthology.orchestra.run.smithi133.stdout: "contact": { 2023-10-08T16:09:10.163 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "contact", 2023-10-08T16:09:10.163 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.163 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.163 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.163 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.163 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.163 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.164 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.164 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.164 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.164 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.164 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.164 INFO:teuthology.orchestra.run.smithi133.stdout: "description": { 2023-10-08T16:09:10.164 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "description", 2023-10-08T16:09:10.165 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.165 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.165 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.165 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.165 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.166 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.166 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.166 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.166 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.166 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.166 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.166 INFO:teuthology.orchestra.run.smithi133.stdout: "device_url": { 2023-10-08T16:09:10.167 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "device_url", 2023-10-08T16:09:10.167 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.167 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.167 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.167 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-08T16:09:10.167 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.167 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.167 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.168 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.168 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.168 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.168 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.168 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": { 2023-10-08T16:09:10.168 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "enabled", 2023-10-08T16:09:10.168 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.169 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.169 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.169 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.169 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.169 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.169 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.170 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.170 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.170 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.170 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.170 INFO:teuthology.orchestra.run.smithi133.stdout: "interval": { 2023-10-08T16:09:10.170 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "interval", 2023-10-08T16:09:10.171 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:10.171 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.171 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.171 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "24", 2023-10-08T16:09:10.171 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "8", 2023-10-08T16:09:10.171 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.171 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.171 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.172 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.172 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.172 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.172 INFO:teuthology.orchestra.run.smithi133.stdout: "last_opt_revision": { 2023-10-08T16:09:10.172 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "last_opt_revision", 2023-10-08T16:09:10.172 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:10.172 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.173 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.173 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "1", 2023-10-08T16:09:10.173 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.173 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.173 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.173 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.173 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.174 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.174 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.174 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.174 INFO:teuthology.orchestra.run.smithi133.stdout: "leaderboard": { 2023-10-08T16:09:10.174 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "leaderboard", 2023-10-08T16:09:10.174 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.174 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.174 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.175 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.175 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.175 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.175 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.175 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.175 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.175 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.175 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.176 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:10.176 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:10.176 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.176 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.176 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.176 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.177 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.177 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.177 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:10.177 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:10.177 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:10.177 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:10.177 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:10.177 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:10.178 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:10.178 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:10.178 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.178 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.178 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.178 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.178 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:10.179 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:10.179 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.179 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.179 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.179 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.179 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.179 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.179 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.180 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.180 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.180 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.180 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.180 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:10.180 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:10.180 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.181 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.181 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.181 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:10.181 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.181 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.181 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:10.181 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:10.182 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:10.182 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:10.182 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:10.182 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:10.182 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:10.182 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:10.182 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.182 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.183 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.183 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.183 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:10.183 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:10.183 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.183 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.183 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.184 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.184 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.184 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.184 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.184 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.184 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.184 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.184 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.185 INFO:teuthology.orchestra.run.smithi133.stdout: "organization": { 2023-10-08T16:09:10.185 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "organization", 2023-10-08T16:09:10.185 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.185 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.185 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.185 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.185 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.186 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.186 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.186 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.186 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.186 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.186 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.186 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.186 INFO:teuthology.orchestra.run.smithi133.stdout: "proxy": { 2023-10-08T16:09:10.187 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "proxy", 2023-10-08T16:09:10.187 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.187 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.187 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.187 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.187 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.187 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.188 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.188 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.188 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.188 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.188 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.188 INFO:teuthology.orchestra.run.smithi133.stdout: "url": { 2023-10-08T16:09:10.188 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "url", 2023-10-08T16:09:10.189 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.189 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.189 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.189 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-08T16:09:10.189 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.189 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.189 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.189 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.190 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.190 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.215 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.215 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:10.216 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:10.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:10.216 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "test_orchestrator", 2023-10-08T16:09:10.216 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:10.216 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:10.216 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:10.216 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:10.217 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:10.217 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.217 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.217 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.217 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.217 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.217 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.217 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:10.218 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:10.218 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:10.218 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:10.218 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:10.218 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:10.218 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:10.218 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:10.219 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.219 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.219 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.219 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.219 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:10.219 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:10.219 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.220 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.220 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.220 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.220 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.220 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.220 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.220 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.220 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.221 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.221 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.221 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:10.221 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:10.221 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.221 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.221 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.222 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:10.222 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.222 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.222 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:10.222 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:10.222 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:10.222 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:10.223 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:10.223 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:10.223 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:10.223 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:10.223 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.223 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.223 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.223 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.224 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:10.224 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:10.224 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.224 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.224 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.224 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.224 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.225 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.225 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.225 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.225 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.245 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.245 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.246 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:10.246 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:10.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:10.246 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "volumes", 2023-10-08T16:09:10.246 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:10.246 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:10.247 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:10.247 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:10.247 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:10.247 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.247 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.247 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.247 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:10.248 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.248 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.248 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:10.248 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:10.248 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:10.248 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:10.248 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:10.249 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:10.249 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:10.249 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:10.249 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.250 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.250 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.250 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.251 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.251 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:10.251 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:10.251 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.253 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.253 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.254 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.254 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.254 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.255 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.255 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.255 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.255 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.256 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.256 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.256 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:10.256 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:10.257 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:10.257 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.257 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.257 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:10.258 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.258 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.258 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:10.258 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:10.258 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:10.258 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:10.259 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:10.259 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:10.259 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:10.259 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:10.259 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.259 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.259 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.260 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.260 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.260 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:10.260 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:10.260 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:10.261 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.261 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:10.261 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:10.261 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:10.261 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:10.261 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:10.261 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:10.261 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:10.262 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:10.262 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:10.262 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:10.262 INFO:teuthology.orchestra.run.smithi133.stdout: "max_concurrent_clones": { 2023-10-08T16:09:10.262 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "max_concurrent_clones", 2023-10-08T16:09:10.262 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:10.263 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:10.263 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:10.263 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "4", 2023-10-08T16:09:10.263 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:11.298 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:11.298 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:11.298 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-08T16:09:11.299 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:11.299 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:11.299 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:11.299 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:11.300 INFO:teuthology.orchestra.run.smithi133.stdout: "snapshot_clone_delay": { 2023-10-08T16:09:11.300 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "snapshot_clone_delay", 2023-10-08T16:09:11.301 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:11.301 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:11.301 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:11.302 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "0", 2023-10-08T16:09:11.302 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:11.302 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:11.302 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:11.302 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-08T16:09:11.302 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:11.302 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:11.303 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:11.303 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:11.303 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:11.303 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:11.303 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:11.303 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "zabbix", 2023-10-08T16:09:11.303 INFO:teuthology.orchestra.run.smithi133.stdout: "can_run": true, 2023-10-08T16:09:11.304 INFO:teuthology.orchestra.run.smithi133.stdout: "error_string": "", 2023-10-08T16:09:11.304 INFO:teuthology.orchestra.run.smithi133.stdout: "module_options": { 2023-10-08T16:09:11.304 INFO:teuthology.orchestra.run.smithi133.stdout: "discovery_interval": { 2023-10-08T16:09:11.304 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "discovery_interval", 2023-10-08T16:09:11.304 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "uint", 2023-10-08T16:09:11.304 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:11.304 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:11.305 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "100", 2023-10-08T16:09:11.305 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:11.305 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:11.305 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:11.305 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:11.305 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:11.306 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:11.306 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:11.306 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:11.306 INFO:teuthology.orchestra.run.smithi133.stdout: "identifier": { 2023-10-08T16:09:11.306 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "identifier", 2023-10-08T16:09:11.306 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:11.307 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:11.307 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:11.307 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:11.307 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:11.307 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:11.307 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:11.307 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:11.308 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:11.308 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:11.308 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:11.310 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:11.310 INFO:teuthology.orchestra.run.smithi133.stdout: "interval": { 2023-10-08T16:09:11.311 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "interval", 2023-10-08T16:09:11.311 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "secs", 2023-10-08T16:09:11.311 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:11.312 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:11.312 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "60", 2023-10-08T16:09:11.312 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:11.312 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:11.313 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:11.313 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:11.313 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:11.313 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:11.314 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:11.314 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:11.314 INFO:teuthology.orchestra.run.smithi133.stdout: "log_level": { 2023-10-08T16:09:11.314 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_level", 2023-10-08T16:09:11.314 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:11.315 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:11.315 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:11.315 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:11.315 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:11.315 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:11.316 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:11.316 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:11.316 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:11.316 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:11.317 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:11.317 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:11.317 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:11.317 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:11.318 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:11.318 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:11.318 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:11.318 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:11.319 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:11.319 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster": { 2023-10-08T16:09:11.319 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster", 2023-10-08T16:09:11.319 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:11.319 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:11.320 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:11.320 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:11.320 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:11.320 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:11.321 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:11.321 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:11.321 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:11.321 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:11.322 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:11.322 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:11.322 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_cluster_level": { 2023-10-08T16:09:11.322 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_cluster_level", 2023-10-08T16:09:11.323 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:11.323 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:11.323 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:11.323 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "info", 2023-10-08T16:09:11.323 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:11.323 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:11.323 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [ 2023-10-08T16:09:11.324 INFO:teuthology.orchestra.run.smithi133.stdout: "", 2023-10-08T16:09:11.324 INFO:teuthology.orchestra.run.smithi133.stdout: "critical", 2023-10-08T16:09:11.324 INFO:teuthology.orchestra.run.smithi133.stdout: "debug", 2023-10-08T16:09:11.324 INFO:teuthology.orchestra.run.smithi133.stdout: "error", 2023-10-08T16:09:11.324 INFO:teuthology.orchestra.run.smithi133.stdout: "info", 2023-10-08T16:09:11.324 INFO:teuthology.orchestra.run.smithi133.stdout: "warning" 2023-10-08T16:09:11.324 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:11.325 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:11.325 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:11.325 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:11.325 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:11.325 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:11.325 INFO:teuthology.orchestra.run.smithi133.stdout: "log_to_file": { 2023-10-08T16:09:11.325 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "log_to_file", 2023-10-08T16:09:11.326 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "bool", 2023-10-08T16:09:11.326 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:11.326 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2023-10-08T16:09:11.326 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "False", 2023-10-08T16:09:11.326 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:11.326 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:11.327 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:11.327 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:11.327 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:11.327 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:11.328 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:11.328 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:11.328 INFO:teuthology.orchestra.run.smithi133.stdout: "zabbix_host": { 2023-10-08T16:09:11.328 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "zabbix_host", 2023-10-08T16:09:11.329 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:11.329 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:11.329 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:11.329 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "", 2023-10-08T16:09:11.330 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:11.330 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:11.330 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:11.330 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:11.331 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:11.331 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:11.331 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:11.331 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:11.331 INFO:teuthology.orchestra.run.smithi133.stdout: "zabbix_port": { 2023-10-08T16:09:11.332 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "zabbix_port", 2023-10-08T16:09:11.332 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "int", 2023-10-08T16:09:11.332 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:11.332 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:11.332 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "10051", 2023-10-08T16:09:11.333 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:11.333 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:11.333 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:11.333 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:11.333 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:11.334 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:11.334 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:11.334 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:11.334 INFO:teuthology.orchestra.run.smithi133.stdout: "zabbix_sender": { 2023-10-08T16:09:11.334 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "zabbix_sender", 2023-10-08T16:09:11.335 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "str", 2023-10-08T16:09:11.335 INFO:teuthology.orchestra.run.smithi133.stdout: "level": "advanced", 2023-10-08T16:09:11.335 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 0, 2023-10-08T16:09:11.335 INFO:teuthology.orchestra.run.smithi133.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-08T16:09:11.335 INFO:teuthology.orchestra.run.smithi133.stdout: "min": "", 2023-10-08T16:09:11.335 INFO:teuthology.orchestra.run.smithi133.stdout: "max": "", 2023-10-08T16:09:11.335 INFO:teuthology.orchestra.run.smithi133.stdout: "enum_allowed": [], 2023-10-08T16:09:11.336 INFO:teuthology.orchestra.run.smithi133.stdout: "desc": "", 2023-10-08T16:09:11.336 INFO:teuthology.orchestra.run.smithi133.stdout: "long_desc": "", 2023-10-08T16:09:11.336 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2023-10-08T16:09:11.336 INFO:teuthology.orchestra.run.smithi133.stdout: "see_also": [] 2023-10-08T16:09:11.336 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:11.336 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:11.336 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:11.337 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:11.337 INFO:teuthology.orchestra.run.smithi133.stdout: "services": {}, 2023-10-08T16:09:11.337 INFO:teuthology.orchestra.run.smithi133.stdout: "always_on_modules": { 2023-10-08T16:09:11.337 INFO:teuthology.orchestra.run.smithi133.stdout: "octopus": [ 2023-10-08T16:09:11.337 INFO:teuthology.orchestra.run.smithi133.stdout: "balancer", 2023-10-08T16:09:11.337 INFO:teuthology.orchestra.run.smithi133.stdout: "crash", 2023-10-08T16:09:11.337 INFO:teuthology.orchestra.run.smithi133.stdout: "devicehealth", 2023-10-08T16:09:11.338 INFO:teuthology.orchestra.run.smithi133.stdout: "orchestrator", 2023-10-08T16:09:11.338 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscaler", 2023-10-08T16:09:11.338 INFO:teuthology.orchestra.run.smithi133.stdout: "progress", 2023-10-08T16:09:11.338 INFO:teuthology.orchestra.run.smithi133.stdout: "rbd_support", 2023-10-08T16:09:11.338 INFO:teuthology.orchestra.run.smithi133.stdout: "status", 2023-10-08T16:09:11.338 INFO:teuthology.orchestra.run.smithi133.stdout: "telemetry", 2023-10-08T16:09:11.338 INFO:teuthology.orchestra.run.smithi133.stdout: "volumes" 2023-10-08T16:09:11.339 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:11.339 INFO:teuthology.orchestra.run.smithi133.stdout: "pacific": [ 2023-10-08T16:09:11.339 INFO:teuthology.orchestra.run.smithi133.stdout: "balancer", 2023-10-08T16:09:11.339 INFO:teuthology.orchestra.run.smithi133.stdout: "crash", 2023-10-08T16:09:11.340 INFO:teuthology.orchestra.run.smithi133.stdout: "devicehealth", 2023-10-08T16:09:11.340 INFO:teuthology.orchestra.run.smithi133.stdout: "orchestrator", 2023-10-08T16:09:11.340 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscaler", 2023-10-08T16:09:11.340 INFO:teuthology.orchestra.run.smithi133.stdout: "progress", 2023-10-08T16:09:11.340 INFO:teuthology.orchestra.run.smithi133.stdout: "rbd_support", 2023-10-08T16:09:11.340 INFO:teuthology.orchestra.run.smithi133.stdout: "status", 2023-10-08T16:09:11.341 INFO:teuthology.orchestra.run.smithi133.stdout: "telemetry", 2023-10-08T16:09:11.341 INFO:teuthology.orchestra.run.smithi133.stdout: "volumes" 2023-10-08T16:09:11.341 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2023-10-08T16:09:11.341 INFO:teuthology.orchestra.run.smithi133.stdout: "quincy": [ 2023-10-08T16:09:11.341 INFO:teuthology.orchestra.run.smithi133.stdout: "balancer", 2023-10-08T16:09:11.342 INFO:teuthology.orchestra.run.smithi133.stdout: "crash", 2023-10-08T16:09:11.342 INFO:teuthology.orchestra.run.smithi133.stdout: "devicehealth", 2023-10-08T16:09:11.342 INFO:teuthology.orchestra.run.smithi133.stdout: "orchestrator", 2023-10-08T16:09:11.342 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscaler", 2023-10-08T16:09:11.342 INFO:teuthology.orchestra.run.smithi133.stdout: "progress", 2023-10-08T16:09:11.342 INFO:teuthology.orchestra.run.smithi133.stdout: "rbd_support", 2023-10-08T16:09:11.342 INFO:teuthology.orchestra.run.smithi133.stdout: "status", 2023-10-08T16:09:11.343 INFO:teuthology.orchestra.run.smithi133.stdout: "telemetry", 2023-10-08T16:09:11.343 INFO:teuthology.orchestra.run.smithi133.stdout: "volumes" 2023-10-08T16:09:11.343 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2023-10-08T16:09:11.343 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:11.343 INFO:teuthology.orchestra.run.smithi133.stdout: "last_failure_osd_epoch": 0, 2023-10-08T16:09:11.344 INFO:teuthology.orchestra.run.smithi133.stdout: "active_clients": [ 2023-10-08T16:09:11.344 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:11.344 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "devicehealth", 2023-10-08T16:09:11.344 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2023-10-08T16:09:11.345 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:11.345 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2023-10-08T16:09:11.345 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:0", 2023-10-08T16:09:11.345 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 672361375 2023-10-08T16:09:11.345 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:11.345 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2023-10-08T16:09:11.346 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:11.346 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:11.346 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "libcephsqlite", 2023-10-08T16:09:11.346 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2023-10-08T16:09:11.346 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:11.346 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2023-10-08T16:09:11.347 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:0", 2023-10-08T16:09:11.347 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 2824593171 2023-10-08T16:09:11.347 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:11.347 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2023-10-08T16:09:11.347 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:11.348 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:11.348 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "rbd_support", 2023-10-08T16:09:11.348 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2023-10-08T16:09:11.348 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:11.348 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2023-10-08T16:09:11.349 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:0", 2023-10-08T16:09:11.349 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 2460270600 2023-10-08T16:09:11.349 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:11.349 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2023-10-08T16:09:11.349 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:11.350 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:11.350 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "volumes", 2023-10-08T16:09:11.350 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2023-10-08T16:09:11.350 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-10-08T16:09:11.351 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2023-10-08T16:09:11.351 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:0", 2023-10-08T16:09:11.351 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 1411957691 2023-10-08T16:09:11.351 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:11.352 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2023-10-08T16:09:11.352 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:11.352 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2023-10-08T16:09:11.352 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-10-08T16:09:11.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.849+0000 7f8e1d43c700 1 -- 172.21.15.133:0/984952936 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f8df8060580 msgr2=0x7f8df8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:11.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.849+0000 7f8e1d43c700 1 --2- 172.21.15.133:0/984952936 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f8df8060580 0x7f8df8062a30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8e180b0d30 tx=0x7f8e00017000 comp rx=0 tx=0).stop 2023-10-08T16:09:11.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.849+0000 7f8e1d43c700 1 -- 172.21.15.133:0/984952936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e180680b0 msgr2=0x7f8e18132cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:11.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.849+0000 7f8e1d43c700 1 --2- 172.21.15.133:0/984952936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e180680b0 0x7f8e18132cb0 secure :-1 s=READY pgs=4348 cs=0 l=1 rev1=1 crypto rx=0x7f8e08009ef0 tx=0x7f8e0800b040 comp rx=0 tx=0).stop 2023-10-08T16:09:11.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.849+0000 7f8e1d43c700 1 -- 172.21.15.133:0/984952936 shutdown_connections 2023-10-08T16:09:11.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.849+0000 7f8e1d43c700 1 --2- 172.21.15.133:0/984952936 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f8df8060580 0x7f8df8062a30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:11.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.849+0000 7f8e1d43c700 1 --2- 172.21.15.133:0/984952936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e1813f830 0x7f8e18155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:11.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.849+0000 7f8e1d43c700 1 --2- 172.21.15.133:0/984952936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e180680b0 0x7f8e18132cb0 unknown :-1 s=CLOSED pgs=4348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:11.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.849+0000 7f8e1d43c700 1 --2- 172.21.15.133:0/984952936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e18067ce0 0x7f8e1806c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:11.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.849+0000 7f8e1d43c700 1 -- 172.21.15.133:0/984952936 >> 172.21.15.133:0/984952936 conn(0x7f8e180b4ba0 msgr2=0x7f8e18068570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:11.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.849+0000 7f8e1d43c700 1 -- 172.21.15.133:0/984952936 shutdown_connections 2023-10-08T16:09:11.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:08.849+0000 7f8e1d43c700 1 -- 172.21.15.133:0/984952936 wait complete. 2023-10-08T16:09:11.362 DEBUG:tasks.check_counter:Getting stats from a 2023-10-08T16:09:13.244 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump 2023-10-08T16:09:13.354 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-10-08T16:09:13.404 INFO:teuthology.orchestra.run.smithi133.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T16:09:13.404 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_messages": 31173, 2023-10-08T16:09:13.404 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages": 39281, 2023-10-08T16:09:13.404 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_bytes": 8857973, 2023-10-08T16:09:13.404 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_bytes": 34208973, 2023-10-08T16:09:13.404 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_created_connections": 711, 2023-10-08T16:09:13.405 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_active_connections": 4, 2023-10-08T16:09:13.405 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_total_time": 4.432600043, 2023-10-08T16:09:13.405 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_send_time": 1.751732597, 2023-10-08T16:09:13.405 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_recv_time": 1.904195969, 2023-10-08T16:09:13.405 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_fast_dispatch_time": 0.560003249, 2023-10-08T16:09:13.406 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T16:09:13.406 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 39279, 2023-10-08T16:09:13.406 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 9.987752705, 2023-10-08T16:09:13.406 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000254277 2023-10-08T16:09:13.406 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.406 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_handle_ack_lat": { 2023-10-08T16:09:13.406 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 35786, 2023-10-08T16:09:13.407 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.015928582, 2023-10-08T16:09:13.407 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000445 2023-10-08T16:09:13.407 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:13.407 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.407 INFO:teuthology.orchestra.run.smithi133.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T16:09:13.407 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_messages": 57925, 2023-10-08T16:09:13.407 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages": 91694, 2023-10-08T16:09:13.407 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_bytes": 17166488, 2023-10-08T16:09:13.408 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_bytes": 36301977, 2023-10-08T16:09:13.408 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_created_connections": 967, 2023-10-08T16:09:13.408 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_active_connections": 5, 2023-10-08T16:09:13.408 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_total_time": 8.373402271, 2023-10-08T16:09:13.408 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_send_time": 3.720735270, 2023-10-08T16:09:13.408 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_recv_time": 4.943254166, 2023-10-08T16:09:13.408 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_fast_dispatch_time": 0.318849835, 2023-10-08T16:09:13.408 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T16:09:13.409 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 91693, 2023-10-08T16:09:13.409 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 9.561004957, 2023-10-08T16:09:13.409 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000104271 2023-10-08T16:09:13.409 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.409 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_handle_ack_lat": { 2023-10-08T16:09:13.409 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 111900, 2023-10-08T16:09:13.409 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.037305726, 2023-10-08T16:09:13.410 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000333 2023-10-08T16:09:13.410 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:13.410 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.410 INFO:teuthology.orchestra.run.smithi133.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T16:09:13.410 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_messages": 36373, 2023-10-08T16:09:13.410 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages": 35177, 2023-10-08T16:09:13.410 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_bytes": 9081352, 2023-10-08T16:09:13.410 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_bytes": 67375507, 2023-10-08T16:09:13.411 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_created_connections": 632, 2023-10-08T16:09:13.411 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_active_connections": 4, 2023-10-08T16:09:13.411 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_total_time": 3.591656805, 2023-10-08T16:09:13.411 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_send_time": 1.176629210, 2023-10-08T16:09:13.411 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_recv_time": 1.030835396, 2023-10-08T16:09:13.411 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_fast_dispatch_time": 1.073076854, 2023-10-08T16:09:13.411 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T16:09:13.411 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 35177, 2023-10-08T16:09:13.412 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 20.961661377, 2023-10-08T16:09:13.412 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000595891 2023-10-08T16:09:13.412 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.412 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_handle_ack_lat": { 2023-10-08T16:09:13.412 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 6308, 2023-10-08T16:09:13.412 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.001534107, 2023-10-08T16:09:13.412 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000243 2023-10-08T16:09:13.413 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:13.413 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.413 INFO:teuthology.orchestra.run.smithi133.stdout: "cct": { 2023-10-08T16:09:13.413 INFO:teuthology.orchestra.run.smithi133.stdout: "total_workers": 1, 2023-10-08T16:09:13.413 INFO:teuthology.orchestra.run.smithi133.stdout: "unhealthy_workers": 0 2023-10-08T16:09:13.413 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.413 INFO:teuthology.orchestra.run.smithi133.stdout: "finisher-MDSRank": { 2023-10-08T16:09:13.413 INFO:teuthology.orchestra.run.smithi133.stdout: "queue_len": 0, 2023-10-08T16:09:13.414 INFO:teuthology.orchestra.run.smithi133.stdout: "complete_latency": { 2023-10-08T16:09:13.414 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 34443, 2023-10-08T16:09:13.414 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 18.654964443, 2023-10-08T16:09:13.414 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000541618 2023-10-08T16:09:13.414 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:13.414 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.414 INFO:teuthology.orchestra.run.smithi133.stdout: "finisher-PurgeQueue": { 2023-10-08T16:09:13.414 INFO:teuthology.orchestra.run.smithi133.stdout: "queue_len": 0, 2023-10-08T16:09:13.415 INFO:teuthology.orchestra.run.smithi133.stdout: "complete_latency": { 2023-10-08T16:09:13.415 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 2520, 2023-10-08T16:09:13.415 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.616330580, 2023-10-08T16:09:13.415 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000244575 2023-10-08T16:09:13.415 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:13.415 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.415 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": { 2023-10-08T16:09:13.416 INFO:teuthology.orchestra.run.smithi133.stdout: "request": 21643, 2023-10-08T16:09:13.416 INFO:teuthology.orchestra.run.smithi133.stdout: "reply": 21643, 2023-10-08T16:09:13.416 INFO:teuthology.orchestra.run.smithi133.stdout: "reply_latency": { 2023-10-08T16:09:13.416 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 21643, 2023-10-08T16:09:13.416 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 77.330859312, 2023-10-08T16:09:13.416 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.003573019 2023-10-08T16:09:13.416 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.416 INFO:teuthology.orchestra.run.smithi133.stdout: "slow_reply": 0, 2023-10-08T16:09:13.417 INFO:teuthology.orchestra.run.smithi133.stdout: "forward": 0, 2023-10-08T16:09:13.417 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_fetch": 0, 2023-10-08T16:09:13.417 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_commit": 94, 2023-10-08T16:09:13.417 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_split": 10, 2023-10-08T16:09:13.417 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_merge": 0, 2023-10-08T16:09:13.417 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes": 205, 2023-10-08T16:09:13.417 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_top": 0, 2023-10-08T16:09:13.417 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_bottom": 205, 2023-10-08T16:09:13.418 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_pin_tail": 0, 2023-10-08T16:09:13.418 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_pinned": 205, 2023-10-08T16:09:13.418 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_expired": 17, 2023-10-08T16:09:13.418 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_with_caps": 0, 2023-10-08T16:09:13.418 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": 0, 2023-10-08T16:09:13.418 INFO:teuthology.orchestra.run.smithi133.stdout: "subtrees": 2, 2023-10-08T16:09:13.418 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse": 24247, 2023-10-08T16:09:13.419 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_hit": 23598, 2023-10-08T16:09:13.419 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_forward": 0, 2023-10-08T16:09:13.419 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_discover": 0, 2023-10-08T16:09:13.419 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_dir_fetch": 0, 2023-10-08T16:09:13.419 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_remote_ino": 0, 2023-10-08T16:09:13.419 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_lock": 20, 2023-10-08T16:09:13.419 INFO:teuthology.orchestra.run.smithi133.stdout: "load_cent": 7714, 2023-10-08T16:09:13.419 INFO:teuthology.orchestra.run.smithi133.stdout: "q": 0, 2023-10-08T16:09:13.420 INFO:teuthology.orchestra.run.smithi133.stdout: "exported": 0, 2023-10-08T16:09:13.420 INFO:teuthology.orchestra.run.smithi133.stdout: "exported_inodes": 0, 2023-10-08T16:09:13.420 INFO:teuthology.orchestra.run.smithi133.stdout: "imported": 0, 2023-10-08T16:09:13.420 INFO:teuthology.orchestra.run.smithi133.stdout: "imported_inodes": 0, 2023-10-08T16:09:13.420 INFO:teuthology.orchestra.run.smithi133.stdout: "openino_dir_fetch": 0, 2023-10-08T16:09:13.420 INFO:teuthology.orchestra.run.smithi133.stdout: "openino_backtrace_fetch": 1016, 2023-10-08T16:09:13.420 INFO:teuthology.orchestra.run.smithi133.stdout: "openino_peer_discover": 0, 2023-10-08T16:09:13.420 INFO:teuthology.orchestra.run.smithi133.stdout: "root_rfiles": 145, 2023-10-08T16:09:13.421 INFO:teuthology.orchestra.run.smithi133.stdout: "root_rbytes": 16904814, 2023-10-08T16:09:13.421 INFO:teuthology.orchestra.run.smithi133.stdout: "root_rsnaps": 6, 2023-10-08T16:09:13.421 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_backtrace_fetch": 0, 2023-10-08T16:09:13.421 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_set_tag": 0, 2023-10-08T16:09:13.421 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T16:09:13.421 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_inotable_repaired": 0, 2023-10-08T16:09:13.421 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_dir_inodes": 0, 2023-10-08T16:09:13.422 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T16:09:13.422 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T16:09:13.422 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_file_inodes": 0, 2023-10-08T16:09:13.422 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_inode_file_caps": 0, 2023-10-08T16:09:13.422 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_cap_op_revoke": 34296, 2023-10-08T16:09:13.422 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_cap_op_grant": 24649, 2023-10-08T16:09:13.422 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_cap_op_trunc": 7, 2023-10-08T16:09:13.422 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T16:09:13.423 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_cap_op_flush_ack": 1, 2023-10-08T16:09:13.423 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_client_caps": 34395, 2023-10-08T16:09:13.423 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_client_caps_dirty": 2597, 2023-10-08T16:09:13.423 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_client_cap_release": 38, 2023-10-08T16:09:13.423 INFO:teuthology.orchestra.run.smithi133.stdout: "process_request_cap_release": 11110 2023-10-08T16:09:13.423 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.423 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_cache": { 2023-10-08T16:09:13.424 INFO:teuthology.orchestra.run.smithi133.stdout: "num_strays": 6, 2023-10-08T16:09:13.424 INFO:teuthology.orchestra.run.smithi133.stdout: "num_strays_delayed": 0, 2023-10-08T16:09:13.424 INFO:teuthology.orchestra.run.smithi133.stdout: "num_strays_enqueuing": 0, 2023-10-08T16:09:13.424 INFO:teuthology.orchestra.run.smithi133.stdout: "strays_created": 2781, 2023-10-08T16:09:13.424 INFO:teuthology.orchestra.run.smithi133.stdout: "strays_enqueued": 2772, 2023-10-08T16:09:13.424 INFO:teuthology.orchestra.run.smithi133.stdout: "strays_reintegrated": 10, 2023-10-08T16:09:13.424 INFO:teuthology.orchestra.run.smithi133.stdout: "strays_migrated": 0, 2023-10-08T16:09:13.424 INFO:teuthology.orchestra.run.smithi133.stdout: "num_recovering_processing": 0, 2023-10-08T16:09:13.425 INFO:teuthology.orchestra.run.smithi133.stdout: "num_recovering_enqueued": 0, 2023-10-08T16:09:13.425 INFO:teuthology.orchestra.run.smithi133.stdout: "num_recovering_prioritized": 0, 2023-10-08T16:09:13.425 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_started": 0, 2023-10-08T16:09:13.425 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_completed": 0, 2023-10-08T16:09:13.425 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T16:09:13.425 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_exportdir": 0, 2023-10-08T16:09:13.425 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_flush": 0, 2023-10-08T16:09:13.425 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_fragmentdir": 10, 2023-10-08T16:09:13.426 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_fragstats": 0, 2023-10-08T16:09:13.426 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_inodestats": 0 2023-10-08T16:09:13.426 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.426 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_log": { 2023-10-08T16:09:13.426 INFO:teuthology.orchestra.run.smithi133.stdout: "evadd": 28285, 2023-10-08T16:09:13.426 INFO:teuthology.orchestra.run.smithi133.stdout: "evex": 0, 2023-10-08T16:09:13.426 INFO:teuthology.orchestra.run.smithi133.stdout: "evtrm": 0, 2023-10-08T16:09:13.427 INFO:teuthology.orchestra.run.smithi133.stdout: "ev": 28285, 2023-10-08T16:09:13.427 INFO:teuthology.orchestra.run.smithi133.stdout: "evexg": 0, 2023-10-08T16:09:13.427 INFO:teuthology.orchestra.run.smithi133.stdout: "evexd": 0, 2023-10-08T16:09:13.427 INFO:teuthology.orchestra.run.smithi133.stdout: "segadd": 36, 2023-10-08T16:09:13.427 INFO:teuthology.orchestra.run.smithi133.stdout: "segex": 0, 2023-10-08T16:09:13.427 INFO:teuthology.orchestra.run.smithi133.stdout: "segtrm": 0, 2023-10-08T16:09:13.427 INFO:teuthology.orchestra.run.smithi133.stdout: "seg": 36, 2023-10-08T16:09:13.427 INFO:teuthology.orchestra.run.smithi133.stdout: "segexg": 0, 2023-10-08T16:09:13.428 INFO:teuthology.orchestra.run.smithi133.stdout: "segexd": 0, 2023-10-08T16:09:13.428 INFO:teuthology.orchestra.run.smithi133.stdout: "expos": 4194304, 2023-10-08T16:09:13.428 INFO:teuthology.orchestra.run.smithi133.stdout: "wrpos": 89036938, 2023-10-08T16:09:13.428 INFO:teuthology.orchestra.run.smithi133.stdout: "rdpos": 0, 2023-10-08T16:09:13.428 INFO:teuthology.orchestra.run.smithi133.stdout: "jlat": { 2023-10-08T16:09:13.428 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 17482, 2023-10-08T16:09:13.428 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 76.763320636, 2023-10-08T16:09:13.429 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.004390991 2023-10-08T16:09:13.429 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.429 INFO:teuthology.orchestra.run.smithi133.stdout: "replayed": 0 2023-10-08T16:09:13.429 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.429 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_mem": { 2023-10-08T16:09:13.429 INFO:teuthology.orchestra.run.smithi133.stdout: "ino": 196, 2023-10-08T16:09:13.429 INFO:teuthology.orchestra.run.smithi133.stdout: "ino+": 2968, 2023-10-08T16:09:13.429 INFO:teuthology.orchestra.run.smithi133.stdout: "ino-": 2772, 2023-10-08T16:09:13.430 INFO:teuthology.orchestra.run.smithi133.stdout: "dir": 50, 2023-10-08T16:09:13.430 INFO:teuthology.orchestra.run.smithi133.stdout: "dir+": 321, 2023-10-08T16:09:13.430 INFO:teuthology.orchestra.run.smithi133.stdout: "dir-": 271, 2023-10-08T16:09:13.430 INFO:teuthology.orchestra.run.smithi133.stdout: "dn": 233, 2023-10-08T16:09:13.430 INFO:teuthology.orchestra.run.smithi133.stdout: "dn+": 5693, 2023-10-08T16:09:13.430 INFO:teuthology.orchestra.run.smithi133.stdout: "dn-": 5460, 2023-10-08T16:09:13.430 INFO:teuthology.orchestra.run.smithi133.stdout: "cap": 0, 2023-10-08T16:09:13.430 INFO:teuthology.orchestra.run.smithi133.stdout: "cap+": 5297, 2023-10-08T16:09:13.431 INFO:teuthology.orchestra.run.smithi133.stdout: "cap-": 5297, 2023-10-08T16:09:13.431 INFO:teuthology.orchestra.run.smithi133.stdout: "rss": 79040, 2023-10-08T16:09:13.431 INFO:teuthology.orchestra.run.smithi133.stdout: "heap": 207072 2023-10-08T16:09:13.431 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.431 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_server": { 2023-10-08T16:09:13.431 INFO:teuthology.orchestra.run.smithi133.stdout: "dispatch_client_request": 51095, 2023-10-08T16:09:13.431 INFO:teuthology.orchestra.run.smithi133.stdout: "dispatch_server_request": 0, 2023-10-08T16:09:13.432 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_client_request": 21643, 2023-10-08T16:09:13.432 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_client_session": 10586, 2023-10-08T16:09:13.432 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_peer_request": 0, 2023-10-08T16:09:13.432 INFO:teuthology.orchestra.run.smithi133.stdout: "req_create_latency": { 2023-10-08T16:09:13.432 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 2704, 2023-10-08T16:09:13.432 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 4.671499851, 2023-10-08T16:09:13.432 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.001727625 2023-10-08T16:09:13.432 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.433 INFO:teuthology.orchestra.run.smithi133.stdout: "req_getattr_latency": { 2023-10-08T16:09:13.433 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 2583, 2023-10-08T16:09:13.433 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 2.060757537, 2023-10-08T16:09:13.433 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000797815 2023-10-08T16:09:13.433 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.433 INFO:teuthology.orchestra.run.smithi133.stdout: "req_getfilelock_latency": { 2023-10-08T16:09:13.433 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 7, 2023-10-08T16:09:13.434 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.001077684, 2023-10-08T16:09:13.434 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000153954 2023-10-08T16:09:13.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.434 INFO:teuthology.orchestra.run.smithi133.stdout: "req_link_latency": { 2023-10-08T16:09:13.434 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 6, 2023-10-08T16:09:13.434 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.011904668, 2023-10-08T16:09:13.434 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.001984111 2023-10-08T16:09:13.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.435 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookup_latency": { 2023-10-08T16:09:13.435 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 288, 2023-10-08T16:09:13.435 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 2.156879848, 2023-10-08T16:09:13.435 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.007489166 2023-10-08T16:09:13.435 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.435 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookuphash_latency": { 2023-10-08T16:09:13.435 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2023-10-08T16:09:13.436 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2023-10-08T16:09:13.436 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2023-10-08T16:09:13.436 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.436 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookupino_latency": { 2023-10-08T16:09:13.436 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 520, 2023-10-08T16:09:13.436 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.804755959, 2023-10-08T16:09:13.436 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.001547607 2023-10-08T16:09:13.436 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.437 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookupname_latency": { 2023-10-08T16:09:13.437 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2023-10-08T16:09:13.437 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2023-10-08T16:09:13.437 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2023-10-08T16:09:13.437 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.437 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookupparent_latency": { 2023-10-08T16:09:13.437 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 4, 2023-10-08T16:09:13.438 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000458452, 2023-10-08T16:09:13.438 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000114613 2023-10-08T16:09:13.438 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.438 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookupsnap_latency": { 2023-10-08T16:09:13.438 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 30, 2023-10-08T16:09:13.438 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.010413098, 2023-10-08T16:09:13.438 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000347103 2023-10-08T16:09:13.439 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.439 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lssnap_latency": { 2023-10-08T16:09:13.439 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2023-10-08T16:09:13.439 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2023-10-08T16:09:13.439 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2023-10-08T16:09:13.439 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.439 INFO:teuthology.orchestra.run.smithi133.stdout: "req_mkdir_latency": { 2023-10-08T16:09:13.439 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 242, 2023-10-08T16:09:13.440 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.673859814, 2023-10-08T16:09:13.440 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.002784544 2023-10-08T16:09:13.440 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.440 INFO:teuthology.orchestra.run.smithi133.stdout: "req_mknod_latency": { 2023-10-08T16:09:13.440 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2023-10-08T16:09:13.440 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2023-10-08T16:09:13.440 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2023-10-08T16:09:13.441 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.441 INFO:teuthology.orchestra.run.smithi133.stdout: "req_mksnap_latency": { 2023-10-08T16:09:13.441 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 12, 2023-10-08T16:09:13.441 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.141688726, 2023-10-08T16:09:13.441 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.011807393 2023-10-08T16:09:13.441 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.441 INFO:teuthology.orchestra.run.smithi133.stdout: "req_open_latency": { 2023-10-08T16:09:13.442 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 19, 2023-10-08T16:09:13.442 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.013889528, 2023-10-08T16:09:13.442 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000731027 2023-10-08T16:09:13.442 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.442 INFO:teuthology.orchestra.run.smithi133.stdout: "req_readdir_latency": { 2023-10-08T16:09:13.442 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 155, 2023-10-08T16:09:13.442 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.246998359, 2023-10-08T16:09:13.442 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.001593537 2023-10-08T16:09:13.443 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.443 INFO:teuthology.orchestra.run.smithi133.stdout: "req_rename_latency": { 2023-10-08T16:09:13.443 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 21, 2023-10-08T16:09:13.443 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.802141055, 2023-10-08T16:09:13.443 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.038197193 2023-10-08T16:09:13.443 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.443 INFO:teuthology.orchestra.run.smithi133.stdout: "req_renamesnap_latency": { 2023-10-08T16:09:13.444 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2023-10-08T16:09:13.444 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2023-10-08T16:09:13.444 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2023-10-08T16:09:13.444 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.444 INFO:teuthology.orchestra.run.smithi133.stdout: "req_rmdir_latency": { 2023-10-08T16:09:13.444 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 206, 2023-10-08T16:09:13.444 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 2.948064688, 2023-10-08T16:09:13.444 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.014310993 2023-10-08T16:09:13.445 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.445 INFO:teuthology.orchestra.run.smithi133.stdout: "req_rmsnap_latency": { 2023-10-08T16:09:13.445 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 6, 2023-10-08T16:09:13.445 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.053149473, 2023-10-08T16:09:13.445 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.008858245 2023-10-08T16:09:13.445 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.445 INFO:teuthology.orchestra.run.smithi133.stdout: "req_rmxattr_latency": { 2023-10-08T16:09:13.445 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 56, 2023-10-08T16:09:13.446 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.057656935, 2023-10-08T16:09:13.446 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.001029588 2023-10-08T16:09:13.446 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.446 INFO:teuthology.orchestra.run.smithi133.stdout: "req_setattr_latency": { 2023-10-08T16:09:13.446 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 11958, 2023-10-08T16:09:13.446 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 59.175014792, 2023-10-08T16:09:13.446 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.004948571 2023-10-08T16:09:13.447 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.447 INFO:teuthology.orchestra.run.smithi133.stdout: "req_setdirlayout_latency": { 2023-10-08T16:09:13.447 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2023-10-08T16:09:13.447 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2023-10-08T16:09:13.447 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2023-10-08T16:09:13.447 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.447 INFO:teuthology.orchestra.run.smithi133.stdout: "req_setfilelock_latency": { 2023-10-08T16:09:13.447 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 120, 2023-10-08T16:09:13.448 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.196795261, 2023-10-08T16:09:13.448 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.001639960 2023-10-08T16:09:13.448 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.448 INFO:teuthology.orchestra.run.smithi133.stdout: "req_setlayout_latency": { 2023-10-08T16:09:13.448 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2023-10-08T16:09:13.448 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2023-10-08T16:09:13.448 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2023-10-08T16:09:13.449 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.449 INFO:teuthology.orchestra.run.smithi133.stdout: "req_setxattr_latency": { 2023-10-08T16:09:13.449 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 80, 2023-10-08T16:09:13.449 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.127191308, 2023-10-08T16:09:13.449 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.001589891 2023-10-08T16:09:13.449 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.449 INFO:teuthology.orchestra.run.smithi133.stdout: "req_symlink_latency": { 2023-10-08T16:09:13.449 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 26, 2023-10-08T16:09:13.450 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.025672480, 2023-10-08T16:09:13.450 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000987403 2023-10-08T16:09:13.450 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.450 INFO:teuthology.orchestra.run.smithi133.stdout: "req_unlink_latency": { 2023-10-08T16:09:13.450 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 2592, 2023-10-08T16:09:13.450 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 3.149443239, 2023-10-08T16:09:13.450 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.001215062 2023-10-08T16:09:13.450 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.451 INFO:teuthology.orchestra.run.smithi133.stdout: "cap_revoke_eviction": 0, 2023-10-08T16:09:13.451 INFO:teuthology.orchestra.run.smithi133.stdout: "cap_acquisition_throttle": 0, 2023-10-08T16:09:13.451 INFO:teuthology.orchestra.run.smithi133.stdout: "req_getvxattr_latency": { 2023-10-08T16:09:13.451 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 8, 2023-10-08T16:09:13.451 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.001546557, 2023-10-08T16:09:13.451 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000193319 2023-10-08T16:09:13.451 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:13.451 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.452 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_sessions": { 2023-10-08T16:09:13.452 INFO:teuthology.orchestra.run.smithi133.stdout: "session_count": 0, 2023-10-08T16:09:13.452 INFO:teuthology.orchestra.run.smithi133.stdout: "session_add": 2291, 2023-10-08T16:09:13.452 INFO:teuthology.orchestra.run.smithi133.stdout: "session_remove": 2291, 2023-10-08T16:09:13.452 INFO:teuthology.orchestra.run.smithi133.stdout: "sessions_open": 0, 2023-10-08T16:09:13.452 INFO:teuthology.orchestra.run.smithi133.stdout: "sessions_stale": 0, 2023-10-08T16:09:13.452 INFO:teuthology.orchestra.run.smithi133.stdout: "total_load": 6005, 2023-10-08T16:09:13.453 INFO:teuthology.orchestra.run.smithi133.stdout: "average_load": 6005, 2023-10-08T16:09:13.453 INFO:teuthology.orchestra.run.smithi133.stdout: "avg_session_uptime": 2, 2023-10-08T16:09:13.453 INFO:teuthology.orchestra.run.smithi133.stdout: "mdthresh_evicted": 0 2023-10-08T16:09:13.453 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.453 INFO:teuthology.orchestra.run.smithi133.stdout: "mempool": { 2023-10-08T16:09:13.453 INFO:teuthology.orchestra.run.smithi133.stdout: "bloom_filter_bytes": 120, 2023-10-08T16:09:13.453 INFO:teuthology.orchestra.run.smithi133.stdout: "bloom_filter_items": 120, 2023-10-08T16:09:13.453 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T16:09:13.454 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_alloc_items": 0, 2023-10-08T16:09:13.454 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T16:09:13.454 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_data_items": 0, 2023-10-08T16:09:13.454 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T16:09:13.454 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T16:09:13.454 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T16:09:13.454 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T16:09:13.455 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T16:09:13.455 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_other_items": 0, 2023-10-08T16:09:13.455 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_Buffer_bytes": 0, 2023-10-08T16:09:13.455 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_Buffer_items": 0, 2023-10-08T16:09:13.455 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_Extent_bytes": 0, 2023-10-08T16:09:13.455 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_Extent_items": 0, 2023-10-08T16:09:13.455 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_Blob_bytes": 0, 2023-10-08T16:09:13.456 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_Blob_items": 0, 2023-10-08T16:09:13.456 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_SharedBlob_bytes": 0, 2023-10-08T16:09:13.456 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_SharedBlob_items": 0, 2023-10-08T16:09:13.456 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T16:09:13.456 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T16:09:13.456 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T16:09:13.456 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_fsck_items": 0, 2023-10-08T16:09:13.456 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_txc_bytes": 0, 2023-10-08T16:09:13.457 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_txc_items": 0, 2023-10-08T16:09:13.457 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T16:09:13.457 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T16:09:13.457 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_writing_bytes": 0, 2023-10-08T16:09:13.457 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_writing_items": 0, 2023-10-08T16:09:13.457 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_bytes": 0, 2023-10-08T16:09:13.457 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_items": 0, 2023-10-08T16:09:13.457 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T16:09:13.458 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_file_reader_items": 0, 2023-10-08T16:09:13.458 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T16:09:13.458 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_file_writer_items": 0, 2023-10-08T16:09:13.458 INFO:teuthology.orchestra.run.smithi133.stdout: "buffer_anon_bytes": 415185, 2023-10-08T16:09:13.458 INFO:teuthology.orchestra.run.smithi133.stdout: "buffer_anon_items": 140, 2023-10-08T16:09:13.458 INFO:teuthology.orchestra.run.smithi133.stdout: "buffer_meta_bytes": 0, 2023-10-08T16:09:13.458 INFO:teuthology.orchestra.run.smithi133.stdout: "buffer_meta_items": 0, 2023-10-08T16:09:13.459 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_bytes": 0, 2023-10-08T16:09:13.459 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_items": 0, 2023-10-08T16:09:13.459 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_mapbl_bytes": 0, 2023-10-08T16:09:13.459 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_mapbl_items": 0, 2023-10-08T16:09:13.459 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_pglog_bytes": 0, 2023-10-08T16:09:13.459 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_pglog_items": 0, 2023-10-08T16:09:13.459 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_bytes": 5728, 2023-10-08T16:09:13.460 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_items": 85, 2023-10-08T16:09:13.460 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T16:09:13.460 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_mapping_items": 0, 2023-10-08T16:09:13.460 INFO:teuthology.orchestra.run.smithi133.stdout: "pgmap_bytes": 0, 2023-10-08T16:09:13.460 INFO:teuthology.orchestra.run.smithi133.stdout: "pgmap_items": 0, 2023-10-08T16:09:13.460 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_co_bytes": 701630, 2023-10-08T16:09:13.460 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_co_items": 8906, 2023-10-08T16:09:13.460 INFO:teuthology.orchestra.run.smithi133.stdout: "unittest_1_bytes": 0, 2023-10-08T16:09:13.461 INFO:teuthology.orchestra.run.smithi133.stdout: "unittest_1_items": 0, 2023-10-08T16:09:13.461 INFO:teuthology.orchestra.run.smithi133.stdout: "unittest_2_bytes": 0, 2023-10-08T16:09:13.461 INFO:teuthology.orchestra.run.smithi133.stdout: "unittest_2_items": 0 2023-10-08T16:09:13.461 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.461 INFO:teuthology.orchestra.run.smithi133.stdout: "objecter": { 2023-10-08T16:09:13.461 INFO:teuthology.orchestra.run.smithi133.stdout: "op_active": 0, 2023-10-08T16:09:13.461 INFO:teuthology.orchestra.run.smithi133.stdout: "op_laggy": 0, 2023-10-08T16:09:13.462 INFO:teuthology.orchestra.run.smithi133.stdout: "op_send": 56723, 2023-10-08T16:09:13.462 INFO:teuthology.orchestra.run.smithi133.stdout: "op_send_bytes": 86093542, 2023-10-08T16:09:13.462 INFO:teuthology.orchestra.run.smithi133.stdout: "op_resend": 37, 2023-10-08T16:09:13.462 INFO:teuthology.orchestra.run.smithi133.stdout: "op_reply": 56723, 2023-10-08T16:09:13.462 INFO:teuthology.orchestra.run.smithi133.stdout: "oplen_avg": { 2023-10-08T16:09:13.462 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 56723, 2023-10-08T16:09:13.462 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 56869 2023-10-08T16:09:13.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.463 INFO:teuthology.orchestra.run.smithi133.stdout: "op": 56723, 2023-10-08T16:09:13.463 INFO:teuthology.orchestra.run.smithi133.stdout: "op_r": 1078, 2023-10-08T16:09:13.463 INFO:teuthology.orchestra.run.smithi133.stdout: "op_w": 55645, 2023-10-08T16:09:13.463 INFO:teuthology.orchestra.run.smithi133.stdout: "op_rmw": 0, 2023-10-08T16:09:13.463 INFO:teuthology.orchestra.run.smithi133.stdout: "op_pg": 0, 2023-10-08T16:09:13.463 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_stat": 0, 2023-10-08T16:09:13.464 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_create": 11, 2023-10-08T16:09:13.464 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_read": 62, 2023-10-08T16:09:13.464 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_write": 17544, 2023-10-08T16:09:13.464 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_writefull": 64, 2023-10-08T16:09:13.464 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_writesame": 0, 2023-10-08T16:09:13.464 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_append": 0, 2023-10-08T16:09:13.464 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_zero": 0, 2023-10-08T16:09:13.464 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_truncate": 2, 2023-10-08T16:09:13.465 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_delete": 37884, 2023-10-08T16:09:13.465 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_mapext": 0, 2023-10-08T16:09:13.465 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_sparse_read": 0, 2023-10-08T16:09:13.465 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_clonerange": 0, 2023-10-08T16:09:13.465 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_getxattr": 1016, 2023-10-08T16:09:13.465 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_setxattr": 22, 2023-10-08T16:09:13.465 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_cmpxattr": 0, 2023-10-08T16:09:13.466 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_rmxattr": 0, 2023-10-08T16:09:13.466 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_resetxattrs": 0, 2023-10-08T16:09:13.466 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_call": 0, 2023-10-08T16:09:13.466 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_watch": 0, 2023-10-08T16:09:13.466 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_notify": 0, 2023-10-08T16:09:13.466 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T16:09:13.466 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_pgls": 0, 2023-10-08T16:09:13.466 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_pgls_filter": 0, 2023-10-08T16:09:13.467 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_other": 5, 2023-10-08T16:09:13.467 INFO:teuthology.orchestra.run.smithi133.stdout: "linger_active": 0, 2023-10-08T16:09:13.467 INFO:teuthology.orchestra.run.smithi133.stdout: "linger_send": 0, 2023-10-08T16:09:13.467 INFO:teuthology.orchestra.run.smithi133.stdout: "linger_resend": 0, 2023-10-08T16:09:13.467 INFO:teuthology.orchestra.run.smithi133.stdout: "linger_ping": 0, 2023-10-08T16:09:13.467 INFO:teuthology.orchestra.run.smithi133.stdout: "poolop_active": 0, 2023-10-08T16:09:13.467 INFO:teuthology.orchestra.run.smithi133.stdout: "poolop_send": 0, 2023-10-08T16:09:13.468 INFO:teuthology.orchestra.run.smithi133.stdout: "poolop_resend": 0, 2023-10-08T16:09:13.468 INFO:teuthology.orchestra.run.smithi133.stdout: "poolstat_active": 0, 2023-10-08T16:09:13.468 INFO:teuthology.orchestra.run.smithi133.stdout: "poolstat_send": 0, 2023-10-08T16:09:13.468 INFO:teuthology.orchestra.run.smithi133.stdout: "poolstat_resend": 0, 2023-10-08T16:09:13.468 INFO:teuthology.orchestra.run.smithi133.stdout: "statfs_active": 0, 2023-10-08T16:09:13.468 INFO:teuthology.orchestra.run.smithi133.stdout: "statfs_send": 0, 2023-10-08T16:09:13.468 INFO:teuthology.orchestra.run.smithi133.stdout: "statfs_resend": 0, 2023-10-08T16:09:13.469 INFO:teuthology.orchestra.run.smithi133.stdout: "command_active": 0, 2023-10-08T16:09:13.469 INFO:teuthology.orchestra.run.smithi133.stdout: "command_send": 0, 2023-10-08T16:09:13.469 INFO:teuthology.orchestra.run.smithi133.stdout: "command_resend": 0, 2023-10-08T16:09:13.469 INFO:teuthology.orchestra.run.smithi133.stdout: "map_epoch": 28, 2023-10-08T16:09:13.469 INFO:teuthology.orchestra.run.smithi133.stdout: "map_full": 0, 2023-10-08T16:09:13.469 INFO:teuthology.orchestra.run.smithi133.stdout: "map_inc": 9, 2023-10-08T16:09:13.469 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_sessions": 8, 2023-10-08T16:09:13.469 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_session_open": 8, 2023-10-08T16:09:13.470 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_session_close": 0, 2023-10-08T16:09:13.470 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_laggy": 0, 2023-10-08T16:09:13.470 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_wr": 238, 2023-10-08T16:09:13.470 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_rd": 0, 2023-10-08T16:09:13.470 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_del": 21 2023-10-08T16:09:13.470 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.470 INFO:teuthology.orchestra.run.smithi133.stdout: "oft": { 2023-10-08T16:09:13.471 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_total_objs": 1, 2023-10-08T16:09:13.471 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_total_kv_pairs": 0, 2023-10-08T16:09:13.471 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_total_updates": 0, 2023-10-08T16:09:13.471 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_total_removes": 0 2023-10-08T16:09:13.471 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.471 INFO:teuthology.orchestra.run.smithi133.stdout: "purge_queue": { 2023-10-08T16:09:13.471 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executing_ops": 0, 2023-10-08T16:09:13.472 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executing_ops_high_water": 65, 2023-10-08T16:09:13.472 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executing": 0, 2023-10-08T16:09:13.472 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executing_high_water": 32, 2023-10-08T16:09:13.472 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executed": 2772, 2023-10-08T16:09:13.472 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_item_in_journal": 0 2023-10-08T16:09:13.472 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.472 INFO:teuthology.orchestra.run.smithi133.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T16:09:13.472 INFO:teuthology.orchestra.run.smithi133.stdout: "val": 0, 2023-10-08T16:09:13.473 INFO:teuthology.orchestra.run.smithi133.stdout: "max": 104857600, 2023-10-08T16:09:13.473 INFO:teuthology.orchestra.run.smithi133.stdout: "get_started": 0, 2023-10-08T16:09:13.473 INFO:teuthology.orchestra.run.smithi133.stdout: "get": 125464, 2023-10-08T16:09:13.473 INFO:teuthology.orchestra.run.smithi133.stdout: "get_sum": 23804653, 2023-10-08T16:09:13.473 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_fail": 0, 2023-10-08T16:09:13.473 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_success": 125464, 2023-10-08T16:09:13.473 INFO:teuthology.orchestra.run.smithi133.stdout: "take": 0, 2023-10-08T16:09:13.473 INFO:teuthology.orchestra.run.smithi133.stdout: "take_sum": 0, 2023-10-08T16:09:13.474 INFO:teuthology.orchestra.run.smithi133.stdout: "put": 125464, 2023-10-08T16:09:13.474 INFO:teuthology.orchestra.run.smithi133.stdout: "put_sum": 23804653, 2023-10-08T16:09:13.474 INFO:teuthology.orchestra.run.smithi133.stdout: "wait": { 2023-10-08T16:09:13.474 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2023-10-08T16:09:13.474 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2023-10-08T16:09:13.474 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2023-10-08T16:09:13.474 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:13.475 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.475 INFO:teuthology.orchestra.run.smithi133.stdout: "throttle-objecter_bytes": { 2023-10-08T16:09:13.475 INFO:teuthology.orchestra.run.smithi133.stdout: "val": 0, 2023-10-08T16:09:13.475 INFO:teuthology.orchestra.run.smithi133.stdout: "max": 104857600, 2023-10-08T16:09:13.475 INFO:teuthology.orchestra.run.smithi133.stdout: "get_started": 0, 2023-10-08T16:09:13.475 INFO:teuthology.orchestra.run.smithi133.stdout: "get": 0, 2023-10-08T16:09:13.475 INFO:teuthology.orchestra.run.smithi133.stdout: "get_sum": 0, 2023-10-08T16:09:13.476 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_fail": 0, 2023-10-08T16:09:13.476 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_success": 0, 2023-10-08T16:09:13.476 INFO:teuthology.orchestra.run.smithi133.stdout: "take": 56723, 2023-10-08T16:09:13.476 INFO:teuthology.orchestra.run.smithi133.stdout: "take_sum": 86373530, 2023-10-08T16:09:13.476 INFO:teuthology.orchestra.run.smithi133.stdout: "put": 56723, 2023-10-08T16:09:13.476 INFO:teuthology.orchestra.run.smithi133.stdout: "put_sum": 86373530, 2023-10-08T16:09:13.476 INFO:teuthology.orchestra.run.smithi133.stdout: "wait": { 2023-10-08T16:09:13.476 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2023-10-08T16:09:13.477 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2023-10-08T16:09:13.477 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2023-10-08T16:09:13.477 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:13.477 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.477 INFO:teuthology.orchestra.run.smithi133.stdout: "throttle-objecter_ops": { 2023-10-08T16:09:13.477 INFO:teuthology.orchestra.run.smithi133.stdout: "val": 0, 2023-10-08T16:09:13.477 INFO:teuthology.orchestra.run.smithi133.stdout: "max": 1024, 2023-10-08T16:09:13.478 INFO:teuthology.orchestra.run.smithi133.stdout: "get_started": 0, 2023-10-08T16:09:13.478 INFO:teuthology.orchestra.run.smithi133.stdout: "get": 0, 2023-10-08T16:09:13.478 INFO:teuthology.orchestra.run.smithi133.stdout: "get_sum": 0, 2023-10-08T16:09:13.478 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_fail": 0, 2023-10-08T16:09:13.478 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_success": 0, 2023-10-08T16:09:13.478 INFO:teuthology.orchestra.run.smithi133.stdout: "take": 56723, 2023-10-08T16:09:13.478 INFO:teuthology.orchestra.run.smithi133.stdout: "take_sum": 56723, 2023-10-08T16:09:13.478 INFO:teuthology.orchestra.run.smithi133.stdout: "put": 56723, 2023-10-08T16:09:13.479 INFO:teuthology.orchestra.run.smithi133.stdout: "put_sum": 56723, 2023-10-08T16:09:13.479 INFO:teuthology.orchestra.run.smithi133.stdout: "wait": { 2023-10-08T16:09:13.479 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2023-10-08T16:09:13.479 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2023-10-08T16:09:13.479 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2023-10-08T16:09:13.479 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:13.479 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.479 INFO:teuthology.orchestra.run.smithi133.stdout: "throttle-write_buf_throttle": { 2023-10-08T16:09:13.480 INFO:teuthology.orchestra.run.smithi133.stdout: "val": 0, 2023-10-08T16:09:13.480 INFO:teuthology.orchestra.run.smithi133.stdout: "max": 3758096384, 2023-10-08T16:09:13.480 INFO:teuthology.orchestra.run.smithi133.stdout: "get_started": 0, 2023-10-08T16:09:13.480 INFO:teuthology.orchestra.run.smithi133.stdout: "get": 2772, 2023-10-08T16:09:13.480 INFO:teuthology.orchestra.run.smithi133.stdout: "get_sum": 279988, 2023-10-08T16:09:13.480 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_fail": 0, 2023-10-08T16:09:13.480 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_success": 2772, 2023-10-08T16:09:13.480 INFO:teuthology.orchestra.run.smithi133.stdout: "take": 0, 2023-10-08T16:09:13.481 INFO:teuthology.orchestra.run.smithi133.stdout: "take_sum": 0, 2023-10-08T16:09:13.481 INFO:teuthology.orchestra.run.smithi133.stdout: "put": 62, 2023-10-08T16:09:13.481 INFO:teuthology.orchestra.run.smithi133.stdout: "put_sum": 279988, 2023-10-08T16:09:13.481 INFO:teuthology.orchestra.run.smithi133.stdout: "wait": { 2023-10-08T16:09:13.481 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2023-10-08T16:09:13.481 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2023-10-08T16:09:13.481 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2023-10-08T16:09:13.481 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:13.482 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-10-08T16:09:13.482 INFO:teuthology.orchestra.run.smithi133.stdout: "throttle-write_buf_throttle-0x55f385ca7e00": { 2023-10-08T16:09:13.482 INFO:teuthology.orchestra.run.smithi133.stdout: "val": 0, 2023-10-08T16:09:13.482 INFO:teuthology.orchestra.run.smithi133.stdout: "max": 3758096384, 2023-10-08T16:09:13.482 INFO:teuthology.orchestra.run.smithi133.stdout: "get_started": 0, 2023-10-08T16:09:13.482 INFO:teuthology.orchestra.run.smithi133.stdout: "get": 28285, 2023-10-08T16:09:13.482 INFO:teuthology.orchestra.run.smithi133.stdout: "get_sum": 84842634, 2023-10-08T16:09:13.483 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_fail": 0, 2023-10-08T16:09:13.483 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_success": 28285, 2023-10-08T16:09:13.483 INFO:teuthology.orchestra.run.smithi133.stdout: "take": 0, 2023-10-08T16:09:13.483 INFO:teuthology.orchestra.run.smithi133.stdout: "take_sum": 0, 2023-10-08T16:09:13.483 INFO:teuthology.orchestra.run.smithi133.stdout: "put": 17482, 2023-10-08T16:09:13.483 INFO:teuthology.orchestra.run.smithi133.stdout: "put_sum": 84842634, 2023-10-08T16:09:13.483 INFO:teuthology.orchestra.run.smithi133.stdout: "wait": { 2023-10-08T16:09:13.483 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2023-10-08T16:09:13.484 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2023-10-08T16:09:13.484 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2023-10-08T16:09:13.484 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:13.484 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-10-08T16:09:13.484 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-10-08T16:09:13.485 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=10 2023-10-08T16:09:13.486 DEBUG:tasks.check_counter:Getting stats from b 2023-10-08T16:09:13.486 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump 2023-10-08T16:09:13.593 INFO:teuthology.orchestra.run.smithi190.stdout:{ 2023-10-08T16:09:13.593 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T16:09:13.593 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 0, 2023-10-08T16:09:13.594 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 2, 2023-10-08T16:09:13.594 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 0, 2023-10-08T16:09:13.594 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 0, 2023-10-08T16:09:13.594 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 4, 2023-10-08T16:09:13.594 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 0, 2023-10-08T16:09:13.594 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 0.002655714, 2023-10-08T16:09:13.594 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 0.000000000, 2023-10-08T16:09:13.595 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 0.000721791, 2023-10-08T16:09:13.595 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T16:09:13.595 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T16:09:13.595 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-08T16:09:13.595 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-08T16:09:13.595 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-08T16:09:13.595 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-08T16:09:13.595 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2023-10-08T16:09:13.596 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-08T16:09:13.596 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-08T16:09:13.596 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-08T16:09:13.596 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-08T16:09:13.596 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-08T16:09:13.596 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T16:09:13.596 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 85, 2023-10-08T16:09:13.596 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 83, 2023-10-08T16:09:13.597 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 104555, 2023-10-08T16:09:13.597 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 46892, 2023-10-08T16:09:13.597 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 2, 2023-10-08T16:09:13.597 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 1, 2023-10-08T16:09:13.597 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 0.020279049, 2023-10-08T16:09:13.597 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 0.007731499, 2023-10-08T16:09:13.597 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 0.008241535, 2023-10-08T16:09:13.597 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.003465357, 2023-10-08T16:09:13.598 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T16:09:13.598 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 83, 2023-10-08T16:09:13.598 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.006175379, 2023-10-08T16:09:13.598 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000074402 2023-10-08T16:09:13.598 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-08T16:09:13.598 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2023-10-08T16:09:13.598 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-08T16:09:13.598 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-08T16:09:13.599 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-08T16:09:13.599 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-08T16:09:13.599 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-08T16:09:13.599 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T16:09:13.599 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 5, 2023-10-08T16:09:13.599 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 66, 2023-10-08T16:09:13.599 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 1728, 2023-10-08T16:09:13.599 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 84656, 2023-10-08T16:09:13.600 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 3, 2023-10-08T16:09:13.600 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 2, 2023-10-08T16:09:13.600 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 0.008487031, 2023-10-08T16:09:13.600 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 0.004187527, 2023-10-08T16:09:13.600 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 0.003348047, 2023-10-08T16:09:13.600 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T16:09:13.600 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T16:09:13.600 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 65, 2023-10-08T16:09:13.601 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.007091627, 2023-10-08T16:09:13.601 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000109101 2023-10-08T16:09:13.601 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-08T16:09:13.601 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2023-10-08T16:09:13.601 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-08T16:09:13.601 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-08T16:09:13.601 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-08T16:09:13.601 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-08T16:09:13.601 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-08T16:09:13.602 INFO:teuthology.orchestra.run.smithi190.stdout: "cct": { 2023-10-08T16:09:13.602 INFO:teuthology.orchestra.run.smithi190.stdout: "total_workers": 0, 2023-10-08T16:09:13.602 INFO:teuthology.orchestra.run.smithi190.stdout: "unhealthy_workers": 0 2023-10-08T16:09:13.602 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-08T16:09:13.602 INFO:teuthology.orchestra.run.smithi190.stdout: "mempool": { 2023-10-08T16:09:13.602 INFO:teuthology.orchestra.run.smithi190.stdout: "bloom_filter_bytes": 0, 2023-10-08T16:09:13.602 INFO:teuthology.orchestra.run.smithi190.stdout: "bloom_filter_items": 0, 2023-10-08T16:09:13.602 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T16:09:13.603 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_alloc_items": 0, 2023-10-08T16:09:13.603 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T16:09:13.603 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_data_items": 0, 2023-10-08T16:09:13.603 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T16:09:13.603 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T16:09:13.603 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T16:09:13.603 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T16:09:13.603 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T16:09:13.603 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_other_items": 0, 2023-10-08T16:09:13.604 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_Buffer_bytes": 0, 2023-10-08T16:09:13.604 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_Buffer_items": 0, 2023-10-08T16:09:13.604 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_Extent_bytes": 0, 2023-10-08T16:09:13.604 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_Extent_items": 0, 2023-10-08T16:09:13.604 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_Blob_bytes": 0, 2023-10-08T16:09:13.604 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_Blob_items": 0, 2023-10-08T16:09:13.604 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_SharedBlob_bytes": 0, 2023-10-08T16:09:13.604 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_SharedBlob_items": 0, 2023-10-08T16:09:13.605 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T16:09:13.605 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T16:09:13.605 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T16:09:13.605 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_fsck_items": 0, 2023-10-08T16:09:13.605 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_txc_bytes": 0, 2023-10-08T16:09:13.605 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_txc_items": 0, 2023-10-08T16:09:13.605 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T16:09:13.605 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T16:09:13.606 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_bytes": 0, 2023-10-08T16:09:13.606 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_items": 0, 2023-10-08T16:09:13.606 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_bytes": 0, 2023-10-08T16:09:13.606 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_items": 0, 2023-10-08T16:09:13.606 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T16:09:13.606 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_reader_items": 0, 2023-10-08T16:09:13.606 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T16:09:13.606 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_writer_items": 0, 2023-10-08T16:09:13.607 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_anon_bytes": 148760, 2023-10-08T16:09:13.607 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_anon_items": 28, 2023-10-08T16:09:13.607 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_meta_bytes": 0, 2023-10-08T16:09:13.607 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_meta_items": 0, 2023-10-08T16:09:13.607 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_bytes": 0, 2023-10-08T16:09:13.607 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_items": 0, 2023-10-08T16:09:13.607 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_mapbl_bytes": 0, 2023-10-08T16:09:13.608 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_mapbl_items": 0, 2023-10-08T16:09:13.608 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_pglog_bytes": 0, 2023-10-08T16:09:13.608 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_pglog_items": 0, 2023-10-08T16:09:13.608 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_bytes": 0, 2023-10-08T16:09:14.047 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_items": 0, 2023-10-08T16:09:14.047 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T16:09:14.047 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_mapping_items": 0, 2023-10-08T16:09:14.047 INFO:teuthology.orchestra.run.smithi190.stdout: "pgmap_bytes": 0, 2023-10-08T16:09:14.048 INFO:teuthology.orchestra.run.smithi190.stdout: "pgmap_items": 0, 2023-10-08T16:09:14.048 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_co_bytes": 856, 2023-10-08T16:09:14.048 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_co_items": 2, 2023-10-08T16:09:14.048 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_1_bytes": 0, 2023-10-08T16:09:14.048 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_1_items": 0, 2023-10-08T16:09:14.048 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_2_bytes": 0, 2023-10-08T16:09:14.048 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_2_items": 0 2023-10-08T16:09:14.049 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-08T16:09:14.049 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T16:09:14.049 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2023-10-08T16:09:14.049 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 104857600, 2023-10-08T16:09:14.049 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2023-10-08T16:09:14.049 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 85, 2023-10-08T16:09:14.049 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 92604, 2023-10-08T16:09:14.049 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2023-10-08T16:09:14.050 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 85, 2023-10-08T16:09:14.050 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 0, 2023-10-08T16:09:14.050 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 0, 2023-10-08T16:09:14.050 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 85, 2023-10-08T16:09:14.050 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 92604, 2023-10-08T16:09:14.050 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2023-10-08T16:09:14.050 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-08T16:09:14.050 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-08T16:09:14.051 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-08T16:09:14.051 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-08T16:09:14.051 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-08T16:09:14.051 INFO:teuthology.orchestra.run.smithi190.stdout:} 2023-10-08T16:09:14.052 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.b 2023-10-08T16:09:14.053 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-08T16:09:14.061 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-08T16:09:14.062 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:09:14.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.173+0000 7ff82ffff700 1 Processor -- start 2023-10-08T16:09:14.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.173+0000 7ff82ffff700 1 -- start start 2023-10-08T16:09:14.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.173+0000 7ff82ffff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff8301423c0 0x7ff8301428d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:14.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.173+0000 7ff82ffff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8300b2150 con 0x7ff830142e10 2023-10-08T16:09:14.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.173+0000 7ff82ffff700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8300b26f0 con 0x7ff8300b59f0 2023-10-08T16:09:14.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.173+0000 7ff82ffff700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8300b1070 con 0x7ff8301423c0 2023-10-08T16:09:14.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.173+0000 7ff82f7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff830142e10 0x7ff83014cd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56276/0 (socket says 172.21.15.133:56276) 2023-10-08T16:09:14.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.173+0000 7ff82f7fe700 1 -- 172.21.15.133:0/944752207 learned_addr learned my addr 172.21.15.133:0/944752207 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:09:14.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.173+0000 7ff82e7fc700 1 --2- 172.21.15.133:0/944752207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff8301423c0 0x7ff8301428d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:14.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.173+0000 7ff82dffb700 1 -- 172.21.15.133:0/944752207 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115252680 0 0) 0x7ff8300b2150 con 0x7ff830142e10 2023-10-08T16:09:14.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.173+0000 7ff82dffb700 1 -- 172.21.15.133:0/944752207 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff81c003570 con 0x7ff830142e10 2023-10-08T16:09:14.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.173+0000 7ff82dffb700 1 -- 172.21.15.133:0/944752207 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991398543 0 0) 0x7ff8300b26f0 con 0x7ff8300b59f0 2023-10-08T16:09:14.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.173+0000 7ff82dffb700 1 -- 172.21.15.133:0/944752207 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8300b2150 con 0x7ff8300b59f0 2023-10-08T16:09:14.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82dffb700 1 -- 172.21.15.133:0/944752207 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 963301458 0 0) 0x7ff81c003570 con 0x7ff830142e10 2023-10-08T16:09:14.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82dffb700 1 -- 172.21.15.133:0/944752207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff8301423c0 msgr2=0x7ff8301428d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:14.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82dffb700 1 --2- 172.21.15.133:0/944752207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff8301423c0 0x7ff8301428d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:14.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82dffb700 1 -- 172.21.15.133:0/944752207 >> v1:172.21.15.190:6789/0 conn(0x7ff8300b59f0 legacy=0x7ff8300b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:14.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82dffb700 1 -- 172.21.15.133:0/944752207 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8300b1cc0 con 0x7ff830142e10 2023-10-08T16:09:14.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82dffb700 1 -- 172.21.15.133:0/944752207 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2883817959 0 0) 0x7ff828001470 con 0x7ff830142e10 2023-10-08T16:09:14.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82e7fc700 1 --2- 172.21.15.133:0/944752207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff8301423c0 0x7ff8301428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:14.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82dffb700 1 -- 172.21.15.133:0/944752207 >> v1:172.21.15.133:6789/0 conn(0x7ff830142e10 legacy=0x7ff83014cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:14.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82dffb700 1 --2- 172.21.15.133:0/944752207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff81c003c20 0x7ff81c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:14.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82dffb700 1 --2- 172.21.15.133:0/944752207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff8301423c0 0x7ff81c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:14.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82dffb700 1 --2- 172.21.15.133:0/944752207 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff81c004d50 0x7ff81c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:14.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82dffb700 1 -- 172.21.15.133:0/944752207 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8300b1070 con 0x7ff81c004d50 2023-10-08T16:09:14.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82dffb700 1 -- 172.21.15.133:0/944752207 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81c00bb10 con 0x7ff81c003c20 2023-10-08T16:09:14.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82dffb700 1 -- 172.21.15.133:0/944752207 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81c00bcd0 con 0x7ff8301423c0 2023-10-08T16:09:14.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82f7fe700 1 --2- 172.21.15.133:0/944752207 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff81c004d50 0x7ff81c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:14.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82effd700 1 --2- 172.21.15.133:0/944752207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff81c003c20 0x7ff81c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:14.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82e7fc700 1 --2- 172.21.15.133:0/944752207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff8301423c0 0x7ff81c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:14.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82effd700 1 -- 172.21.15.133:0/944752207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff8301423c0 msgr2=0x7ff81c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:14.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82effd700 1 --2- 172.21.15.133:0/944752207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff8301423c0 0x7ff81c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:14.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82effd700 1 -- 172.21.15.133:0/944752207 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff81c004d50 msgr2=0x7ff81c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:14.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82effd700 1 --2- 172.21.15.133:0/944752207 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff81c004d50 0x7ff81c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:14.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82effd700 1 -- 172.21.15.133:0/944752207 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff820009a20 con 0x7ff81c003c20 2023-10-08T16:09:14.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82effd700 1 --2- 172.21.15.133:0/944752207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff81c003c20 0x7ff81c004010 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7ff818001a60 tx=0x7ff818007d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3257d1337da8b36 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:14.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82dffb700 1 -- 172.21.15.133:0/944752207 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8180013f0 con 0x7ff81c003c20 2023-10-08T16:09:14.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82dffb700 1 -- 172.21.15.133:0/944752207 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81800c590 con 0x7ff81c003c20 2023-10-08T16:09:14.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82dffb700 1 -- 172.21.15.133:0/944752207 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81800c950 con 0x7ff81c003c20 2023-10-08T16:09:14.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82ffff700 1 -- 172.21.15.133:0/944752207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff81c003c20 msgr2=0x7ff81c004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:14.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82ffff700 1 --2- 172.21.15.133:0/944752207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff81c003c20 0x7ff81c004010 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7ff818001a60 tx=0x7ff818007d80 comp rx=0 tx=0).stop 2023-10-08T16:09:14.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82f7fe700 1 -- 172.21.15.133:0/944752207 reap_dead start 2023-10-08T16:09:14.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82ffff700 1 -- 172.21.15.133:0/944752207 shutdown_connections 2023-10-08T16:09:14.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82ffff700 1 -- 172.21.15.133:0/944752207 >> 172.21.15.133:0/944752207 conn(0x7ff830062ba0 msgr2=0x7ff830062fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:14.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82ffff700 1 -- 172.21.15.133:0/944752207 shutdown_connections 2023-10-08T16:09:14.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.177+0000 7ff82ffff700 1 -- 172.21.15.133:0/944752207 wait complete. 2023-10-08T16:09:14.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.181+0000 7ff82ffff700 1 Processor -- start 2023-10-08T16:09:14.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.181+0000 7ff82ffff700 1 -- start start 2023-10-08T16:09:14.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.181+0000 7ff82ffff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff81c003c20 0x7ff8300ae310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:14.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.181+0000 7ff82ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8301556b0 0x7ff830155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:14.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.181+0000 7ff82ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff83013efc0 0x7ff83013f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:14.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.181+0000 7ff82ffff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8300a5a30 con 0x7ff8301556b0 2023-10-08T16:09:14.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.181+0000 7ff82ffff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8300ae850 con 0x7ff83013efc0 2023-10-08T16:09:14.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.181+0000 7ff82ffff700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff830149020 con 0x7ff81c003c20 2023-10-08T16:09:14.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.181+0000 7ff82e7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8301556b0 0x7ff830155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:14.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.181+0000 7ff82e7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8301556b0 0x7ff830155b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48358/0 (socket says 172.21.15.133:48358) 2023-10-08T16:09:14.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.181+0000 7ff82e7fc700 1 -- 172.21.15.133:0/1359505714 learned_addr learned my addr 172.21.15.133:0/1359505714 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:14.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.181+0000 7ff82f7fe700 1 --2- 172.21.15.133:0/1359505714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff83013efc0 0x7ff83013f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:14.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.181+0000 7ff82effd700 1 --2- 172.21.15.133:0/1359505714 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff81c003c20 0x7ff8300ae310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:14.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.181+0000 7ff82e7fc700 1 -- 172.21.15.133:0/1359505714 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff81c003c20 msgr2=0x7ff8300ae310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:14.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.181+0000 7ff82e7fc700 1 --2- 172.21.15.133:0/1359505714 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff81c003c20 0x7ff8300ae310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:14.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.181+0000 7ff82e7fc700 1 -- 172.21.15.133:0/1359505714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff83013efc0 msgr2=0x7ff83013f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:14.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.181+0000 7ff82e7fc700 1 --2- 172.21.15.133:0/1359505714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff83013efc0 0x7ff83013f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:14.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.181+0000 7ff82e7fc700 1 -- 172.21.15.133:0/1359505714 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8300a66f0 con 0x7ff8301556b0 2023-10-08T16:09:14.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.181+0000 7ff82e7fc700 1 --2- 172.21.15.133:0/1359505714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8301556b0 0x7ff830155b00 secure :-1 s=READY pgs=4350 cs=0 l=1 rev1=1 crypto rx=0x7ff82000f340 tx=0x7ff82000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:14.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.181+0000 7ff826ffd700 1 -- 172.21.15.133:0/1359505714 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82000e040 con 0x7ff8301556b0 2023-10-08T16:09:14.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.181+0000 7ff826ffd700 1 -- 172.21.15.133:0/1359505714 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82000f040 con 0x7ff8301556b0 2023-10-08T16:09:14.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.181+0000 7ff82ffff700 1 -- 172.21.15.133:0/1359505714 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff830148a00 con 0x7ff8301556b0 2023-10-08T16:09:14.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.181+0000 7ff826ffd700 1 -- 172.21.15.133:0/1359505714 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff820015430 con 0x7ff8301556b0 2023-10-08T16:09:14.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.181+0000 7ff82ffff700 1 -- 172.21.15.133:0/1359505714 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8301499a0 con 0x7ff8301556b0 2023-10-08T16:09:14.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.185+0000 7ff82ffff700 1 -- 172.21.15.133:0/1359505714 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff83004be40 con 0x7ff8301556b0 2023-10-08T16:09:14.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.185+0000 7ff826ffd700 1 -- 172.21.15.133:0/1359505714 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff8200157e0 con 0x7ff8301556b0 2023-10-08T16:09:14.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.185+0000 7ff826ffd700 1 --2- 172.21.15.133:0/1359505714 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff810060550 0x7ff810062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:14.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.185+0000 7ff826ffd700 1 -- 172.21.15.133:0/1359505714 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7ff82007d600 con 0x7ff8301556b0 2023-10-08T16:09:14.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.185+0000 7ff82effd700 1 --2- 172.21.15.133:0/1359505714 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff810060550 0x7ff810062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:14.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.185+0000 7ff82effd700 1 --2- 172.21.15.133:0/1359505714 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff810060550 0x7ff810062a00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff818001f20 tx=0x7ff818015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:14.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.193+0000 7ff826ffd700 1 -- 172.21.15.133:0/1359505714 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff8200515f0 con 0x7ff8301556b0 2023-10-08T16:09:14.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.357+0000 7ff82ffff700 1 -- 172.21.15.133:0/1359505714 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff830149160 con 0x7ff8301556b0 2023-10-08T16:09:14.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.357+0000 7ff826ffd700 1 -- 172.21.15.133:0/1359505714 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+15654 (secure 0 0 0) 0x7ff820051180 con 0x7ff8301556b0 2023-10-08T16:09:14.366 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:09:14.366 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":28,"fsid":"f2546191-d59e-4805-8e1b-3d8d3d1dad86","created":"2023-10-08T16:03:52.631855+0000","modified":"2023-10-08T16:08:57.686321+0000","last_up_change":"2023-10-08T16:04:04.030581+0000","last_in_change":"2023-10-08T16:03:54.835293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:04.898316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:14.869859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:15.983795+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":27,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8c5deadf-a203-4d30-aa7f-6e2e492b6ffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6809","nonce":33493},{"type":"v1","addr":"172.21.15.133:6811","nonce":33493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":33493},{"type":"v1","addr":"172.21.15.133:6815","nonce":33493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":33493},{"type":"v1","addr":"172.21.15.133:6822","nonce":33493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":33493},{"type":"v1","addr":"172.21.15.133:6818","nonce":33493}]},"public_addr":"172.21.15.133:6811/33493","cluster_addr":"172.21.15.133:6815/33493","heartbeat_back_addr":"172.21.15.133:6822/33493","heartbeat_front_addr":"172.21.15.133:6818/33493","state":["exists","up"]},{"osd":1,"uuid":"9b081c42-c915-48c3-a1ad-410f09a78576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":33490},{"type":"v1","addr":"172.21.15.133:6801","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":33490},{"type":"v1","addr":"172.21.15.133:6803","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":33490},{"type":"v1","addr":"172.21.15.133:6807","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":33490},{"type":"v1","addr":"172.21.15.133:6805","nonce":33490}]},"public_addr":"172.21.15.133:6801/33490","cluster_addr":"172.21.15.133:6803/33490","heartbeat_back_addr":"172.21.15.133:6807/33490","heartbeat_front_addr":"172.21.15.133:6805/33490","state":["exists","up"]},{"osd":2,"uuid":"88ecda43-01cd-4644-ab0c-92c91fd38966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":33492},{"type":"v1","addr":"172.21.15.133:6825","nonce":33492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":33492},{"type":"v1","addr":"172.21.15.133:6827","nonce":33492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":33492},{"type":"v1","addr":"172.21.15.133:6831","nonce":33492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":33492},{"type":"v1","addr":"172.21.15.133:6829","nonce":33492}]},"public_addr":"172.21.15.133:6825/33492","cluster_addr":"172.21.15.133:6827/33492","heartbeat_back_addr":"172.21.15.133:6831/33492","heartbeat_front_addr":"172.21.15.133:6829/33492","state":["exists","up"]},{"osd":3,"uuid":"39faf38d-b8e2-4e11-9b3b-84dc834c977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":33491},{"type":"v1","addr":"172.21.15.133:6810","nonce":33491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":33491},{"type":"v1","addr":"172.21.15.133:6814","nonce":33491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":33491},{"type":"v1","addr":"172.21.15.133:6823","nonce":33491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":33491},{"type":"v1","addr":"172.21.15.133:6819","nonce":33491}]},"public_addr":"172.21.15.133:6810/33491","cluster_addr":"172.21.15.133:6814/33491","heartbeat_back_addr":"172.21.15.133:6823/33491","heartbeat_front_addr":"172.21.15.133:6819/33491","state":["exists","up"]},{"osd":4,"uuid":"4c097e61-1cad-4b61-9183-4e7bc486bd32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":33678},{"type":"v1","addr":"172.21.15.190:6810","nonce":33678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":33678},{"type":"v1","addr":"172.21.15.190:6814","nonce":33678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":33678},{"type":"v1","addr":"172.21.15.190:6822","nonce":33678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":33678},{"type":"v1","addr":"172.21.15.190:6818","nonce":33678}]},"public_addr":"172.21.15.190:6810/33678","cluster_addr":"172.21.15.190:6814/33678","heartbeat_back_addr":"172.21.15.190:6822/33678","heartbeat_front_addr":"172.21.15.190:6818/33678","state":["exists","up"]},{"osd":5,"uuid":"05f072e0-7bc0-40f0-8cb6-8e322c82d6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":33676},{"type":"v1","addr":"172.21.15.190:6811","nonce":33676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":33676},{"type":"v1","addr":"172.21.15.190:6815","nonce":33676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":33676},{"type":"v1","addr":"172.21.15.190:6823","nonce":33676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":33676},{"type":"v1","addr":"172.21.15.190:6819","nonce":33676}]},"public_addr":"172.21.15.190:6811/33676","cluster_addr":"172.21.15.190:6815/33676","heartbeat_back_addr":"172.21.15.190:6823/33676","heartbeat_front_addr":"172.21.15.190:6819/33676","state":["exists","up"]},{"osd":6,"uuid":"1bcce8d7-14f3-442d-b135-68c7d66cdedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":33677},{"type":"v1","addr":"172.21.15.190:6801","nonce":33677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":33677},{"type":"v1","addr":"172.21.15.190:6803","nonce":33677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":33677},{"type":"v1","addr":"172.21.15.190:6807","nonce":33677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":33677},{"type":"v1","addr":"172.21.15.190:6805","nonce":33677}]},"public_addr":"172.21.15.190:6801/33677","cluster_addr":"172.21.15.190:6803/33677","heartbeat_back_addr":"172.21.15.190:6807/33677","heartbeat_front_addr":"172.21.15.190:6805/33677","state":["exists","up"]},{"osd":7,"uuid":"9157dbf7-2bf9-43d7-a89a-a8e3dae7514c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":33686},{"type":"v1","addr":"172.21.15.190:6825","nonce":33686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":33686},{"type":"v1","addr":"172.21.15.190:6827","nonce":33686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":33686},{"type":"v1","addr":"172.21.15.190:6831","nonce":33686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":33686},{"type":"v1","addr":"172.21.15.190:6829","nonce":33686}]},"public_addr":"172.21.15.190:6825/33686","cluster_addr":"172.21.15.190:6827/33686","heartbeat_back_addr":"172.21.15.190:6831/33686","heartbeat_front_addr":"172.21.15.190:6829/33686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.886742+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.199618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.871695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.115926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.069650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.841448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.132320+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.315132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":14,"length":6}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:14.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.361+0000 7ff82ffff700 1 -- 172.21.15.133:0/1359505714 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff810060550 msgr2=0x7ff810062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:14.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.361+0000 7ff82ffff700 1 --2- 172.21.15.133:0/1359505714 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff810060550 0x7ff810062a00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff818001f20 tx=0x7ff818015000 comp rx=0 tx=0).stop 2023-10-08T16:09:14.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.361+0000 7ff82ffff700 1 -- 172.21.15.133:0/1359505714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8301556b0 msgr2=0x7ff830155b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:14.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.361+0000 7ff82ffff700 1 --2- 172.21.15.133:0/1359505714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8301556b0 0x7ff830155b00 secure :-1 s=READY pgs=4350 cs=0 l=1 rev1=1 crypto rx=0x7ff82000f340 tx=0x7ff82000b040 comp rx=0 tx=0).stop 2023-10-08T16:09:14.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.361+0000 7ff82ffff700 1 -- 172.21.15.133:0/1359505714 shutdown_connections 2023-10-08T16:09:14.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.361+0000 7ff82ffff700 1 --2- 172.21.15.133:0/1359505714 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff810060550 0x7ff810062a00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:14.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.361+0000 7ff82ffff700 1 --2- 172.21.15.133:0/1359505714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff83013efc0 0x7ff83013f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:14.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.361+0000 7ff82ffff700 1 --2- 172.21.15.133:0/1359505714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8301556b0 0x7ff830155b00 unknown :-1 s=CLOSED pgs=4350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:14.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.361+0000 7ff82ffff700 1 --2- 172.21.15.133:0/1359505714 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff81c003c20 0x7ff8300ae310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:14.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.361+0000 7ff82ffff700 1 -- 172.21.15.133:0/1359505714 >> 172.21.15.133:0/1359505714 conn(0x7ff830062ba0 msgr2=0x7ff8301406a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:14.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.361+0000 7ff82ffff700 1 -- 172.21.15.133:0/1359505714 shutdown_connections 2023-10-08T16:09:14.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.361+0000 7ff82ffff700 1 -- 172.21.15.133:0/1359505714 wait complete. 2023-10-08T16:09:14.379 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-08T16:09:14.379 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:09:14.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.477+0000 7fc16a00f700 1 Processor -- start 2023-10-08T16:09:14.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.477+0000 7fc16a00f700 1 -- start start 2023-10-08T16:09:14.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.477+0000 7fc16a00f700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc1640b1dc0 0x7fc164140280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:14.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.477+0000 7fc16a00f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc16406e9a0 0x7fc1640b0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:14.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.477+0000 7fc16a00f700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc16406b610 con 0x7fc1640ab960 2023-10-08T16:09:14.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.477+0000 7fc16a00f700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1640afc70 con 0x7fc1640b1dc0 2023-10-08T16:09:14.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.477+0000 7fc16a00f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1640b0060 con 0x7fc16406e9a0 2023-10-08T16:09:14.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.477+0000 7fc16980e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc16406e9a0 0x7fc1640b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:14.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.477+0000 7fc16900d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc1640b1dc0 0x7fc164140280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:14.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.477+0000 7fc16980e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc16406e9a0 0x7fc1640b0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.133:58130/0 (socket says 172.21.15.133:58130) 2023-10-08T16:09:14.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.477+0000 7fc16980e700 1 -- 172.21.15.133:0/1641478241 learned_addr learned my addr 172.21.15.133:0/1641478241 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:14.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.477+0000 7fc16880c700 1 --1- 172.21.15.133:0/1641478241 >> v1:172.21.15.190:6789/0 conn(0x7fc1640ab960 0x7fc16406e290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.133:55486/0 (socket says 172.21.15.133:55486) 2023-10-08T16:09:14.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc163fff700 1 -- 172.21.15.133:0/1641478241 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3764871064 0 0) 0x7fc16406b610 con 0x7fc1640ab960 2023-10-08T16:09:14.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc163fff700 1 -- 172.21.15.133:0/1641478241 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc14c003570 con 0x7fc1640ab960 2023-10-08T16:09:14.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc16980e700 1 -- 172.21.15.133:0/1641478241 >> v2:172.21.15.190:3300/0 conn(0x7fc1640b1dc0 msgr2=0x7fc164140280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:14.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc16980e700 1 --2- 172.21.15.133:0/1641478241 >> v2:172.21.15.190:3300/0 conn(0x7fc1640b1dc0 0x7fc164140280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:14.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc16980e700 1 -- 172.21.15.133:0/1641478241 >> v1:172.21.15.190:6789/0 conn(0x7fc1640ab960 legacy=0x7fc16406e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:14.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc16980e700 1 -- 172.21.15.133:0/1641478241 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1640b0340 con 0x7fc16406e9a0 2023-10-08T16:09:14.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc16900d700 1 --2- 172.21.15.133:0/1641478241 >> v2:172.21.15.190:3300/0 conn(0x7fc1640b1dc0 0x7fc164140280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:14.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc16980e700 1 --2- 172.21.15.133:0/1641478241 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc16406e9a0 0x7fc1640b0860 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0099b0 tx=0x7fc15c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b41ff8226d5076e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:14.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc163fff700 1 -- 172.21.15.133:0/1641478241 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c00b680 con 0x7fc16406e9a0 2023-10-08T16:09:14.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc163fff700 1 -- 172.21.15.133:0/1641478241 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15c00b7e0 con 0x7fc16406e9a0 2023-10-08T16:09:14.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc163fff700 1 -- 172.21.15.133:0/1641478241 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c00bba0 con 0x7fc16406e9a0 2023-10-08T16:09:14.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc16a00f700 1 -- 172.21.15.133:0/1641478241 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc16406e9a0 msgr2=0x7fc1640b0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:14.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc16a00f700 1 --2- 172.21.15.133:0/1641478241 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc16406e9a0 0x7fc1640b0860 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0099b0 tx=0x7fc15c009250 comp rx=0 tx=0).stop 2023-10-08T16:09:14.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc16a00f700 1 -- 172.21.15.133:0/1641478241 shutdown_connections 2023-10-08T16:09:14.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc16a00f700 1 --2- 172.21.15.133:0/1641478241 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc16406e9a0 0x7fc1640b0860 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:14.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc16a00f700 1 --2- 172.21.15.133:0/1641478241 >> v2:172.21.15.190:3300/0 conn(0x7fc1640b1dc0 0x7fc164140280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:14.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc16a00f700 1 -- 172.21.15.133:0/1641478241 >> 172.21.15.133:0/1641478241 conn(0x7fc164063670 msgr2=0x7fc1640b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:14.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc16a00f700 1 -- 172.21.15.133:0/1641478241 shutdown_connections 2023-10-08T16:09:14.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc16a00f700 1 -- 172.21.15.133:0/1641478241 wait complete. 2023-10-08T16:09:14.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc16a00f700 1 Processor -- start 2023-10-08T16:09:14.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc16a00f700 1 -- start start 2023-10-08T16:09:14.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc16a00f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc16406e9a0 0x7fc1640a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:14.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc16a00f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1640ab960 0x7fc1640a5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:14.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc16a00f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1640b1dc0 0x7fc16414fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:14.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc16a00f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1640a7200 con 0x7fc16406e9a0 2023-10-08T16:09:14.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc16a00f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16413d720 con 0x7fc1640b1dc0 2023-10-08T16:09:14.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.481+0000 7fc16a00f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1640a74e0 con 0x7fc1640ab960 2023-10-08T16:09:14.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.485+0000 7fc16900d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc16406e9a0 0x7fc1640a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:14.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.485+0000 7fc16900d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc16406e9a0 0x7fc1640a5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48374/0 (socket says 172.21.15.133:48374) 2023-10-08T16:09:14.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.485+0000 7fc16900d700 1 -- 172.21.15.133:0/3459356025 learned_addr learned my addr 172.21.15.133:0/3459356025 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:14.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.485+0000 7fc16880c700 1 --2- 172.21.15.133:0/3459356025 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1640ab960 0x7fc1640a5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:14.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.485+0000 7fc16980e700 1 --2- 172.21.15.133:0/3459356025 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1640b1dc0 0x7fc16414fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:14.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.485+0000 7fc16900d700 1 -- 172.21.15.133:0/3459356025 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1640ab960 msgr2=0x7fc1640a5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:14.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.485+0000 7fc16900d700 1 --2- 172.21.15.133:0/3459356025 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1640ab960 0x7fc1640a5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:14.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.485+0000 7fc16900d700 1 -- 172.21.15.133:0/3459356025 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1640b1dc0 msgr2=0x7fc16414fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:14.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.485+0000 7fc16900d700 1 --2- 172.21.15.133:0/3459356025 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1640b1dc0 0x7fc16414fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:14.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.485+0000 7fc16900d700 1 -- 172.21.15.133:0/3459356025 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc158009420 con 0x7fc16406e9a0 2023-10-08T16:09:14.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.485+0000 7fc16900d700 1 --2- 172.21.15.133:0/3459356025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc16406e9a0 0x7fc1640a5a70 secure :-1 s=READY pgs=4351 cs=0 l=1 rev1=1 crypto rx=0x7fc15800ec80 tx=0x7fc1580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:14.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.485+0000 7fc1617fa700 1 -- 172.21.15.133:0/3459356025 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15800c850 con 0x7fc16406e9a0 2023-10-08T16:09:14.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.485+0000 7fc1617fa700 1 -- 172.21.15.133:0/3459356025 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15800c9b0 con 0x7fc16406e9a0 2023-10-08T16:09:14.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.485+0000 7fc16a00f700 1 -- 172.21.15.133:0/3459356025 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc15c0094f0 con 0x7fc16406e9a0 2023-10-08T16:09:14.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.485+0000 7fc1617fa700 1 -- 172.21.15.133:0/3459356025 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15800cd30 con 0x7fc16406e9a0 2023-10-08T16:09:14.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.485+0000 7fc16a00f700 1 -- 172.21.15.133:0/3459356025 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc16413dcc0 con 0x7fc16406e9a0 2023-10-08T16:09:14.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.485+0000 7fc16a00f700 1 -- 172.21.15.133:0/3459356025 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc16404be40 con 0x7fc16406e9a0 2023-10-08T16:09:14.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.485+0000 7fc1617fa700 1 -- 172.21.15.133:0/3459356025 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc158013680 con 0x7fc16406e9a0 2023-10-08T16:09:14.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.489+0000 7fc1617fa700 1 --2- 172.21.15.133:0/3459356025 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fc150060550 0x7fc150062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:14.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.489+0000 7fc16880c700 1 --2- 172.21.15.133:0/3459356025 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fc150060550 0x7fc150062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:14.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.489+0000 7fc1617fa700 1 -- 172.21.15.133:0/3459356025 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fc15807cb20 con 0x7fc16406e9a0 2023-10-08T16:09:14.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.489+0000 7fc16880c700 1 --2- 172.21.15.133:0/3459356025 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fc150060550 0x7fc150062a00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc16406c7a0 tx=0x7fc154009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:14.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.493+0000 7fc1617fa700 1 -- 172.21.15.133:0/3459356025 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc15804cfe0 con 0x7fc16406e9a0 2023-10-08T16:09:14.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.649+0000 7fc16a00f700 1 -- 172.21.15.133:0/3459356025 --> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc16404b600 con 0x7fc150060550 2023-10-08T16:09:14.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.665+0000 7fc1617fa700 1 -- 172.21.15.133:0/3459356025 <== mgr.4104 v2:172.21.15.133:6832/33362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289704 (secure 0 0 0) 0x7fc16404b600 con 0x7fc150060550 2023-10-08T16:09:14.676 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:09:14.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.673+0000 7fc16a00f700 1 -- 172.21.15.133:0/3459356025 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fc150060550 msgr2=0x7fc150062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:14.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.673+0000 7fc16a00f700 1 --2- 172.21.15.133:0/3459356025 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fc150060550 0x7fc150062a00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc16406c7a0 tx=0x7fc154009040 comp rx=0 tx=0).stop 2023-10-08T16:09:14.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.673+0000 7fc16a00f700 1 -- 172.21.15.133:0/3459356025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc16406e9a0 msgr2=0x7fc1640a5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:14.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.673+0000 7fc16a00f700 1 --2- 172.21.15.133:0/3459356025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc16406e9a0 0x7fc1640a5a70 secure :-1 s=READY pgs=4351 cs=0 l=1 rev1=1 crypto rx=0x7fc15800ec80 tx=0x7fc1580091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:14.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.673+0000 7fc16a00f700 1 -- 172.21.15.133:0/3459356025 shutdown_connections 2023-10-08T16:09:14.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.673+0000 7fc16a00f700 1 --2- 172.21.15.133:0/3459356025 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fc150060550 0x7fc150062a00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:14.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.673+0000 7fc16a00f700 1 --2- 172.21.15.133:0/3459356025 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1640b1dc0 0x7fc16414fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:14.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.673+0000 7fc16a00f700 1 --2- 172.21.15.133:0/3459356025 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1640ab960 0x7fc1640a5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:14.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.673+0000 7fc16a00f700 1 --2- 172.21.15.133:0/3459356025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc16406e9a0 0x7fc1640a5a70 unknown :-1 s=CLOSED pgs=4351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:14.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.673+0000 7fc16a00f700 1 -- 172.21.15.133:0/3459356025 >> 172.21.15.133:0/3459356025 conn(0x7fc164063670 msgr2=0x7fc16406fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:14.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.673+0000 7fc16a00f700 1 -- 172.21.15.133:0/3459356025 shutdown_connections 2023-10-08T16:09:14.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.673+0000 7fc16a00f700 1 -- 172.21.15.133:0/3459356025 wait complete. 2023-10-08T16:09:14.681 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-10-08T16:09:14.691 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":175,"stamp":"2023-10-08T16:09:12.938796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":85834404,"num_objects":127,"num_object_clones":21,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":8,"num_read":209,"num_read_kb":442,"num_write":18237,"num_write_kb":96370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55916,"ondisk_log_size":55916,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2618148,"kb_used_data":170212,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752356572,"statfs":{"total":773094113280,"available":770413129728,"internally_reserved":0,"allocated":174297088,"data_stored":172632049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":83,"apply_latency_ms":83,"commit_latency_ns":83000000,"apply_latency_ns":83000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":551293,"num_objects":6,"num_object_clones":3,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":3,"num_read":7,"num_read_kb":8,"num_write":107,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004535"},"pg_stats":[{"pgid":"3.3f","version":"28'511","reported_seq":579,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646405+0000","last_change":"2023-10-08T16:08:50.725515+0000","last_active":"2023-10-08T16:09:06.646405+0000","last_peered":"2023-10-08T16:09:06.646405+0000","last_clean":"2023-10-08T16:09:06.646405+0000","last_became_active":"2023-10-08T16:04:17.626468+0000","last_became_peered":"2023-10-08T16:04:17.626468+0000","last_unstale":"2023-10-08T16:09:06.646405+0000","last_undegraded":"2023-10-08T16:09:06.646405+0000","last_fullsized":"2023-10-08T16:09:06.646405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:37.040973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012965628,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"28'502","reported_seq":570,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.632342+0000","last_change":"2023-10-08T16:08:50.761523+0000","last_active":"2023-10-08T16:09:06.632342+0000","last_peered":"2023-10-08T16:09:06.632342+0000","last_clean":"2023-10-08T16:09:06.632342+0000","last_became_active":"2023-10-08T16:04:17.623968+0000","last_became_peered":"2023-10-08T16:04:17.623968+0000","last_unstale":"2023-10-08T16:09:06.632342+0000","last_undegraded":"2023-10-08T16:09:06.632342+0000","last_fullsized":"2023-10-08T16:09:06.632342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025754998000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"28'750","reported_seq":817,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.628419+0000","last_change":"2023-10-08T16:08:50.782249+0000","last_active":"2023-10-08T16:09:06.628419+0000","last_peered":"2023-10-08T16:09:06.628419+0000","last_clean":"2023-10-08T16:09:06.628419+0000","last_became_active":"2023-10-08T16:04:17.624219+0000","last_became_peered":"2023-10-08T16:04:17.624219+0000","last_unstale":"2023-10-08T16:09:06.628419+0000","last_undegraded":"2023-10-08T16:09:06.628419+0000","last_fullsized":"2023-10-08T16:09:06.628419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:07.785877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.046708411999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'447","reported_seq":515,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.640828+0000","last_change":"2023-10-08T16:08:50.726275+0000","last_active":"2023-10-08T16:09:06.640828+0000","last_peered":"2023-10-08T16:09:06.640828+0000","last_clean":"2023-10-08T16:09:06.640828+0000","last_became_active":"2023-10-08T16:04:17.628308+0000","last_became_peered":"2023-10-08T16:04:17.628308+0000","last_unstale":"2023-10-08T16:09:06.640828+0000","last_undegraded":"2023-10-08T16:09:06.640828+0000","last_fullsized":"2023-10-08T16:09:06.640828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:48.519448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019603182,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'456","reported_seq":523,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646223+0000","last_change":"2023-10-08T16:08:50.725181+0000","last_active":"2023-10-08T16:09:06.646223+0000","last_peered":"2023-10-08T16:09:06.646223+0000","last_clean":"2023-10-08T16:09:06.646223+0000","last_became_active":"2023-10-08T16:04:17.625650+0000","last_became_peered":"2023-10-08T16:04:17.625650+0000","last_unstale":"2023-10-08T16:09:06.646223+0000","last_undegraded":"2023-10-08T16:09:06.646223+0000","last_fullsized":"2023-10-08T16:09:06.646223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:42.972904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013008828,"stat_sum":{"num_bytes":4107,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'638","reported_seq":703,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.630901+0000","last_change":"2023-10-08T16:08:50.747973+0000","last_active":"2023-10-08T16:09:06.630901+0000","last_peered":"2023-10-08T16:09:06.630901+0000","last_clean":"2023-10-08T16:09:06.630901+0000","last_became_active":"2023-10-08T16:04:59.029141+0000","last_became_peered":"2023-10-08T16:04:59.029141+0000","last_unstale":"2023-10-08T16:09:06.630901+0000","last_undegraded":"2023-10-08T16:09:06.630901+0000","last_fullsized":"2023-10-08T16:09:06.630901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:26:02.042909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010017161,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"28'439","reported_seq":507,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.645595+0000","last_change":"2023-10-08T16:08:50.721969+0000","last_active":"2023-10-08T16:09:06.645595+0000","last_peered":"2023-10-08T16:09:06.645595+0000","last_clean":"2023-10-08T16:09:06.645595+0000","last_became_active":"2023-10-08T16:04:17.631722+0000","last_became_peered":"2023-10-08T16:04:17.631722+0000","last_unstale":"2023-10-08T16:09:06.645595+0000","last_undegraded":"2023-10-08T16:09:06.645595+0000","last_fullsized":"2023-10-08T16:09:06.645595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:52.670934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010482406,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'606","reported_seq":673,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650514+0000","last_change":"2023-10-08T16:08:50.714547+0000","last_active":"2023-10-08T16:09:06.650514+0000","last_peered":"2023-10-08T16:09:06.650514+0000","last_clean":"2023-10-08T16:09:06.650514+0000","last_became_active":"2023-10-08T16:04:17.628987+0000","last_became_peered":"2023-10-08T16:04:17.628987+0000","last_unstale":"2023-10-08T16:09:06.650514+0000","last_undegraded":"2023-10-08T16:09:06.650514+0000","last_fullsized":"2023-10-08T16:09:06.650514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:26.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011543940000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"28'702","reported_seq":770,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650736+0000","last_change":"2023-10-08T16:08:50.727041+0000","last_active":"2023-10-08T16:09:06.650736+0000","last_peered":"2023-10-08T16:09:06.650736+0000","last_clean":"2023-10-08T16:09:06.650736+0000","last_became_active":"2023-10-08T16:04:17.636350+0000","last_became_peered":"2023-10-08T16:04:17.636350+0000","last_unstale":"2023-10-08T16:09:06.650736+0000","last_undegraded":"2023-10-08T16:09:06.650736+0000","last_fullsized":"2023-10-08T16:09:06.650736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:38:37.066127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014319053,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'946","reported_seq":1024,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.636787+0000","last_change":"2023-10-08T16:08:50.720768+0000","last_active":"2023-10-08T16:09:06.636787+0000","last_peered":"2023-10-08T16:09:06.636787+0000","last_clean":"2023-10-08T16:09:06.636787+0000","last_became_active":"2023-10-08T16:04:58.696602+0000","last_became_peered":"2023-10-08T16:04:58.696602+0000","last_unstale":"2023-10-08T16:09:06.636787+0000","last_undegraded":"2023-10-08T16:09:06.636787+0000","last_fullsized":"2023-10-08T16:09:06.636787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":946,"log_dups_size":0,"ondisk_log_size":946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:04.594336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014587116000000001,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"28'515","reported_seq":583,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.647874+0000","last_change":"2023-10-08T16:08:50.717913+0000","last_active":"2023-10-08T16:09:06.647874+0000","last_peered":"2023-10-08T16:09:06.647874+0000","last_clean":"2023-10-08T16:09:06.647874+0000","last_became_active":"2023-10-08T16:04:17.627965+0000","last_became_peered":"2023-10-08T16:04:17.627965+0000","last_unstale":"2023-10-08T16:09:06.647874+0000","last_undegraded":"2023-10-08T16:09:06.647874+0000","last_fullsized":"2023-10-08T16:09:06.647874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012809017000000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'622","reported_seq":690,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.651027+0000","last_change":"2023-10-08T16:08:50.748915+0000","last_active":"2023-10-08T16:09:06.651027+0000","last_peered":"2023-10-08T16:09:06.651027+0000","last_clean":"2023-10-08T16:09:06.651027+0000","last_became_active":"2023-10-08T16:04:17.616988+0000","last_became_peered":"2023-10-08T16:04:17.616988+0000","last_unstale":"2023-10-08T16:09:06.651027+0000","last_undegraded":"2023-10-08T16:09:06.651027+0000","last_fullsized":"2023-10-08T16:09:06.651027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:49.607853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010221923000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"28'578","reported_seq":646,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.636406+0000","last_change":"2023-10-08T16:08:50.715034+0000","last_active":"2023-10-08T16:09:06.636406+0000","last_peered":"2023-10-08T16:09:06.636406+0000","last_clean":"2023-10-08T16:09:06.636406+0000","last_became_active":"2023-10-08T16:04:17.625529+0000","last_became_peered":"2023-10-08T16:04:17.625529+0000","last_unstale":"2023-10-08T16:09:06.636406+0000","last_undegraded":"2023-10-08T16:09:06.636406+0000","last_fullsized":"2023-10-08T16:09:06.636406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:07.051965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011264827,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"28'489","reported_seq":557,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.629848+0000","last_change":"2023-10-08T16:08:50.772353+0000","last_active":"2023-10-08T16:09:06.629848+0000","last_peered":"2023-10-08T16:09:06.629848+0000","last_clean":"2023-10-08T16:09:06.629848+0000","last_became_active":"2023-10-08T16:04:17.624197+0000","last_became_peered":"2023-10-08T16:04:17.624197+0000","last_unstale":"2023-10-08T16:09:06.629848+0000","last_undegraded":"2023-10-08T16:09:06.629848+0000","last_fullsized":"2023-10-08T16:09:06.629848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:08.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037453408000000001,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"28'586","reported_seq":654,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.639903+0000","last_change":"2023-10-08T16:08:50.764291+0000","last_active":"2023-10-08T16:09:06.639903+0000","last_peered":"2023-10-08T16:09:06.639903+0000","last_clean":"2023-10-08T16:09:06.639903+0000","last_became_active":"2023-10-08T16:04:17.620391+0000","last_became_peered":"2023-10-08T16:04:17.620391+0000","last_unstale":"2023-10-08T16:09:06.639903+0000","last_undegraded":"2023-10-08T16:09:06.639903+0000","last_fullsized":"2023-10-08T16:09:06.639903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:08.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029228837000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"28'650","reported_seq":717,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649001+0000","last_change":"2023-10-08T16:08:50.723712+0000","last_active":"2023-10-08T16:09:06.649001+0000","last_peered":"2023-10-08T16:09:06.649001+0000","last_clean":"2023-10-08T16:09:06.649001+0000","last_became_active":"2023-10-08T16:04:17.619843+0000","last_became_peered":"2023-10-08T16:04:17.619843+0000","last_unstale":"2023-10-08T16:09:06.649001+0000","last_undegraded":"2023-10-08T16:09:06.649001+0000","last_fullsized":"2023-10-08T16:09:06.649001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.599406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018851915,"stat_sum":{"num_bytes":4105,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"28'622","reported_seq":690,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650219+0000","last_change":"2023-10-08T16:08:50.725684+0000","last_active":"2023-10-08T16:09:06.650219+0000","last_peered":"2023-10-08T16:09:06.650219+0000","last_clean":"2023-10-08T16:09:06.650219+0000","last_became_active":"2023-10-08T16:04:17.625580+0000","last_became_peered":"2023-10-08T16:04:17.625580+0000","last_unstale":"2023-10-08T16:09:06.650219+0000","last_undegraded":"2023-10-08T16:09:06.650219+0000","last_fullsized":"2023-10-08T16:09:06.650219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:46.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018077737,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"28'589","reported_seq":656,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.636598+0000","last_change":"2023-10-08T16:08:50.751069+0000","last_active":"2023-10-08T16:09:06.636598+0000","last_peered":"2023-10-08T16:09:06.636598+0000","last_clean":"2023-10-08T16:09:06.636598+0000","last_became_active":"2023-10-08T16:04:17.627197+0000","last_became_peered":"2023-10-08T16:04:17.627197+0000","last_unstale":"2023-10-08T16:09:06.636598+0000","last_undegraded":"2023-10-08T16:09:06.636598+0000","last_fullsized":"2023-10-08T16:09:06.636598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:09.387194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098294880000000008,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"28'596","reported_seq":664,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646672+0000","last_change":"2023-10-08T16:08:50.727158+0000","last_active":"2023-10-08T16:09:06.646672+0000","last_peered":"2023-10-08T16:09:06.646672+0000","last_clean":"2023-10-08T16:09:06.646672+0000","last_became_active":"2023-10-08T16:04:17.625586+0000","last_became_peered":"2023-10-08T16:04:17.625586+0000","last_unstale":"2023-10-08T16:09:06.646672+0000","last_undegraded":"2023-10-08T16:09:06.646672+0000","last_fullsized":"2023-10-08T16:09:06.646672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.599406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014288673999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"28'769","reported_seq":837,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646513+0000","last_change":"2023-10-08T16:08:50.717675+0000","last_active":"2023-10-08T16:09:06.646513+0000","last_peered":"2023-10-08T16:09:06.646513+0000","last_clean":"2023-10-08T16:09:06.646513+0000","last_became_active":"2023-10-08T16:04:17.623200+0000","last_became_peered":"2023-10-08T16:04:17.623200+0000","last_unstale":"2023-10-08T16:09:06.646513+0000","last_undegraded":"2023-10-08T16:09:06.646513+0000","last_fullsized":"2023-10-08T16:09:06.646513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:36.869466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012983668,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"28'725","reported_seq":794,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650301+0000","last_change":"2023-10-08T16:08:50.784761+0000","last_active":"2023-10-08T16:09:06.650301+0000","last_peered":"2023-10-08T16:09:06.650301+0000","last_clean":"2023-10-08T16:09:06.650301+0000","last_became_active":"2023-10-08T16:04:17.623945+0000","last_became_peered":"2023-10-08T16:04:17.623945+0000","last_unstale":"2023-10-08T16:09:06.650301+0000","last_undegraded":"2023-10-08T16:09:06.650301+0000","last_fullsized":"2023-10-08T16:09:06.650301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:15.965581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045353759,"stat_sum":{"num_bytes":4128,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"28'829","reported_seq":920,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650027+0000","last_change":"2023-10-08T16:08:50.723672+0000","last_active":"2023-10-08T16:09:06.650027+0000","last_peered":"2023-10-08T16:09:06.650027+0000","last_clean":"2023-10-08T16:09:06.650027+0000","last_became_active":"2023-10-08T16:04:17.623904+0000","last_became_peered":"2023-10-08T16:04:17.623904+0000","last_unstale":"2023-10-08T16:09:06.650027+0000","last_undegraded":"2023-10-08T16:09:06.650027+0000","last_fullsized":"2023-10-08T16:09:06.650027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:52.670934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019052278999999998,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":25,"num_read_kb":20,"num_write":31,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'549","reported_seq":616,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.638800+0000","last_change":"2023-10-08T16:08:50.714440+0000","last_active":"2023-10-08T16:09:06.638800+0000","last_peered":"2023-10-08T16:09:06.638800+0000","last_clean":"2023-10-08T16:09:06.638800+0000","last_became_active":"2023-10-08T16:04:17.618549+0000","last_became_peered":"2023-10-08T16:04:17.618549+0000","last_unstale":"2023-10-08T16:09:06.638800+0000","last_undegraded":"2023-10-08T16:09:06.638800+0000","last_fullsized":"2023-10-08T16:09:06.638800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011087115999999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'657","reported_seq":724,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649258+0000","last_change":"2023-10-08T16:08:50.724464+0000","last_active":"2023-10-08T16:09:06.649258+0000","last_peered":"2023-10-08T16:09:06.649258+0000","last_clean":"2023-10-08T16:09:06.649258+0000","last_became_active":"2023-10-08T16:04:17.627673+0000","last_became_peered":"2023-10-08T16:04:17.627673+0000","last_unstale":"2023-10-08T16:09:06.649258+0000","last_undegraded":"2023-10-08T16:09:06.649258+0000","last_fullsized":"2023-10-08T16:09:06.649258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:26.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019445790000000001,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"28'468","reported_seq":536,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.629597+0000","last_change":"2023-10-08T16:08:50.715828+0000","last_active":"2023-10-08T16:09:06.629597+0000","last_peered":"2023-10-08T16:09:06.629597+0000","last_clean":"2023-10-08T16:09:06.629597+0000","last_became_active":"2023-10-08T16:04:17.628793+0000","last_became_peered":"2023-10-08T16:04:17.628793+0000","last_unstale":"2023-10-08T16:09:06.629597+0000","last_undegraded":"2023-10-08T16:09:06.629597+0000","last_fullsized":"2023-10-08T16:09:06.629597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:15.965581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011350429,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"28'659","reported_seq":727,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649543+0000","last_change":"2023-10-08T16:08:50.720438+0000","last_active":"2023-10-08T16:09:06.649543+0000","last_peered":"2023-10-08T16:09:06.649543+0000","last_clean":"2023-10-08T16:09:06.649543+0000","last_became_active":"2023-10-08T16:04:17.625220+0000","last_became_peered":"2023-10-08T16:04:17.625220+0000","last_unstale":"2023-10-08T16:09:06.649543+0000","last_undegraded":"2023-10-08T16:09:06.649543+0000","last_fullsized":"2023-10-08T16:09:06.649543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:08.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013452108000000001,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'351","reported_seq":419,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.612968+0000","last_change":"2023-10-08T16:08:50.761809+0000","last_active":"2023-10-08T16:09:06.612968+0000","last_peered":"2023-10-08T16:09:06.612968+0000","last_clean":"2023-10-08T16:09:06.612968+0000","last_became_active":"2023-10-08T16:04:17.629574+0000","last_became_peered":"2023-10-08T16:04:17.629574+0000","last_unstale":"2023-10-08T16:09:06.612968+0000","last_undegraded":"2023-10-08T16:09:06.612968+0000","last_fullsized":"2023-10-08T16:09:06.612968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:26.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024743081,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"28'585","reported_seq":653,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.643506+0000","last_change":"2023-10-08T16:08:50.715713+0000","last_active":"2023-10-08T16:09:06.643506+0000","last_peered":"2023-10-08T16:09:06.643506+0000","last_clean":"2023-10-08T16:09:06.643506+0000","last_became_active":"2023-10-08T16:04:17.626420+0000","last_became_peered":"2023-10-08T16:04:17.626420+0000","last_unstale":"2023-10-08T16:09:06.643506+0000","last_undegraded":"2023-10-08T16:09:06.643506+0000","last_fullsized":"2023-10-08T16:09:06.643506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011442964999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'586","reported_seq":654,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.635599+0000","last_change":"2023-10-08T16:08:50.786032+0000","last_active":"2023-10-08T16:09:06.635599+0000","last_peered":"2023-10-08T16:09:06.635599+0000","last_clean":"2023-10-08T16:09:06.635599+0000","last_became_active":"2023-10-08T16:04:17.618207+0000","last_became_peered":"2023-10-08T16:04:17.618207+0000","last_unstale":"2023-10-08T16:09:06.635599+0000","last_undegraded":"2023-10-08T16:09:06.635599+0000","last_fullsized":"2023-10-08T16:09:06.635599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:16:31.009207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042752309000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"28'401","reported_seq":469,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.647800+0000","last_change":"2023-10-08T16:08:50.725249+0000","last_active":"2023-10-08T16:09:06.647800+0000","last_peered":"2023-10-08T16:09:06.647800+0000","last_clean":"2023-10-08T16:09:06.647800+0000","last_became_active":"2023-10-08T16:04:17.627093+0000","last_became_peered":"2023-10-08T16:04:17.627093+0000","last_unstale":"2023-10-08T16:09:06.647800+0000","last_undegraded":"2023-10-08T16:09:06.647800+0000","last_fullsized":"2023-10-08T16:09:06.647800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:45.664795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020438813,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"28'943","reported_seq":1010,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649964+0000","last_change":"2023-10-08T16:08:50.753000+0000","last_active":"2023-10-08T16:09:06.649964+0000","last_peered":"2023-10-08T16:09:06.649964+0000","last_clean":"2023-10-08T16:09:06.649964+0000","last_became_active":"2023-10-08T16:04:17.629049+0000","last_became_peered":"2023-10-08T16:04:17.629049+0000","last_unstale":"2023-10-08T16:09:06.649964+0000","last_undegraded":"2023-10-08T16:09:06.649964+0000","last_fullsized":"2023-10-08T16:09:06.649964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:07.785877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01455822,"stat_sum":{"num_bytes":8206,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"28'746","reported_seq":814,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.636917+0000","last_change":"2023-10-08T16:08:50.714786+0000","last_active":"2023-10-08T16:09:06.636917+0000","last_peered":"2023-10-08T16:09:06.636917+0000","last_clean":"2023-10-08T16:09:06.636917+0000","last_became_active":"2023-10-08T16:04:17.632012+0000","last_became_peered":"2023-10-08T16:04:17.632012+0000","last_unstale":"2023-10-08T16:09:06.636917+0000","last_undegraded":"2023-10-08T16:09:06.636917+0000","last_fullsized":"2023-10-08T16:09:06.636917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010590815999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"28'514","reported_seq":582,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.627809+0000","last_change":"2023-10-08T16:08:50.747895+0000","last_active":"2023-10-08T16:09:06.627809+0000","last_peered":"2023-10-08T16:09:06.627809+0000","last_clean":"2023-10-08T16:09:06.627809+0000","last_became_active":"2023-10-08T16:04:17.623220+0000","last_became_peered":"2023-10-08T16:04:17.623220+0000","last_unstale":"2023-10-08T16:09:06.627809+0000","last_undegraded":"2023-10-08T16:09:06.627809+0000","last_fullsized":"2023-10-08T16:09:06.627809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:07.785877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010375987999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'747","reported_seq":765,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.776172+0000","last_change":"2023-10-08T16:04:16.660492+0000","last_active":"2023-10-08T16:08:57.776172+0000","last_peered":"2023-10-08T16:08:57.776172+0000","last_clean":"2023-10-08T16:08:57.776172+0000","last_became_active":"2023-10-08T16:04:16.660183+0000","last_became_peered":"2023-10-08T16:04:16.660183+0000","last_unstale":"2023-10-08T16:08:57.776172+0000","last_undegraded":"2023-10-08T16:08:57.776172+0000","last_fullsized":"2023-10-08T16:08:57.776172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:08.532886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":743,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'638","reported_seq":706,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.644690+0000","last_change":"2023-10-08T16:08:50.786087+0000","last_active":"2023-10-08T16:09:06.644690+0000","last_peered":"2023-10-08T16:09:06.644690+0000","last_clean":"2023-10-08T16:09:06.644690+0000","last_became_active":"2023-10-08T16:04:17.620532+0000","last_became_peered":"2023-10-08T16:04:17.620532+0000","last_unstale":"2023-10-08T16:09:06.644690+0000","last_undegraded":"2023-10-08T16:09:06.644690+0000","last_fullsized":"2023-10-08T16:09:06.644690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:48:25.093009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042650311000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"28'756","reported_seq":774,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:58.144652+0000","last_change":"2023-10-08T16:04:16.654209+0000","last_active":"2023-10-08T16:08:58.144652+0000","last_peered":"2023-10-08T16:08:58.144652+0000","last_clean":"2023-10-08T16:08:58.144652+0000","last_became_active":"2023-10-08T16:04:16.653936+0000","last_became_peered":"2023-10-08T16:04:16.653936+0000","last_unstale":"2023-10-08T16:08:58.144652+0000","last_undegraded":"2023-10-08T16:08:58.144652+0000","last_fullsized":"2023-10-08T16:08:58.144652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:39:19.429906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"28'11","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.775670+0000","last_change":"2023-10-08T16:04:16.656953+0000","last_active":"2023-10-08T16:08:57.775670+0000","last_peered":"2023-10-08T16:08:57.775670+0000","last_clean":"2023-10-08T16:08:57.775670+0000","last_became_active":"2023-10-08T16:04:16.656642+0000","last_became_peered":"2023-10-08T16:04:16.656642+0000","last_unstale":"2023-10-08T16:08:57.775670+0000","last_undegraded":"2023-10-08T16:08:57.775670+0000","last_fullsized":"2023-10-08T16:08:57.775670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:04.157234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'647","reported_seq":713,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.628901+0000","last_change":"2023-10-08T16:08:50.765265+0000","last_active":"2023-10-08T16:09:06.628901+0000","last_peered":"2023-10-08T16:09:06.628901+0000","last_clean":"2023-10-08T16:09:06.628901+0000","last_became_active":"2023-10-08T16:04:59.029346+0000","last_became_peered":"2023-10-08T16:04:59.029346+0000","last_unstale":"2023-10-08T16:09:06.628901+0000","last_undegraded":"2023-10-08T16:09:06.628901+0000","last_fullsized":"2023-10-08T16:09:06.628901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:26.162193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024714613999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1526","reported_seq":1544,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.705019+0000","last_change":"2023-10-08T16:04:16.651645+0000","last_active":"2023-10-08T16:08:50.705019+0000","last_peered":"2023-10-08T16:08:50.705019+0000","last_clean":"2023-10-08T16:08:50.705019+0000","last_became_active":"2023-10-08T16:04:16.651258+0000","last_became_peered":"2023-10-08T16:04:16.651258+0000","last_unstale":"2023-10-08T16:08:50.705019+0000","last_undegraded":"2023-10-08T16:08:50.705019+0000","last_fullsized":"2023-10-08T16:08:50.705019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1526,"log_dups_size":0,"ondisk_log_size":1526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:48.596542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1522,"num_write_kb":8929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"28'757","reported_seq":825,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.626273+0000","last_change":"2023-10-08T16:08:50.761686+0000","last_active":"2023-10-08T16:09:06.626273+0000","last_peered":"2023-10-08T16:09:06.626273+0000","last_clean":"2023-10-08T16:09:06.626273+0000","last_became_active":"2023-10-08T16:04:17.629765+0000","last_became_peered":"2023-10-08T16:04:17.629765+0000","last_unstale":"2023-10-08T16:09:06.626273+0000","last_undegraded":"2023-10-08T16:09:06.626273+0000","last_fullsized":"2023-10-08T16:09:06.626273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026861545000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'13","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.709453+0000","last_change":"2023-10-08T16:04:16.655712+0000","last_active":"2023-10-08T16:08:57.709453+0000","last_peered":"2023-10-08T16:08:57.709453+0000","last_clean":"2023-10-08T16:08:57.709453+0000","last_became_active":"2023-10-08T16:04:16.654002+0000","last_became_peered":"2023-10-08T16:04:16.654002+0000","last_unstale":"2023-10-08T16:08:57.709453+0000","last_undegraded":"2023-10-08T16:08:57.709453+0000","last_fullsized":"2023-10-08T16:08:57.709453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"28'595","reported_seq":662,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649572+0000","last_change":"2023-10-08T16:08:50.724955+0000","last_active":"2023-10-08T16:09:06.649572+0000","last_peered":"2023-10-08T16:09:06.649572+0000","last_clean":"2023-10-08T16:09:06.649572+0000","last_became_active":"2023-10-08T16:04:17.624071+0000","last_became_peered":"2023-10-08T16:04:17.624071+0000","last_unstale":"2023-10-08T16:09:06.649572+0000","last_undegraded":"2023-10-08T16:09:06.649572+0000","last_fullsized":"2023-10-08T16:09:06.649572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:42.972904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018261580999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"26'15","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.706688+0000","last_change":"2023-10-08T16:04:16.657245+0000","last_active":"2023-10-08T16:08:50.706688+0000","last_peered":"2023-10-08T16:08:50.706688+0000","last_clean":"2023-10-08T16:08:50.706688+0000","last_became_active":"2023-10-08T16:04:16.656992+0000","last_became_peered":"2023-10-08T16:04:16.656992+0000","last_unstale":"2023-10-08T16:08:50.706688+0000","last_undegraded":"2023-10-08T16:08:50.706688+0000","last_fullsized":"2023-10-08T16:08:50.706688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"28'498","reported_seq":566,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.648430+0000","last_change":"2023-10-08T16:08:50.783744+0000","last_active":"2023-10-08T16:09:06.648430+0000","last_peered":"2023-10-08T16:09:06.648430+0000","last_clean":"2023-10-08T16:09:06.648430+0000","last_became_active":"2023-10-08T16:04:17.621862+0000","last_became_peered":"2023-10-08T16:04:17.621862+0000","last_unstale":"2023-10-08T16:09:06.648430+0000","last_undegraded":"2023-10-08T16:09:06.648430+0000","last_fullsized":"2023-10-08T16:09:06.648430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:36.869466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045929303999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"28'55","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.158974+0000","last_change":"2023-10-08T16:04:16.656378+0000","last_active":"2023-10-08T16:09:06.158974+0000","last_peered":"2023-10-08T16:09:06.158974+0000","last_clean":"2023-10-08T16:09:06.158974+0000","last_became_active":"2023-10-08T16:04:16.656041+0000","last_became_peered":"2023-10-08T16:04:16.656041+0000","last_unstale":"2023-10-08T16:09:06.158974+0000","last_undegraded":"2023-10-08T16:09:06.158974+0000","last_fullsized":"2023-10-08T16:09:06.158974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:08.375883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'579","reported_seq":647,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649871+0000","last_change":"2023-10-08T16:08:50.749536+0000","last_active":"2023-10-08T16:09:06.649871+0000","last_peered":"2023-10-08T16:09:06.649871+0000","last_clean":"2023-10-08T16:09:06.649871+0000","last_became_active":"2023-10-08T16:04:17.620654+0000","last_became_peered":"2023-10-08T16:04:17.620654+0000","last_unstale":"2023-10-08T16:09:06.649871+0000","last_undegraded":"2023-10-08T16:09:06.649871+0000","last_fullsized":"2023-10-08T16:09:06.649871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:09.387194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010626305000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"27'801","reported_seq":819,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.448007+0000","last_change":"2023-10-08T16:04:16.653310+0000","last_active":"2023-10-08T16:08:55.448007+0000","last_peered":"2023-10-08T16:08:55.448007+0000","last_clean":"2023-10-08T16:08:55.448007+0000","last_became_active":"2023-10-08T16:04:16.653001+0000","last_became_peered":"2023-10-08T16:04:16.653001+0000","last_unstale":"2023-10-08T16:08:55.448007+0000","last_undegraded":"2023-10-08T16:08:55.448007+0000","last_fullsized":"2023-10-08T16:08:55.448007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:48.596542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194948,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":4445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"28'522","reported_seq":590,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646727+0000","last_change":"2023-10-08T16:08:50.725788+0000","last_active":"2023-10-08T16:09:06.646727+0000","last_peered":"2023-10-08T16:09:06.646727+0000","last_clean":"2023-10-08T16:09:06.646727+0000","last_became_active":"2023-10-08T16:04:17.631130+0000","last_became_peered":"2023-10-08T16:04:17.631130+0000","last_unstale":"2023-10-08T16:09:06.646727+0000","last_undegraded":"2023-10-08T16:09:06.646727+0000","last_fullsized":"2023-10-08T16:09:06.646727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:35.211718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013318705,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"26'1512","reported_seq":1530,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.743557+0000","last_change":"2023-10-08T16:04:16.661085+0000","last_active":"2023-10-08T16:08:50.743557+0000","last_peered":"2023-10-08T16:08:50.743557+0000","last_clean":"2023-10-08T16:08:50.743557+0000","last_became_active":"2023-10-08T16:04:16.660830+0000","last_became_peered":"2023-10-08T16:04:16.660830+0000","last_unstale":"2023-10-08T16:08:50.743557+0000","last_undegraded":"2023-10-08T16:08:50.743557+0000","last_fullsized":"2023-10-08T16:08:50.743557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1512,"log_dups_size":0,"ondisk_log_size":1512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:18.465207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1505,"num_write_kb":8987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"28'652","reported_seq":720,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.645919+0000","last_change":"2023-10-08T16:08:50.780644+0000","last_active":"2023-10-08T16:09:06.645919+0000","last_peered":"2023-10-08T16:09:06.645919+0000","last_clean":"2023-10-08T16:09:06.645919+0000","last_became_active":"2023-10-08T16:04:17.623038+0000","last_became_peered":"2023-10-08T16:04:17.623038+0000","last_unstale":"2023-10-08T16:09:06.645919+0000","last_undegraded":"2023-10-08T16:09:06.645919+0000","last_fullsized":"2023-10-08T16:09:06.645919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045488809999999998,"stat_sum":{"num_bytes":4107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"26'14","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.705165+0000","last_change":"2023-10-08T16:04:16.650083+0000","last_active":"2023-10-08T16:08:50.705165+0000","last_peered":"2023-10-08T16:08:50.705165+0000","last_clean":"2023-10-08T16:08:50.705165+0000","last_became_active":"2023-10-08T16:04:16.649675+0000","last_became_peered":"2023-10-08T16:04:16.649675+0000","last_unstale":"2023-10-08T16:08:50.705165+0000","last_undegraded":"2023-10-08T16:08:50.705165+0000","last_fullsized":"2023-10-08T16:08:50.705165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:04.030037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'966","reported_seq":1034,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646421+0000","last_change":"2023-10-08T16:08:50.725608+0000","last_active":"2023-10-08T16:09:06.646421+0000","last_peered":"2023-10-08T16:09:06.646421+0000","last_clean":"2023-10-08T16:09:06.646421+0000","last_became_active":"2023-10-08T16:04:17.628865+0000","last_became_peered":"2023-10-08T16:04:17.628865+0000","last_unstale":"2023-10-08T16:09:06.646421+0000","last_undegraded":"2023-10-08T16:09:06.646421+0000","last_fullsized":"2023-10-08T16:09:06.646421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":966,"log_dups_size":0,"ondisk_log_size":966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:46.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013199152,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"27'12","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:52.141852+0000","last_change":"2023-10-08T16:04:16.655486+0000","last_active":"2023-10-08T16:08:52.141852+0000","last_peered":"2023-10-08T16:08:52.141852+0000","last_clean":"2023-10-08T16:08:52.141852+0000","last_became_active":"2023-10-08T16:04:16.653342+0000","last_became_peered":"2023-10-08T16:04:16.653342+0000","last_unstale":"2023-10-08T16:08:52.141852+0000","last_undegraded":"2023-10-08T16:08:52.141852+0000","last_fullsized":"2023-10-08T16:08:52.141852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:04.157234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"28'290","reported_seq":358,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.636856+0000","last_change":"2023-10-08T16:08:50.717095+0000","last_active":"2023-10-08T16:09:06.636856+0000","last_peered":"2023-10-08T16:09:06.636856+0000","last_clean":"2023-10-08T16:09:06.636856+0000","last_became_active":"2023-10-08T16:04:17.624454+0000","last_became_peered":"2023-10-08T16:04:17.624454+0000","last_unstale":"2023-10-08T16:09:06.636856+0000","last_undegraded":"2023-10-08T16:09:06.636856+0000","last_fullsized":"2023-10-08T16:09:06.636856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012620849,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"26'22","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.737986+0000","last_change":"2023-10-08T16:04:16.659433+0000","last_active":"2023-10-08T16:08:50.737986+0000","last_peered":"2023-10-08T16:08:50.737986+0000","last_clean":"2023-10-08T16:08:50.737986+0000","last_became_active":"2023-10-08T16:04:16.658886+0000","last_became_peered":"2023-10-08T16:04:16.658886+0000","last_unstale":"2023-10-08T16:08:50.737986+0000","last_undegraded":"2023-10-08T16:08:50.737986+0000","last_fullsized":"2023-10-08T16:08:50.737986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:08.532886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"28'592","reported_seq":660,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.645466+0000","last_change":"2023-10-08T16:08:50.724877+0000","last_active":"2023-10-08T16:09:06.645466+0000","last_peered":"2023-10-08T16:09:06.645466+0000","last_clean":"2023-10-08T16:09:06.645466+0000","last_became_active":"2023-10-08T16:04:17.628605+0000","last_became_peered":"2023-10-08T16:04:17.628605+0000","last_unstale":"2023-10-08T16:09:06.645466+0000","last_undegraded":"2023-10-08T16:09:06.645466+0000","last_fullsized":"2023-10-08T16:09:06.645466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:02:45.593266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013094041000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'18","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.699963+0000","last_change":"2023-10-08T16:04:16.660881+0000","last_active":"2023-10-08T16:08:57.699963+0000","last_peered":"2023-10-08T16:08:57.699963+0000","last_clean":"2023-10-08T16:08:57.699963+0000","last_became_active":"2023-10-08T16:04:16.660651+0000","last_became_peered":"2023-10-08T16:04:16.660651+0000","last_unstale":"2023-10-08T16:08:57.699963+0000","last_undegraded":"2023-10-08T16:08:57.699963+0000","last_fullsized":"2023-10-08T16:08:57.699963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:54.682083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"28'296","reported_seq":364,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.633524+0000","last_change":"2023-10-08T16:08:50.725143+0000","last_active":"2023-10-08T16:09:06.633524+0000","last_peered":"2023-10-08T16:09:06.633524+0000","last_clean":"2023-10-08T16:09:06.633524+0000","last_became_active":"2023-10-08T16:04:17.628701+0000","last_became_peered":"2023-10-08T16:04:17.628701+0000","last_unstale":"2023-10-08T16:09:06.633524+0000","last_undegraded":"2023-10-08T16:09:06.633524+0000","last_fullsized":"2023-10-08T16:09:06.633524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:45.664795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012739413999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'276","reported_seq":294,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:53.142796+0000","last_change":"2023-10-08T16:04:16.652447+0000","last_active":"2023-10-08T16:08:53.142796+0000","last_peered":"2023-10-08T16:08:53.142796+0000","last_clean":"2023-10-08T16:08:53.142796+0000","last_became_active":"2023-10-08T16:04:16.651709+0000","last_became_peered":"2023-10-08T16:04:16.651709+0000","last_unstale":"2023-10-08T16:08:53.142796+0000","last_undegraded":"2023-10-08T16:08:53.142796+0000","last_fullsized":"2023-10-08T16:08:53.142796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:04.157234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"28'660","reported_seq":727,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646340+0000","last_change":"2023-10-08T16:08:50.727298+0000","last_active":"2023-10-08T16:09:06.646340+0000","last_peered":"2023-10-08T16:09:06.646340+0000","last_clean":"2023-10-08T16:09:06.646340+0000","last_became_active":"2023-10-08T16:04:17.630908+0000","last_became_peered":"2023-10-08T16:04:17.630908+0000","last_unstale":"2023-10-08T16:09:06.646340+0000","last_undegraded":"2023-10-08T16:09:06.646340+0000","last_fullsized":"2023-10-08T16:09:06.646340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:48.519448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014318363000000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"28'764","reported_seq":782,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.773013+0000","last_change":"2023-10-08T16:04:16.655771+0000","last_active":"2023-10-08T16:08:57.773013+0000","last_peered":"2023-10-08T16:08:57.773013+0000","last_clean":"2023-10-08T16:08:57.773013+0000","last_became_active":"2023-10-08T16:04:16.655245+0000","last_became_peered":"2023-10-08T16:04:16.655245+0000","last_unstale":"2023-10-08T16:08:57.773013+0000","last_undegraded":"2023-10-08T16:08:57.773013+0000","last_fullsized":"2023-10-08T16:08:57.773013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:48.596542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":759,"num_write_kb":4511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"28'465","reported_seq":533,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.647811+0000","last_change":"2023-10-08T16:08:50.726922+0000","last_active":"2023-10-08T16:09:06.647811+0000","last_peered":"2023-10-08T16:09:06.647811+0000","last_clean":"2023-10-08T16:09:06.647811+0000","last_became_active":"2023-10-08T16:04:17.627369+0000","last_became_peered":"2023-10-08T16:04:17.627369+0000","last_unstale":"2023-10-08T16:09:06.647811+0000","last_undegraded":"2023-10-08T16:09:06.647811+0000","last_fullsized":"2023-10-08T16:09:06.647811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020078136999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"28'12","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.770743+0000","last_change":"2023-10-08T16:04:16.654597+0000","last_active":"2023-10-08T16:08:57.770743+0000","last_peered":"2023-10-08T16:08:57.770743+0000","last_clean":"2023-10-08T16:08:57.770743+0000","last_became_active":"2023-10-08T16:04:16.654124+0000","last_became_peered":"2023-10-08T16:04:16.654124+0000","last_unstale":"2023-10-08T16:08:57.770743+0000","last_undegraded":"2023-10-08T16:08:57.770743+0000","last_fullsized":"2023-10-08T16:08:57.770743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'569","reported_seq":635,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649431+0000","last_change":"2023-10-08T16:08:50.749000+0000","last_active":"2023-10-08T16:09:06.649431+0000","last_peered":"2023-10-08T16:09:06.649431+0000","last_clean":"2023-10-08T16:09:06.649431+0000","last_became_active":"2023-10-08T16:04:58.693477+0000","last_became_peered":"2023-10-08T16:04:58.693477+0000","last_unstale":"2023-10-08T16:09:06.649431+0000","last_undegraded":"2023-10-08T16:09:06.649431+0000","last_fullsized":"2023-10-08T16:09:06.649431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:43:34.693379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0094988650000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.711580+0000","last_change":"2023-10-08T16:04:06.370834+0000","last_active":"2023-10-08T16:08:50.711580+0000","last_peered":"2023-10-08T16:08:50.711580+0000","last_clean":"2023-10-08T16:08:50.711580+0000","last_became_active":"2023-10-08T16:04:06.368022+0000","last_became_peered":"2023-10-08T16:04:06.368022+0000","last_unstale":"2023-10-08T16:08:50.711580+0000","last_undegraded":"2023-10-08T16:08:50.711580+0000","last_fullsized":"2023-10-08T16:08:50.711580+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:05.034115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:05.034115+0000","last_clean_scrub_stamp":"2023-10-08T16:04:05.034115+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:37.338076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"28'13","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.697048+0000","last_change":"2023-10-08T16:04:16.646681+0000","last_active":"2023-10-08T16:08:57.697048+0000","last_peered":"2023-10-08T16:08:57.697048+0000","last_clean":"2023-10-08T16:08:57.697048+0000","last_became_active":"2023-10-08T16:04:16.646086+0000","last_became_peered":"2023-10-08T16:04:16.646086+0000","last_unstale":"2023-10-08T16:08:57.697048+0000","last_undegraded":"2023-10-08T16:08:57.697048+0000","last_fullsized":"2023-10-08T16:08:57.697048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:24.778540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'510","reported_seq":578,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649793+0000","last_change":"2023-10-08T16:08:50.714760+0000","last_active":"2023-10-08T16:09:06.649793+0000","last_peered":"2023-10-08T16:09:06.649793+0000","last_clean":"2023-10-08T16:09:06.649793+0000","last_became_active":"2023-10-08T16:04:17.629127+0000","last_became_peered":"2023-10-08T16:04:17.629127+0000","last_unstale":"2023-10-08T16:09:06.649793+0000","last_undegraded":"2023-10-08T16:09:06.649793+0000","last_fullsized":"2023-10-08T16:09:06.649793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:33.720945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011169416999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"27'1504","reported_seq":1522,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:52.141724+0000","last_change":"2023-10-08T16:04:16.661382+0000","last_active":"2023-10-08T16:08:52.141724+0000","last_peered":"2023-10-08T16:08:52.141724+0000","last_clean":"2023-10-08T16:08:52.141724+0000","last_became_active":"2023-10-08T16:04:16.661186+0000","last_became_peered":"2023-10-08T16:04:16.661186+0000","last_unstale":"2023-10-08T16:08:52.141724+0000","last_undegraded":"2023-10-08T16:08:52.141724+0000","last_fullsized":"2023-10-08T16:08:52.141724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1504,"log_dups_size":0,"ondisk_log_size":1504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:06.774566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1499,"num_write_kb":8970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"28'493","reported_seq":561,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.644348+0000","last_change":"2023-10-08T16:08:50.779348+0000","last_active":"2023-10-08T16:09:06.644348+0000","last_peered":"2023-10-08T16:09:06.644348+0000","last_clean":"2023-10-08T16:09:06.644348+0000","last_became_active":"2023-10-08T16:04:17.615671+0000","last_became_peered":"2023-10-08T16:04:17.615671+0000","last_unstale":"2023-10-08T16:09:06.644348+0000","last_undegraded":"2023-10-08T16:09:06.644348+0000","last_fullsized":"2023-10-08T16:09:06.644348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:05.041349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.043805617999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"28'75","reported_seq":155,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:07.150577+0000","last_change":"2023-10-08T16:04:16.654721+0000","last_active":"2023-10-08T16:09:07.150577+0000","last_peered":"2023-10-08T16:09:07.150577+0000","last_clean":"2023-10-08T16:09:07.150577+0000","last_became_active":"2023-10-08T16:04:16.654359+0000","last_became_peered":"2023-10-08T16:04:16.654359+0000","last_unstale":"2023-10-08T16:09:07.150577+0000","last_undegraded":"2023-10-08T16:09:07.150577+0000","last_fullsized":"2023-10-08T16:09:07.150577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:04.030037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":279988,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":321,"num_write":71,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'386","reported_seq":453,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.621683+0000","last_change":"2023-10-08T16:08:50.765489+0000","last_active":"2023-10-08T16:09:06.621683+0000","last_peered":"2023-10-08T16:09:06.621683+0000","last_clean":"2023-10-08T16:09:06.621683+0000","last_became_active":"2023-10-08T16:04:17.624876+0000","last_became_peered":"2023-10-08T16:04:17.624876+0000","last_unstale":"2023-10-08T16:09:06.621683+0000","last_undegraded":"2023-10-08T16:09:06.621683+0000","last_fullsized":"2023-10-08T16:09:06.621683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:15.965581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024289327999999999,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"27'1399","reported_seq":1417,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:52.140934+0000","last_change":"2023-10-08T16:04:16.654812+0000","last_active":"2023-10-08T16:08:52.140934+0000","last_peered":"2023-10-08T16:08:52.140934+0000","last_clean":"2023-10-08T16:08:52.140934+0000","last_became_active":"2023-10-08T16:04:16.654454+0000","last_became_peered":"2023-10-08T16:04:16.654454+0000","last_unstale":"2023-10-08T16:08:52.140934+0000","last_undegraded":"2023-10-08T16:08:52.140934+0000","last_fullsized":"2023-10-08T16:08:52.140934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1399,"log_dups_size":0,"ondisk_log_size":1399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1390,"num_write_kb":8905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"28'618","reported_seq":686,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.642629+0000","last_change":"2023-10-08T16:08:50.750159+0000","last_active":"2023-10-08T16:09:06.642629+0000","last_peered":"2023-10-08T16:09:06.642629+0000","last_clean":"2023-10-08T16:09:06.642629+0000","last_became_active":"2023-10-08T16:04:17.619294+0000","last_became_peered":"2023-10-08T16:04:17.619294+0000","last_unstale":"2023-10-08T16:09:06.642629+0000","last_undegraded":"2023-10-08T16:09:06.642629+0000","last_fullsized":"2023-10-08T16:09:06.642629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:25.789851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011233748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"27'7","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.141419+0000","last_change":"2023-10-08T16:04:16.662004+0000","last_active":"2023-10-08T16:08:55.141419+0000","last_peered":"2023-10-08T16:08:55.141419+0000","last_clean":"2023-10-08T16:08:55.141419+0000","last_became_active":"2023-10-08T16:04:16.661756+0000","last_became_peered":"2023-10-08T16:04:16.661756+0000","last_unstale":"2023-10-08T16:08:55.141419+0000","last_undegraded":"2023-10-08T16:08:55.141419+0000","last_fullsized":"2023-10-08T16:08:55.141419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:06.774566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"28'513","reported_seq":581,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.648937+0000","last_change":"2023-10-08T16:08:50.726661+0000","last_active":"2023-10-08T16:09:06.648937+0000","last_peered":"2023-10-08T16:09:06.648937+0000","last_clean":"2023-10-08T16:09:06.648937+0000","last_became_active":"2023-10-08T16:04:17.616348+0000","last_became_peered":"2023-10-08T16:04:17.616348+0000","last_unstale":"2023-10-08T16:09:06.648937+0000","last_undegraded":"2023-10-08T16:09:06.648937+0000","last_fullsized":"2023-10-08T16:09:06.648937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:08.121055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016977602000000001,"stat_sum":{"num_bytes":4107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"26'21","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.712617+0000","last_change":"2023-10-08T16:04:16.662731+0000","last_active":"2023-10-08T16:08:50.712617+0000","last_peered":"2023-10-08T16:08:50.712617+0000","last_clean":"2023-10-08T16:08:50.712617+0000","last_became_active":"2023-10-08T16:04:16.662446+0000","last_became_peered":"2023-10-08T16:04:16.662446+0000","last_unstale":"2023-10-08T16:08:50.712617+0000","last_undegraded":"2023-10-08T16:08:50.712617+0000","last_fullsized":"2023-10-08T16:08:50.712617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:59.297962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'604","reported_seq":672,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.613363+0000","last_change":"2023-10-08T16:08:50.759947+0000","last_active":"2023-10-08T16:09:06.613363+0000","last_peered":"2023-10-08T16:09:06.613363+0000","last_clean":"2023-10-08T16:09:06.613363+0000","last_became_active":"2023-10-08T16:04:17.624319+0000","last_became_peered":"2023-10-08T16:04:17.624319+0000","last_unstale":"2023-10-08T16:09:06.613363+0000","last_undegraded":"2023-10-08T16:09:06.613363+0000","last_fullsized":"2023-10-08T16:09:06.613363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024480915999999998,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"28'46","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:05.448064+0000","last_change":"2023-10-08T16:04:16.661076+0000","last_active":"2023-10-08T16:09:05.448064+0000","last_peered":"2023-10-08T16:09:05.448064+0000","last_clean":"2023-10-08T16:09:05.448064+0000","last_became_active":"2023-10-08T16:04:16.660704+0000","last_became_peered":"2023-10-08T16:04:16.660704+0000","last_unstale":"2023-10-08T16:09:05.448064+0000","last_undegraded":"2023-10-08T16:09:05.448064+0000","last_fullsized":"2023-10-08T16:09:05.448064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"28'626","reported_seq":694,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646062+0000","last_change":"2023-10-08T16:08:50.715485+0000","last_active":"2023-10-08T16:09:06.646062+0000","last_peered":"2023-10-08T16:09:06.646062+0000","last_clean":"2023-10-08T16:09:06.646062+0000","last_became_active":"2023-10-08T16:04:17.631615+0000","last_became_peered":"2023-10-08T16:04:17.631615+0000","last_unstale":"2023-10-08T16:09:06.646062+0000","last_undegraded":"2023-10-08T16:09:06.646062+0000","last_fullsized":"2023-10-08T16:09:06.646062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.599406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011336120999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"27'12","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:53.144513+0000","last_change":"2023-10-08T16:04:16.659489+0000","last_active":"2023-10-08T16:08:53.144513+0000","last_peered":"2023-10-08T16:08:53.144513+0000","last_clean":"2023-10-08T16:08:53.144513+0000","last_became_active":"2023-10-08T16:04:16.659148+0000","last_became_peered":"2023-10-08T16:04:16.659148+0000","last_unstale":"2023-10-08T16:08:53.144513+0000","last_undegraded":"2023-10-08T16:08:53.144513+0000","last_fullsized":"2023-10-08T16:08:53.144513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'436","reported_seq":505,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.624840+0000","last_change":"2023-10-08T16:08:50.780938+0000","last_active":"2023-10-08T16:09:06.624840+0000","last_peered":"2023-10-08T16:09:06.624840+0000","last_clean":"2023-10-08T16:09:06.624840+0000","last_became_active":"2023-10-08T16:04:17.624385+0000","last_became_peered":"2023-10-08T16:04:17.624385+0000","last_unstale":"2023-10-08T16:09:06.624840+0000","last_undegraded":"2023-10-08T16:09:06.624840+0000","last_fullsized":"2023-10-08T16:09:06.624840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.044071592,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"26'758","reported_seq":776,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.711386+0000","last_change":"2023-10-08T16:04:16.662618+0000","last_active":"2023-10-08T16:08:50.711386+0000","last_peered":"2023-10-08T16:08:50.711386+0000","last_clean":"2023-10-08T16:08:50.711386+0000","last_became_active":"2023-10-08T16:04:16.662327+0000","last_became_peered":"2023-10-08T16:04:16.662327+0000","last_unstale":"2023-10-08T16:08:50.711386+0000","last_undegraded":"2023-10-08T16:08:50.711386+0000","last_fullsized":"2023-10-08T16:08:50.711386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:06:41.062441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":753,"num_write_kb":4504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'450","reported_seq":518,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.642591+0000","last_change":"2023-10-08T16:08:50.749200+0000","last_active":"2023-10-08T16:09:06.642591+0000","last_peered":"2023-10-08T16:09:06.642591+0000","last_clean":"2023-10-08T16:09:06.642591+0000","last_became_active":"2023-10-08T16:04:17.622898+0000","last_became_peered":"2023-10-08T16:04:17.622898+0000","last_unstale":"2023-10-08T16:09:06.642591+0000","last_undegraded":"2023-10-08T16:09:06.642591+0000","last_fullsized":"2023-10-08T16:09:06.642591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:47.130200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075401410000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'10","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.773333+0000","last_change":"2023-10-08T16:04:16.661483+0000","last_active":"2023-10-08T16:08:57.773333+0000","last_peered":"2023-10-08T16:08:57.773333+0000","last_clean":"2023-10-08T16:08:57.773333+0000","last_became_active":"2023-10-08T16:04:16.661055+0000","last_became_peered":"2023-10-08T16:04:16.661055+0000","last_unstale":"2023-10-08T16:08:57.773333+0000","last_undegraded":"2023-10-08T16:08:57.773333+0000","last_fullsized":"2023-10-08T16:08:57.773333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"28'501","reported_seq":569,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.626089+0000","last_change":"2023-10-08T16:08:50.713213+0000","last_active":"2023-10-08T16:09:06.626089+0000","last_peered":"2023-10-08T16:09:06.626089+0000","last_clean":"2023-10-08T16:09:06.626089+0000","last_became_active":"2023-10-08T16:04:17.626991+0000","last_became_peered":"2023-10-08T16:04:17.626991+0000","last_unstale":"2023-10-08T16:09:06.626089+0000","last_undegraded":"2023-10-08T16:09:06.626089+0000","last_fullsized":"2023-10-08T16:09:06.626089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:56.205550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010148346000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'11","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:52.136834+0000","last_change":"2023-10-08T16:04:16.657613+0000","last_active":"2023-10-08T16:08:52.136834+0000","last_peered":"2023-10-08T16:08:52.136834+0000","last_clean":"2023-10-08T16:08:52.136834+0000","last_became_active":"2023-10-08T16:04:16.657299+0000","last_became_peered":"2023-10-08T16:04:16.657299+0000","last_unstale":"2023-10-08T16:08:52.136834+0000","last_undegraded":"2023-10-08T16:08:52.136834+0000","last_fullsized":"2023-10-08T16:08:52.136834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:24.778540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"28'597","reported_seq":663,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.632951+0000","last_change":"2023-10-08T16:08:50.715044+0000","last_active":"2023-10-08T16:09:06.632951+0000","last_peered":"2023-10-08T16:09:06.632951+0000","last_clean":"2023-10-08T16:09:06.632951+0000","last_became_active":"2023-10-08T16:04:17.620693+0000","last_became_peered":"2023-10-08T16:04:17.620693+0000","last_unstale":"2023-10-08T16:09:06.632951+0000","last_undegraded":"2023-10-08T16:09:06.632951+0000","last_fullsized":"2023-10-08T16:09:06.632951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011078684,"stat_sum":{"num_bytes":4121,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'97","reported_seq":115,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.712638+0000","last_change":"2023-10-08T16:04:16.663488+0000","last_active":"2023-10-08T16:08:50.712638+0000","last_peered":"2023-10-08T16:08:50.712638+0000","last_clean":"2023-10-08T16:08:50.712638+0000","last_became_active":"2023-10-08T16:04:16.663184+0000","last_became_peered":"2023-10-08T16:04:16.663184+0000","last_unstale":"2023-10-08T16:08:50.712638+0000","last_undegraded":"2023-10-08T16:08:50.712638+0000","last_fullsized":"2023-10-08T16:08:50.712638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:26.863386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":4152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"28'778","reported_seq":846,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.637315+0000","last_change":"2023-10-08T16:08:50.716768+0000","last_active":"2023-10-08T16:09:06.637315+0000","last_peered":"2023-10-08T16:09:06.637315+0000","last_clean":"2023-10-08T16:09:06.637315+0000","last_became_active":"2023-10-08T16:04:17.622898+0000","last_became_peered":"2023-10-08T16:04:17.622898+0000","last_unstale":"2023-10-08T16:09:06.637315+0000","last_undegraded":"2023-10-08T16:09:06.637315+0000","last_fullsized":"2023-10-08T16:09:06.637315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:33.720945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012379262,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"28'812","reported_seq":879,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.648671+0000","last_change":"2023-10-08T16:08:50.726432+0000","last_active":"2023-10-08T16:09:06.648671+0000","last_peered":"2023-10-08T16:09:06.648671+0000","last_clean":"2023-10-08T16:09:06.648671+0000","last_became_active":"2023-10-08T16:04:17.617179+0000","last_became_peered":"2023-10-08T16:04:17.617179+0000","last_unstale":"2023-10-08T16:09:06.648671+0000","last_undegraded":"2023-10-08T16:09:06.648671+0000","last_fullsized":"2023-10-08T16:09:06.648671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:56.205550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016893819000000001,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"27'2503","reported_seq":2521,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:52.142091+0000","last_change":"2023-10-08T16:04:16.661467+0000","last_active":"2023-10-08T16:08:52.142091+0000","last_peered":"2023-10-08T16:08:52.142091+0000","last_clean":"2023-10-08T16:08:52.142091+0000","last_became_active":"2023-10-08T16:04:16.661215+0000","last_became_peered":"2023-10-08T16:04:16.661215+0000","last_unstale":"2023-10-08T16:08:52.142091+0000","last_undegraded":"2023-10-08T16:08:52.142091+0000","last_fullsized":"2023-10-08T16:08:52.142091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":2503,"log_dups_size":0,"ondisk_log_size":2503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2502,"num_write_kb":5839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'612","reported_seq":679,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.647511+0000","last_change":"2023-10-08T16:08:50.727342+0000","last_active":"2023-10-08T16:09:06.647511+0000","last_peered":"2023-10-08T16:09:06.647511+0000","last_clean":"2023-10-08T16:09:06.647511+0000","last_became_active":"2023-10-08T16:04:17.617216+0000","last_became_peered":"2023-10-08T16:04:17.617216+0000","last_unstale":"2023-10-08T16:09:06.647511+0000","last_undegraded":"2023-10-08T16:09:06.647511+0000","last_fullsized":"2023-10-08T16:09:06.647511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:07.051965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020241687000000001,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1661","reported_seq":1679,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.914438+0000","last_change":"2023-10-08T16:04:16.661825+0000","last_active":"2023-10-08T16:09:06.914438+0000","last_peered":"2023-10-08T16:09:06.914438+0000","last_clean":"2023-10-08T16:09:06.914438+0000","last_became_active":"2023-10-08T16:04:16.661224+0000","last_became_peered":"2023-10-08T16:04:16.661224+0000","last_unstale":"2023-10-08T16:09:06.914438+0000","last_undegraded":"2023-10-08T16:09:06.914438+0000","last_fullsized":"2023-10-08T16:09:06.914438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1661,"log_dups_size":0,"ondisk_log_size":1661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:08.375883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9337974,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1649,"num_write_kb":9964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"28'531","reported_seq":599,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.648573+0000","last_change":"2023-10-08T16:08:50.784243+0000","last_active":"2023-10-08T16:09:06.648573+0000","last_peered":"2023-10-08T16:09:06.648573+0000","last_clean":"2023-10-08T16:09:06.648573+0000","last_became_active":"2023-10-08T16:04:17.621550+0000","last_became_peered":"2023-10-08T16:04:17.621550+0000","last_unstale":"2023-10-08T16:09:06.648573+0000","last_undegraded":"2023-10-08T16:09:06.648573+0000","last_fullsized":"2023-10-08T16:09:06.648573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:33.720945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.046468506999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"26'764","reported_seq":782,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.704289+0000","last_change":"2023-10-08T16:04:16.662223+0000","last_active":"2023-10-08T16:08:50.704289+0000","last_peered":"2023-10-08T16:08:50.704289+0000","last_clean":"2023-10-08T16:08:50.704289+0000","last_became_active":"2023-10-08T16:04:16.661907+0000","last_became_peered":"2023-10-08T16:04:16.661907+0000","last_unstale":"2023-10-08T16:08:50.704289+0000","last_undegraded":"2023-10-08T16:08:50.704289+0000","last_fullsized":"2023-10-08T16:08:50.704289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:04.030037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":4591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"28'524","reported_seq":592,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.637537+0000","last_change":"2023-10-08T16:08:50.715393+0000","last_active":"2023-10-08T16:09:06.637537+0000","last_peered":"2023-10-08T16:09:06.637537+0000","last_clean":"2023-10-08T16:09:06.637537+0000","last_became_active":"2023-10-08T16:04:17.627562+0000","last_became_peered":"2023-10-08T16:04:17.627562+0000","last_unstale":"2023-10-08T16:09:06.637537+0000","last_undegraded":"2023-10-08T16:09:06.637537+0000","last_fullsized":"2023-10-08T16:09:06.637537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:08.121055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011393438000000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"27'2621","reported_seq":2639,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:51.147036+0000","last_change":"2023-10-08T16:04:16.663088+0000","last_active":"2023-10-08T16:08:51.147036+0000","last_peered":"2023-10-08T16:08:51.147036+0000","last_clean":"2023-10-08T16:08:51.147036+0000","last_became_active":"2023-10-08T16:04:16.662714+0000","last_became_peered":"2023-10-08T16:04:16.662714+0000","last_unstale":"2023-10-08T16:08:51.147036+0000","last_undegraded":"2023-10-08T16:08:51.147036+0000","last_fullsized":"2023-10-08T16:08:51.147036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":2621,"log_dups_size":0,"ondisk_log_size":2621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:54.682083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2619,"num_write_kb":5944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":82,"num_object_clones":21,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":8,"num_read":31,"num_read_kb":21,"num_write":110,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37743,"ondisk_log_size":37743,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":85116848,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":62,"num_read_kb":321,"num_write":17968,"num_write_kb":93757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":170295296,"data_stored":170233696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18056,"ondisk_log_size":18056,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":348300,"kb_used_data":38724,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94023540,"statfs":{"total":96636764160,"available":96280104960,"internally_reserved":0,"allocated":39653376,"data_stored":39442383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.84699999999999998,"15min":0.86699999999999999},"min":{"1min":0.48799999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2989999999999999,"5min":1.976,"15min":1.976},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.83699999999999997,"15min":0.86299999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.121,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.81999999999999995}]},{"osd":1,"last update":"Sun Oct 8 16:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85099999999999998,"15min":0.86599999999999999},"min":{"1min":0.54200000000000004,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89900000000000002,"15min":0.91200000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.98799999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90400000000000003},"min":{"1min":0.57599999999999996,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3720000000000001,"5min":1.478,"15min":1.478},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.876,"5min":0.89700000000000002,"15min":0.92400000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2410000000000001,"5min":1.948,"15min":1.948},"last":1.0680000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.97099999999999997,"15min":0.98099999999999998},"min":{"1min":0.626,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2589999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.0249999999999999,"15min":1.0509999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.335,"5min":1.552,"15min":1.552},"last":0.90600000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:08:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.997,"15min":1.006},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.05,"5min":1.069,"15min":1.0860000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.339,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.871}]},{"osd":5,"last update":"Sun Oct 8 16:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.0429999999999999,"15min":1.0629999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3160000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.997,"5min":1.103,"15min":1.1259999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.3859999999999999,"5min":1.726,"15min":1.726},"last":0.93600000000000005}]},{"osd":6,"last update":"Sun Oct 8 16:08:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1890000000000001,"15min":1.2210000000000001},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4350000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.1859999999999999,"15min":1.2010000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.611,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.04}]}]},{"osd":6,"up_from":13,"seq":55834574912,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319044,"kb_used_data":17660,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94052796,"statfs":{"total":96636764160,"available":96310063104,"internally_reserved":0,"allocated":18083840,"data_stored":17880545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.75,"15min":0.76000000000000001},"min":{"1min":0.52700000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.325,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.77500000000000002,"15min":0.72899999999999998},"min":{"1min":0.51300000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2529999999999999,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.90600000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.91100000000000003,"15min":0.91200000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3180000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.45700000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.1990000000000001,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.0289999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.86299999999999999,"15min":0.84899999999999998},"min":{"1min":0.54200000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.21,"5min":1.25,"15min":1.25},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.90600000000000003,"15min":0.91500000000000004},"min":{"1min":0.57699999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.1779999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.89800000000000002,"15min":0.85199999999999998},"min":{"1min":0.64300000000000002,"5min":0.501,"15min":0.501},"max":{"1min":2.173,"5min":2.173,"15min":2.173},"last":0.747},{"interface":"front","average":{"1min":1,"5min":0.997,"15min":0.96199999999999997},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2869999999999999,"5min":1.381,"15min":1.381},"last":1.2190000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.98499999999999999,"15min":1.0029999999999999},"min":{"1min":0.61199999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0489999999999999,"15min":1.022},"min":{"1min":0.72299999999999998,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":1.083}]},{"osd":5,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.083,"15min":1.0409999999999999},"min":{"1min":0.70099999999999996,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":4.4269999999999996,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.8540000000000001,"5min":1.274,"15min":1.1919999999999999},"min":{"1min":0.88300000000000001,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":17.428999999999998,"5min":17.428999999999998,"15min":17.428999999999998},"last":1.2709999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.117,"15min":1.089},"min":{"1min":0.79600000000000004,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.3839999999999999,"5min":1.905,"15min":1.905},"last":1.248},{"interface":"front","average":{"1min":1.159,"5min":1.2070000000000001,"15min":1.1970000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.4279999999999999,"5min":1.724,"15min":1.724},"last":1.3049999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574913,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":330424,"kb_used_data":20848,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94041416,"statfs":{"total":96636764160,"available":96298409984,"internally_reserved":0,"allocated":21348352,"data_stored":21141337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.82499999999999996,"15min":0.88400000000000001},"min":{"1min":0.439,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.105,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79500000000000004,"15min":0.81399999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.175,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.56999999999999995}]},{"osd":1,"last update":"Sun Oct 8 16:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81999999999999995,"15min":0.82399999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1919999999999999,"5min":1.631,"15min":1.631},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.874,"15min":0.88900000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2529999999999999,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.88300000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.88800000000000001,"15min":0.90500000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.286,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.873,"5min":0.89700000000000002,"15min":0.89600000000000002},"min":{"1min":0.626,"5min":0.496,"15min":0.496},"max":{"1min":1.2230000000000001,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.80200000000000005}]},{"osd":3,"last update":"Sun Oct 8 16:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.97199999999999998,"15min":0.995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3100000000000001,"5min":1.671,"15min":1.671},"last":1.01},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0309999999999999,"15min":1.0549999999999999},"min":{"1min":0.64600000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.3049999999999999,"5min":1.974,"15min":1.974},"last":1.0569999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":1.05,"15min":1.0569999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.222,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.095},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0600000000000001,"15min":1.111},"min":{"1min":0.72399999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.353,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.84699999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:08:09 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.0600000000000001,"15min":1.083},"min":{"1min":0.73399999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.3080000000000001,"5min":1.835,"15min":1.835},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.079,"5min":1.1659999999999999,"15min":1.224},"min":{"1min":0.79900000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.423,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.1719999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:08:09 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.1579999999999999,"15min":1.2190000000000001},"min":{"1min":0.75800000000000001,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4039999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.131,"5min":1.1799999999999999,"15min":1.1930000000000001},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.381,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.034}]}]},{"osd":4,"up_from":13,"seq":55834574912,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":334488,"kb_used_data":29008,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94037352,"statfs":{"total":96636764160,"available":96294248448,"internally_reserved":0,"allocated":29704192,"data_stored":29497190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.81599999999999995,"15min":0.81799999999999995},"min":{"1min":0.48899999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.089,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79400000000000004,"15min":0.78600000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.1000000000000001,"5min":1.641,"15min":1.641},"last":1.0680000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.82599999999999996,"15min":0.84599999999999997},"min":{"1min":0.59599999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.044,"5min":1.292,"15min":1.292},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88600000000000001,"15min":0.872},"min":{"1min":0.49299999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.2609999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.91600000000000004}]},{"osd":2,"last update":"Sun Oct 8 16:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.87,"15min":0.876},"min":{"1min":0.55800000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0089999999999999,"15min":0.96299999999999997},"min":{"1min":0.67800000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2789999999999999,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.68999999999999995}]},{"osd":3,"last update":"Sun Oct 8 16:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.94299999999999995,"15min":0.97299999999999998},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.244,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":1.02,"5min":1.0620000000000001,"15min":1.0980000000000001},"min":{"1min":0.73199999999999998,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.333,"5min":1.448,"15min":1.448},"last":0.73199999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:08:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0309999999999999,"15min":1.026},"min":{"1min":0.68999999999999995,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3680000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.018},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.1120000000000001,"15min":1.079},"min":{"1min":0.67000000000000004,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3540000000000001,"5min":9.8480000000000008,"15min":9.8480000000000008},"last":0.88100000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:08:10 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.0860000000000001,"15min":1.1459999999999999},"min":{"1min":0.70299999999999996,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.3779999999999999,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.1699999999999999,"15min":1.175},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.421,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.099}]},{"osd":7,"last update":"Sun Oct 8 16:08:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.2030000000000001,"15min":1.173},"min":{"1min":0.82899999999999996,"5min":0.75,"15min":0.75},"max":{"1min":1.415,"5min":8.8290000000000006,"15min":8.8290000000000006},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.2170000000000001,"15min":1.2729999999999999},"min":{"1min":0.88800000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.4299999999999999,"5min":1.71,"15min":1.71},"last":1.0429999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574911,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":318408,"kb_used_data":17024,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94053432,"statfs":{"total":96636764160,"available":96310714368,"internally_reserved":0,"allocated":17432576,"data_stored":17223470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65300000000000002,"15min":0.66000000000000003},"min":{"1min":0.52400000000000002,"5min":0.214,"15min":0.214},"max":{"1min":0.89100000000000001,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70299999999999996,"15min":0.71099999999999997},"min":{"1min":0.40999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.026,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":1.026}]},{"osd":1,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.69999999999999996,"15min":0.65600000000000003},"min":{"1min":0.42399999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1120000000000001,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.85099999999999998,"15min":0.76900000000000002},"min":{"1min":0.45700000000000002,"5min":0.249,"15min":0.249},"max":{"1min":1.3420000000000001,"5min":8.3059999999999992,"15min":8.3059999999999992},"last":0.85399999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.1100000000000001,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.81299999999999994,"15min":0.78500000000000003},"min":{"1min":0.53900000000000003,"5min":0.433,"15min":0.433},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.81200000000000006}]},{"osd":4,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.99299999999999999,"15min":1.0309999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.2310000000000001,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.04,"5min":0.997,"15min":1.0049999999999999},"min":{"1min":0.74399999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3919999999999999,"5min":2.202,"15min":2.202},"last":0.97199999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0569999999999999,"15min":1.0820000000000001},"min":{"1min":0.69099999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.4379999999999999,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":1.099},{"interface":"front","average":{"1min":1.012,"5min":1.0760000000000001,"15min":1.099},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.341,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.256}]},{"osd":6,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0620000000000001,"15min":1.0680000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3220000000000001,"5min":2.113,"15min":2.113},"last":1.161},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1299999999999999,"15min":1.1679999999999999},"min":{"1min":0.72999999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.5129999999999999,"5min":3.351,"15min":3.351},"last":1.3280000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.1459999999999999,"15min":1.2110000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.353,"5min":2.984,"15min":2.984},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.1799999999999999,"15min":1.141},"min":{"1min":0.69999999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":6.3940000000000001,"5min":6.3940000000000001,"15min":6.3940000000000001},"last":1.228}]}]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310200,"kb_used_data":4720,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94061640,"statfs":{"total":96636764160,"available":96319119360,"internally_reserved":0,"allocated":4833280,"data_stored":4631728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.36099999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63,"15min":0.621},"min":{"1min":0.44800000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.83899999999999997,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.71099999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.72199999999999998,"15min":0.748},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.753,"15min":0.74099999999999999},"min":{"1min":0.52400000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.92500000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.74399999999999999,"15min":0.75900000000000001},"min":{"1min":0.57899999999999996,"5min":0.315,"15min":0.315},"max":{"1min":0.871,"5min":1.454,"15min":1.454},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.86399999999999999,"15min":0.874},"min":{"1min":0.505,"5min":0.433,"15min":0.433},"max":{"1min":1.115,"5min":1.306,"15min":1.306},"last":0.88}]},{"osd":4,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.97299999999999998,"15min":1.0149999999999999},"min":{"1min":0.60499999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2250000000000001,"5min":1.954,"15min":1.954},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.998,"15min":1.0349999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.377,"5min":1.804,"15min":1.804},"last":1.012}]},{"osd":5,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.96499999999999997,"15min":1.0149999999999999},"min":{"1min":0.61699999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.401,"5min":1.873,"15min":1.873},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0569999999999999,"15min":1.0960000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.206,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.0369999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.05,"15min":1.0860000000000001},"min":{"1min":0.70399999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.329,"5min":1.974,"15min":1.974},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.995,"5min":1.0469999999999999,"15min":1.079},"min":{"1min":0.66300000000000003,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.361,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.121}]},{"osd":7,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.1140000000000001,"15min":1.147},"min":{"1min":0.84999999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.3029999999999999,"5min":1.915,"15min":1.915},"last":1.159},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.115,"15min":1.1599999999999999},"min":{"1min":0.79100000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.4219999999999999,"5min":2.524,"15min":2.524},"last":1.234}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326288,"kb_used_data":20808,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94045552,"statfs":{"total":96636764160,"available":96302645248,"internally_reserved":0,"allocated":21307392,"data_stored":21108603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60399999999999998,"15min":0.60799999999999998},"min":{"1min":0.315,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.98999999999999999,"5min":1.024,"15min":1.024},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.65700000000000003,"15min":0.65100000000000002},"min":{"1min":0.39100000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.522}]},{"osd":2,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68200000000000005,"15min":0.65000000000000002},"min":{"1min":0.42899999999999999,"5min":0.373,"15min":0.373},"max":{"1min":1.3129999999999999,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":1.3460000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.747,"15min":0.76300000000000001},"min":{"1min":0.53100000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.65100000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79500000000000004,"15min":0.83799999999999997},"min":{"1min":0.51200000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.224,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.76400000000000001,"15min":0.76300000000000001},"min":{"1min":0.47199999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.153,"5min":1.25,"15min":1.25},"last":2.0449999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.90900000000000003,"15min":0.93200000000000005},"min":{"1min":0.60399999999999998,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.173,"5min":1.492,"15min":1.492},"last":1.845},{"interface":"front","average":{"1min":0.91200000000000003,"5min":1.0169999999999999,"15min":1.0149999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2210000000000001,"5min":3.5910000000000002,"15min":3.5910000000000002},"last":1.5700000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":1.03,"15min":1.0369999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.2829999999999999,"5min":3.6280000000000001,"15min":3.6280000000000001},"last":1.472},{"interface":"front","average":{"1min":1.109,"5min":1.075,"15min":1.113},"min":{"1min":0.69499999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.4650000000000001,"5min":1.641,"15min":1.641},"last":0.872}]},{"osd":6,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0409999999999999,"15min":1.091},"min":{"1min":0.71299999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.4299999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.7569999999999999},{"interface":"front","average":{"1min":1.012,"5min":1.117,"15min":1.1419999999999999},"min":{"1min":0.71099999999999997,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3660000000000001,"5min":3.657,"15min":3.657},"last":1.6339999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.103,"15min":1.1499999999999999},"min":{"1min":0.751,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.548,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.079,"5min":1.085,"15min":1.1220000000000001},"min":{"1min":0.68200000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3260000000000001,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":2.101}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":330996,"kb_used_data":21420,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94040844,"statfs":{"total":96636764160,"available":96297824256,"internally_reserved":0,"allocated":21934080,"data_stored":21706793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.66000000000000003,"15min":0.64500000000000002},"min":{"1min":0.46000000000000002,"5min":0.318,"15min":0.318},"max":{"1min":3.9449999999999998,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.40699999999999997,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1659999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.68999999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.72099999999999997,"15min":0.70299999999999996},"min":{"1min":0.52100000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.755},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.77800000000000002,"15min":0.77400000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.3340000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.83399999999999996}]},{"osd":3,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.42699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":4.2229999999999999,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.84099999999999997,"15min":0.82299999999999995},"min":{"1min":0.628,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.88300000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.99199999999999999,"15min":0.999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.722,"5min":1.734,"15min":1.734},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.97299999999999998,"15min":1.014},"min":{"1min":0.63400000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.286,"5min":1.552,"15min":1.552},"last":1.006}]},{"osd":5,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.98399999999999999,"15min":1.0109999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.361,"5min":1.601,"15min":1.601},"last":1.157},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.0740000000000001,"15min":1.0760000000000001},"min":{"1min":0.76900000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.133}]},{"osd":6,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.115,"15min":1.129},"min":{"1min":0.71899999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.056},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1060000000000001,"15min":1.087},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.0900000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.161,"15min":1.157},"min":{"1min":0.81499999999999995,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.0940000000000001,"15min":1.1160000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":1.228}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20983808,"data_stored":20972130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20979712,"data_stored":20971680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4476928,"data_stored":4474292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17068032,"data_stored":17057848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17735680,"data_stored":17727226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":38703104,"data_stored":38698656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":24687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":16404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":36917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":45103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":16417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":49208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":32800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":32840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:09:14.698 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:09:14.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.805+0000 7fe491a6c700 1 Processor -- start 2023-10-08T16:09:14.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.805+0000 7fe491a6c700 1 -- start start 2023-10-08T16:09:14.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe491a6c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe48c142a80 0x7fe48c142f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:14.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe491a6c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe48c13bcc0 0x7fe48c13c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:14.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe491a6c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48c06c5c0 con 0x7fe48c0b2ec0 2023-10-08T16:09:14.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe491a6c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe48c1425a0 con 0x7fe48c142a80 2023-10-08T16:09:14.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe491a6c700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe48c146550 con 0x7fe48c13bcc0 2023-10-08T16:09:14.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe483fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe48c142a80 0x7fe48c142f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:14.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe483fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe48c142a80 0x7fe48c142f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48378/0 (socket says 172.21.15.133:48378) 2023-10-08T16:09:14.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe483fff700 1 -- 172.21.15.133:0/2970657506 learned_addr learned my addr 172.21.15.133:0/2970657506 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:14.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe49126b700 1 --2- 172.21.15.133:0/2970657506 >> v2:172.21.15.190:3300/0 conn(0x7fe48c13bcc0 0x7fe48c13c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:14.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe483fff700 1 -- 172.21.15.133:0/2970657506 >> v2:172.21.15.190:3300/0 conn(0x7fe48c13bcc0 msgr2=0x7fe48c13c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:14.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe483fff700 1 --2- 172.21.15.133:0/2970657506 >> v2:172.21.15.190:3300/0 conn(0x7fe48c13bcc0 0x7fe48c13c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:14.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe483fff700 1 -- 172.21.15.133:0/2970657506 >> v1:172.21.15.133:6789/0 conn(0x7fe48c0b2ec0 legacy=0x7fe48c145a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:14.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe483fff700 1 -- 172.21.15.133:0/2970657506 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c0b3290 con 0x7fe48c142a80 2023-10-08T16:09:14.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe483fff700 1 --2- 172.21.15.133:0/2970657506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe48c142a80 0x7fe48c142f00 secure :-1 s=READY pgs=4353 cs=0 l=1 rev1=1 crypto rx=0x7fe48c06b110 tx=0x7fe47c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1c7f3fff5bee9b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:14.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe4837fe700 1 -- 172.21.15.133:0/2970657506 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c00b860 con 0x7fe48c142a80 2023-10-08T16:09:14.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe4837fe700 1 -- 172.21.15.133:0/2970657506 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47c00b9c0 con 0x7fe48c142a80 2023-10-08T16:09:14.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe4837fe700 1 -- 172.21.15.133:0/2970657506 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c00bd60 con 0x7fe48c142a80 2023-10-08T16:09:14.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe491a6c700 1 -- 172.21.15.133:0/2970657506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe48c142a80 msgr2=0x7fe48c142f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:14.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe491a6c700 1 --2- 172.21.15.133:0/2970657506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe48c142a80 0x7fe48c142f00 secure :-1 s=READY pgs=4353 cs=0 l=1 rev1=1 crypto rx=0x7fe48c06b110 tx=0x7fe47c009250 comp rx=0 tx=0).stop 2023-10-08T16:09:14.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe491a6c700 1 -- 172.21.15.133:0/2970657506 shutdown_connections 2023-10-08T16:09:14.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe491a6c700 1 --2- 172.21.15.133:0/2970657506 >> v2:172.21.15.190:3300/0 conn(0x7fe48c13bcc0 0x7fe48c13c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:14.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe491a6c700 1 --2- 172.21.15.133:0/2970657506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe48c142a80 0x7fe48c142f00 unknown :-1 s=CLOSED pgs=4353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:14.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe491a6c700 1 -- 172.21.15.133:0/2970657506 >> 172.21.15.133:0/2970657506 conn(0x7fe48c067a60 msgr2=0x7fe48c0b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:14.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe491a6c700 1 -- 172.21.15.133:0/2970657506 shutdown_connections 2023-10-08T16:09:14.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe491a6c700 1 -- 172.21.15.133:0/2970657506 wait complete. 2023-10-08T16:09:14.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe491a6c700 1 Processor -- start 2023-10-08T16:09:14.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.809+0000 7fe491a6c700 1 -- start start 2023-10-08T16:09:14.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.813+0000 7fe491a6c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe48c0b2ec0 0x7fe48c0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:14.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.813+0000 7fe491a6c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe48c13bcc0 0x7fe48c06d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:14.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.813+0000 7fe491a6c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe48c142a80 0x7fe48c06dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:14.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.813+0000 7fe491a6c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c06e630 con 0x7fe48c13bcc0 2023-10-08T16:09:14.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.813+0000 7fe491a6c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c0aab90 con 0x7fe48c0b2ec0 2023-10-08T16:09:14.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.813+0000 7fe491a6c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c0aa920 con 0x7fe48c142a80 2023-10-08T16:09:14.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.813+0000 7fe483fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe48c13bcc0 0x7fe48c06d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:14.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.813+0000 7fe483fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe48c13bcc0 0x7fe48c06d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48386/0 (socket says 172.21.15.133:48386) 2023-10-08T16:09:14.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.813+0000 7fe483fff700 1 -- 172.21.15.133:0/3534322794 learned_addr learned my addr 172.21.15.133:0/3534322794 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:14.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.813+0000 7fe490a6a700 1 --2- 172.21.15.133:0/3534322794 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe48c0b2ec0 0x7fe48c0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:14.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.813+0000 7fe49126b700 1 --2- 172.21.15.133:0/3534322794 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe48c142a80 0x7fe48c06dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:14.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.813+0000 7fe483fff700 1 -- 172.21.15.133:0/3534322794 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe48c142a80 msgr2=0x7fe48c06dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:14.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.813+0000 7fe483fff700 1 --2- 172.21.15.133:0/3534322794 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe48c142a80 0x7fe48c06dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:14.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.813+0000 7fe483fff700 1 -- 172.21.15.133:0/3534322794 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe48c0b2ec0 msgr2=0x7fe48c0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:14.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.813+0000 7fe483fff700 1 --2- 172.21.15.133:0/3534322794 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe48c0b2ec0 0x7fe48c0a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:14.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.813+0000 7fe483fff700 1 -- 172.21.15.133:0/3534322794 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c0094f0 con 0x7fe48c13bcc0 2023-10-08T16:09:14.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.813+0000 7fe483fff700 1 --2- 172.21.15.133:0/3534322794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe48c13bcc0 0x7fe48c06d830 secure :-1 s=READY pgs=4354 cs=0 l=1 rev1=1 crypto rx=0x7fe47c006fd0 tx=0x7fe47c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:14.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.813+0000 7fe480ff9700 1 -- 172.21.15.133:0/3534322794 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c011e00 con 0x7fe48c13bcc0 2023-10-08T16:09:14.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.813+0000 7fe480ff9700 1 -- 172.21.15.133:0/3534322794 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47c01a450 con 0x7fe48c13bcc0 2023-10-08T16:09:14.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.813+0000 7fe491a6c700 1 -- 172.21.15.133:0/3534322794 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe48c0aae70 con 0x7fe48c13bcc0 2023-10-08T16:09:14.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.813+0000 7fe480ff9700 1 -- 172.21.15.133:0/3534322794 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c01a810 con 0x7fe48c13bcc0 2023-10-08T16:09:14.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.813+0000 7fe491a6c700 1 -- 172.21.15.133:0/3534322794 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe48c152430 con 0x7fe48c13bcc0 2023-10-08T16:09:14.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.813+0000 7fe491a6c700 1 -- 172.21.15.133:0/3534322794 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe48c152150 con 0x7fe48c13bcc0 2023-10-08T16:09:14.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.813+0000 7fe480ff9700 1 -- 172.21.15.133:0/3534322794 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe47c01abc0 con 0x7fe48c13bcc0 2023-10-08T16:09:14.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.813+0000 7fe480ff9700 1 --2- 172.21.15.133:0/3534322794 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe478060580 0x7fe478062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:14.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.817+0000 7fe480ff9700 1 -- 172.21.15.133:0/3534322794 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fe47c07e250 con 0x7fe48c13bcc0 2023-10-08T16:09:14.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.817+0000 7fe490a6a700 1 --2- 172.21.15.133:0/3534322794 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe478060580 0x7fe478062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:14.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.817+0000 7fe490a6a700 1 --2- 172.21.15.133:0/3534322794 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe478060580 0x7fe478062a30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe488003a80 tx=0x7fe488007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:14.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.821+0000 7fe480ff9700 1 -- 172.21.15.133:0/3534322794 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe48c152150 con 0x7fe48c13bcc0 2023-10-08T16:09:14.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.981+0000 7fe491a6c700 1 -- 172.21.15.133:0/3534322794 --> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe48c152150 con 0x7fe478060580 2023-10-08T16:09:15.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:14.997+0000 7fe480ff9700 1 -- 172.21.15.133:0/3534322794 <== mgr.4104 v2:172.21.15.133:6832/33362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289814 (secure 0 0 0) 0x7fe48c152150 con 0x7fe478060580 2023-10-08T16:09:15.009 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:09:15.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.009+0000 7fe491a6c700 1 -- 172.21.15.133:0/3534322794 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe478060580 msgr2=0x7fe478062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:15.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.009+0000 7fe491a6c700 1 --2- 172.21.15.133:0/3534322794 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe478060580 0x7fe478062a30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe488003a80 tx=0x7fe488007ec0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.009+0000 7fe491a6c700 1 -- 172.21.15.133:0/3534322794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe48c13bcc0 msgr2=0x7fe48c06d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:15.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.009+0000 7fe491a6c700 1 --2- 172.21.15.133:0/3534322794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe48c13bcc0 0x7fe48c06d830 secure :-1 s=READY pgs=4354 cs=0 l=1 rev1=1 crypto rx=0x7fe47c006fd0 tx=0x7fe47c017000 comp rx=0 tx=0).stop 2023-10-08T16:09:15.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.009+0000 7fe491a6c700 1 -- 172.21.15.133:0/3534322794 shutdown_connections 2023-10-08T16:09:15.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.009+0000 7fe491a6c700 1 --2- 172.21.15.133:0/3534322794 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe478060580 0x7fe478062a30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.009+0000 7fe491a6c700 1 --2- 172.21.15.133:0/3534322794 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe48c142a80 0x7fe48c06dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.009+0000 7fe491a6c700 1 --2- 172.21.15.133:0/3534322794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe48c13bcc0 0x7fe48c06d830 unknown :-1 s=CLOSED pgs=4354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.009+0000 7fe491a6c700 1 --2- 172.21.15.133:0/3534322794 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe48c0b2ec0 0x7fe48c0a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.009+0000 7fe491a6c700 1 -- 172.21.15.133:0/3534322794 >> 172.21.15.133:0/3534322794 conn(0x7fe48c067a60 msgr2=0x7fe48c13b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:15.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.009+0000 7fe491a6c700 1 -- 172.21.15.133:0/3534322794 shutdown_connections 2023-10-08T16:09:15.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.009+0000 7fe491a6c700 1 -- 172.21.15.133:0/3534322794 wait complete. 2023-10-08T16:09:15.014 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-10-08T16:09:15.025 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2023-10-08T16:09:14.939367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":85841592,"num_objects":127,"num_object_clones":21,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":8,"num_read":209,"num_read_kb":442,"num_write":18241,"num_write_kb":96379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55919,"ondisk_log_size":55919,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2618164,"kb_used_data":170228,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752356556,"statfs":{"total":773094113280,"available":770413113344,"internally_reserved":0,"allocated":174313472,"data_stored":172646425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":558481,"num_objects":6,"num_object_clones":3,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":3,"num_read":7,"num_read_kb":8,"num_write":111,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004158"},"pg_stats":[{"pgid":"3.3f","version":"28'511","reported_seq":579,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646405+0000","last_change":"2023-10-08T16:08:50.725515+0000","last_active":"2023-10-08T16:09:06.646405+0000","last_peered":"2023-10-08T16:09:06.646405+0000","last_clean":"2023-10-08T16:09:06.646405+0000","last_became_active":"2023-10-08T16:04:17.626468+0000","last_became_peered":"2023-10-08T16:04:17.626468+0000","last_unstale":"2023-10-08T16:09:06.646405+0000","last_undegraded":"2023-10-08T16:09:06.646405+0000","last_fullsized":"2023-10-08T16:09:06.646405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:37.040973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012965628,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"28'502","reported_seq":570,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.632342+0000","last_change":"2023-10-08T16:08:50.761523+0000","last_active":"2023-10-08T16:09:06.632342+0000","last_peered":"2023-10-08T16:09:06.632342+0000","last_clean":"2023-10-08T16:09:06.632342+0000","last_became_active":"2023-10-08T16:04:17.623968+0000","last_became_peered":"2023-10-08T16:04:17.623968+0000","last_unstale":"2023-10-08T16:09:06.632342+0000","last_undegraded":"2023-10-08T16:09:06.632342+0000","last_fullsized":"2023-10-08T16:09:06.632342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025754998000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"28'750","reported_seq":817,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.628419+0000","last_change":"2023-10-08T16:08:50.782249+0000","last_active":"2023-10-08T16:09:06.628419+0000","last_peered":"2023-10-08T16:09:06.628419+0000","last_clean":"2023-10-08T16:09:06.628419+0000","last_became_active":"2023-10-08T16:04:17.624219+0000","last_became_peered":"2023-10-08T16:04:17.624219+0000","last_unstale":"2023-10-08T16:09:06.628419+0000","last_undegraded":"2023-10-08T16:09:06.628419+0000","last_fullsized":"2023-10-08T16:09:06.628419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:07.785877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.046708411999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'447","reported_seq":515,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.640828+0000","last_change":"2023-10-08T16:08:50.726275+0000","last_active":"2023-10-08T16:09:06.640828+0000","last_peered":"2023-10-08T16:09:06.640828+0000","last_clean":"2023-10-08T16:09:06.640828+0000","last_became_active":"2023-10-08T16:04:17.628308+0000","last_became_peered":"2023-10-08T16:04:17.628308+0000","last_unstale":"2023-10-08T16:09:06.640828+0000","last_undegraded":"2023-10-08T16:09:06.640828+0000","last_fullsized":"2023-10-08T16:09:06.640828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:48.519448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019603182,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'456","reported_seq":523,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646223+0000","last_change":"2023-10-08T16:08:50.725181+0000","last_active":"2023-10-08T16:09:06.646223+0000","last_peered":"2023-10-08T16:09:06.646223+0000","last_clean":"2023-10-08T16:09:06.646223+0000","last_became_active":"2023-10-08T16:04:17.625650+0000","last_became_peered":"2023-10-08T16:04:17.625650+0000","last_unstale":"2023-10-08T16:09:06.646223+0000","last_undegraded":"2023-10-08T16:09:06.646223+0000","last_fullsized":"2023-10-08T16:09:06.646223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:42.972904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013008828,"stat_sum":{"num_bytes":4107,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'638","reported_seq":703,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.630901+0000","last_change":"2023-10-08T16:08:50.747973+0000","last_active":"2023-10-08T16:09:06.630901+0000","last_peered":"2023-10-08T16:09:06.630901+0000","last_clean":"2023-10-08T16:09:06.630901+0000","last_became_active":"2023-10-08T16:04:59.029141+0000","last_became_peered":"2023-10-08T16:04:59.029141+0000","last_unstale":"2023-10-08T16:09:06.630901+0000","last_undegraded":"2023-10-08T16:09:06.630901+0000","last_fullsized":"2023-10-08T16:09:06.630901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:26:02.042909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010017161,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"28'439","reported_seq":507,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.645595+0000","last_change":"2023-10-08T16:08:50.721969+0000","last_active":"2023-10-08T16:09:06.645595+0000","last_peered":"2023-10-08T16:09:06.645595+0000","last_clean":"2023-10-08T16:09:06.645595+0000","last_became_active":"2023-10-08T16:04:17.631722+0000","last_became_peered":"2023-10-08T16:04:17.631722+0000","last_unstale":"2023-10-08T16:09:06.645595+0000","last_undegraded":"2023-10-08T16:09:06.645595+0000","last_fullsized":"2023-10-08T16:09:06.645595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:52.670934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010482406,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'606","reported_seq":673,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650514+0000","last_change":"2023-10-08T16:08:50.714547+0000","last_active":"2023-10-08T16:09:06.650514+0000","last_peered":"2023-10-08T16:09:06.650514+0000","last_clean":"2023-10-08T16:09:06.650514+0000","last_became_active":"2023-10-08T16:04:17.628987+0000","last_became_peered":"2023-10-08T16:04:17.628987+0000","last_unstale":"2023-10-08T16:09:06.650514+0000","last_undegraded":"2023-10-08T16:09:06.650514+0000","last_fullsized":"2023-10-08T16:09:06.650514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:26.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011543940000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"28'702","reported_seq":770,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650736+0000","last_change":"2023-10-08T16:08:50.727041+0000","last_active":"2023-10-08T16:09:06.650736+0000","last_peered":"2023-10-08T16:09:06.650736+0000","last_clean":"2023-10-08T16:09:06.650736+0000","last_became_active":"2023-10-08T16:04:17.636350+0000","last_became_peered":"2023-10-08T16:04:17.636350+0000","last_unstale":"2023-10-08T16:09:06.650736+0000","last_undegraded":"2023-10-08T16:09:06.650736+0000","last_fullsized":"2023-10-08T16:09:06.650736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:38:37.066127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014319053,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'946","reported_seq":1024,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.636787+0000","last_change":"2023-10-08T16:08:50.720768+0000","last_active":"2023-10-08T16:09:06.636787+0000","last_peered":"2023-10-08T16:09:06.636787+0000","last_clean":"2023-10-08T16:09:06.636787+0000","last_became_active":"2023-10-08T16:04:58.696602+0000","last_became_peered":"2023-10-08T16:04:58.696602+0000","last_unstale":"2023-10-08T16:09:06.636787+0000","last_undegraded":"2023-10-08T16:09:06.636787+0000","last_fullsized":"2023-10-08T16:09:06.636787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":946,"log_dups_size":0,"ondisk_log_size":946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:04.594336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014587116000000001,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"28'515","reported_seq":583,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.647874+0000","last_change":"2023-10-08T16:08:50.717913+0000","last_active":"2023-10-08T16:09:06.647874+0000","last_peered":"2023-10-08T16:09:06.647874+0000","last_clean":"2023-10-08T16:09:06.647874+0000","last_became_active":"2023-10-08T16:04:17.627965+0000","last_became_peered":"2023-10-08T16:04:17.627965+0000","last_unstale":"2023-10-08T16:09:06.647874+0000","last_undegraded":"2023-10-08T16:09:06.647874+0000","last_fullsized":"2023-10-08T16:09:06.647874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012809017000000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'622","reported_seq":690,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.651027+0000","last_change":"2023-10-08T16:08:50.748915+0000","last_active":"2023-10-08T16:09:06.651027+0000","last_peered":"2023-10-08T16:09:06.651027+0000","last_clean":"2023-10-08T16:09:06.651027+0000","last_became_active":"2023-10-08T16:04:17.616988+0000","last_became_peered":"2023-10-08T16:04:17.616988+0000","last_unstale":"2023-10-08T16:09:06.651027+0000","last_undegraded":"2023-10-08T16:09:06.651027+0000","last_fullsized":"2023-10-08T16:09:06.651027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:49.607853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010221923000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"28'578","reported_seq":646,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.636406+0000","last_change":"2023-10-08T16:08:50.715034+0000","last_active":"2023-10-08T16:09:06.636406+0000","last_peered":"2023-10-08T16:09:06.636406+0000","last_clean":"2023-10-08T16:09:06.636406+0000","last_became_active":"2023-10-08T16:04:17.625529+0000","last_became_peered":"2023-10-08T16:04:17.625529+0000","last_unstale":"2023-10-08T16:09:06.636406+0000","last_undegraded":"2023-10-08T16:09:06.636406+0000","last_fullsized":"2023-10-08T16:09:06.636406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:07.051965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011264827,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"28'489","reported_seq":557,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.629848+0000","last_change":"2023-10-08T16:08:50.772353+0000","last_active":"2023-10-08T16:09:06.629848+0000","last_peered":"2023-10-08T16:09:06.629848+0000","last_clean":"2023-10-08T16:09:06.629848+0000","last_became_active":"2023-10-08T16:04:17.624197+0000","last_became_peered":"2023-10-08T16:04:17.624197+0000","last_unstale":"2023-10-08T16:09:06.629848+0000","last_undegraded":"2023-10-08T16:09:06.629848+0000","last_fullsized":"2023-10-08T16:09:06.629848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:08.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037453408000000001,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"28'586","reported_seq":654,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.639903+0000","last_change":"2023-10-08T16:08:50.764291+0000","last_active":"2023-10-08T16:09:06.639903+0000","last_peered":"2023-10-08T16:09:06.639903+0000","last_clean":"2023-10-08T16:09:06.639903+0000","last_became_active":"2023-10-08T16:04:17.620391+0000","last_became_peered":"2023-10-08T16:04:17.620391+0000","last_unstale":"2023-10-08T16:09:06.639903+0000","last_undegraded":"2023-10-08T16:09:06.639903+0000","last_fullsized":"2023-10-08T16:09:06.639903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:08.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029228837000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"28'650","reported_seq":717,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649001+0000","last_change":"2023-10-08T16:08:50.723712+0000","last_active":"2023-10-08T16:09:06.649001+0000","last_peered":"2023-10-08T16:09:06.649001+0000","last_clean":"2023-10-08T16:09:06.649001+0000","last_became_active":"2023-10-08T16:04:17.619843+0000","last_became_peered":"2023-10-08T16:04:17.619843+0000","last_unstale":"2023-10-08T16:09:06.649001+0000","last_undegraded":"2023-10-08T16:09:06.649001+0000","last_fullsized":"2023-10-08T16:09:06.649001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.599406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018851915,"stat_sum":{"num_bytes":4105,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"28'622","reported_seq":690,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650219+0000","last_change":"2023-10-08T16:08:50.725684+0000","last_active":"2023-10-08T16:09:06.650219+0000","last_peered":"2023-10-08T16:09:06.650219+0000","last_clean":"2023-10-08T16:09:06.650219+0000","last_became_active":"2023-10-08T16:04:17.625580+0000","last_became_peered":"2023-10-08T16:04:17.625580+0000","last_unstale":"2023-10-08T16:09:06.650219+0000","last_undegraded":"2023-10-08T16:09:06.650219+0000","last_fullsized":"2023-10-08T16:09:06.650219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:46.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018077737,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"28'589","reported_seq":656,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.636598+0000","last_change":"2023-10-08T16:08:50.751069+0000","last_active":"2023-10-08T16:09:06.636598+0000","last_peered":"2023-10-08T16:09:06.636598+0000","last_clean":"2023-10-08T16:09:06.636598+0000","last_became_active":"2023-10-08T16:04:17.627197+0000","last_became_peered":"2023-10-08T16:04:17.627197+0000","last_unstale":"2023-10-08T16:09:06.636598+0000","last_undegraded":"2023-10-08T16:09:06.636598+0000","last_fullsized":"2023-10-08T16:09:06.636598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:09.387194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098294880000000008,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"28'596","reported_seq":664,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646672+0000","last_change":"2023-10-08T16:08:50.727158+0000","last_active":"2023-10-08T16:09:06.646672+0000","last_peered":"2023-10-08T16:09:06.646672+0000","last_clean":"2023-10-08T16:09:06.646672+0000","last_became_active":"2023-10-08T16:04:17.625586+0000","last_became_peered":"2023-10-08T16:04:17.625586+0000","last_unstale":"2023-10-08T16:09:06.646672+0000","last_undegraded":"2023-10-08T16:09:06.646672+0000","last_fullsized":"2023-10-08T16:09:06.646672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.599406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014288673999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"28'769","reported_seq":837,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646513+0000","last_change":"2023-10-08T16:08:50.717675+0000","last_active":"2023-10-08T16:09:06.646513+0000","last_peered":"2023-10-08T16:09:06.646513+0000","last_clean":"2023-10-08T16:09:06.646513+0000","last_became_active":"2023-10-08T16:04:17.623200+0000","last_became_peered":"2023-10-08T16:04:17.623200+0000","last_unstale":"2023-10-08T16:09:06.646513+0000","last_undegraded":"2023-10-08T16:09:06.646513+0000","last_fullsized":"2023-10-08T16:09:06.646513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:36.869466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012983668,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"28'725","reported_seq":794,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650301+0000","last_change":"2023-10-08T16:08:50.784761+0000","last_active":"2023-10-08T16:09:06.650301+0000","last_peered":"2023-10-08T16:09:06.650301+0000","last_clean":"2023-10-08T16:09:06.650301+0000","last_became_active":"2023-10-08T16:04:17.623945+0000","last_became_peered":"2023-10-08T16:04:17.623945+0000","last_unstale":"2023-10-08T16:09:06.650301+0000","last_undegraded":"2023-10-08T16:09:06.650301+0000","last_fullsized":"2023-10-08T16:09:06.650301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:15.965581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045353759,"stat_sum":{"num_bytes":4128,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"28'829","reported_seq":920,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650027+0000","last_change":"2023-10-08T16:08:50.723672+0000","last_active":"2023-10-08T16:09:06.650027+0000","last_peered":"2023-10-08T16:09:06.650027+0000","last_clean":"2023-10-08T16:09:06.650027+0000","last_became_active":"2023-10-08T16:04:17.623904+0000","last_became_peered":"2023-10-08T16:04:17.623904+0000","last_unstale":"2023-10-08T16:09:06.650027+0000","last_undegraded":"2023-10-08T16:09:06.650027+0000","last_fullsized":"2023-10-08T16:09:06.650027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:52.670934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019052278999999998,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":25,"num_read_kb":20,"num_write":31,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'549","reported_seq":616,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.638800+0000","last_change":"2023-10-08T16:08:50.714440+0000","last_active":"2023-10-08T16:09:06.638800+0000","last_peered":"2023-10-08T16:09:06.638800+0000","last_clean":"2023-10-08T16:09:06.638800+0000","last_became_active":"2023-10-08T16:04:17.618549+0000","last_became_peered":"2023-10-08T16:04:17.618549+0000","last_unstale":"2023-10-08T16:09:06.638800+0000","last_undegraded":"2023-10-08T16:09:06.638800+0000","last_fullsized":"2023-10-08T16:09:06.638800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011087115999999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'657","reported_seq":724,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649258+0000","last_change":"2023-10-08T16:08:50.724464+0000","last_active":"2023-10-08T16:09:06.649258+0000","last_peered":"2023-10-08T16:09:06.649258+0000","last_clean":"2023-10-08T16:09:06.649258+0000","last_became_active":"2023-10-08T16:04:17.627673+0000","last_became_peered":"2023-10-08T16:04:17.627673+0000","last_unstale":"2023-10-08T16:09:06.649258+0000","last_undegraded":"2023-10-08T16:09:06.649258+0000","last_fullsized":"2023-10-08T16:09:06.649258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:26.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019445790000000001,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"28'468","reported_seq":536,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.629597+0000","last_change":"2023-10-08T16:08:50.715828+0000","last_active":"2023-10-08T16:09:06.629597+0000","last_peered":"2023-10-08T16:09:06.629597+0000","last_clean":"2023-10-08T16:09:06.629597+0000","last_became_active":"2023-10-08T16:04:17.628793+0000","last_became_peered":"2023-10-08T16:04:17.628793+0000","last_unstale":"2023-10-08T16:09:06.629597+0000","last_undegraded":"2023-10-08T16:09:06.629597+0000","last_fullsized":"2023-10-08T16:09:06.629597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:15.965581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011350429,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"28'659","reported_seq":727,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649543+0000","last_change":"2023-10-08T16:08:50.720438+0000","last_active":"2023-10-08T16:09:06.649543+0000","last_peered":"2023-10-08T16:09:06.649543+0000","last_clean":"2023-10-08T16:09:06.649543+0000","last_became_active":"2023-10-08T16:04:17.625220+0000","last_became_peered":"2023-10-08T16:04:17.625220+0000","last_unstale":"2023-10-08T16:09:06.649543+0000","last_undegraded":"2023-10-08T16:09:06.649543+0000","last_fullsized":"2023-10-08T16:09:06.649543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:08.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013452108000000001,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'351","reported_seq":419,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.612968+0000","last_change":"2023-10-08T16:08:50.761809+0000","last_active":"2023-10-08T16:09:06.612968+0000","last_peered":"2023-10-08T16:09:06.612968+0000","last_clean":"2023-10-08T16:09:06.612968+0000","last_became_active":"2023-10-08T16:04:17.629574+0000","last_became_peered":"2023-10-08T16:04:17.629574+0000","last_unstale":"2023-10-08T16:09:06.612968+0000","last_undegraded":"2023-10-08T16:09:06.612968+0000","last_fullsized":"2023-10-08T16:09:06.612968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:26.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024743081,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"28'585","reported_seq":653,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.643506+0000","last_change":"2023-10-08T16:08:50.715713+0000","last_active":"2023-10-08T16:09:06.643506+0000","last_peered":"2023-10-08T16:09:06.643506+0000","last_clean":"2023-10-08T16:09:06.643506+0000","last_became_active":"2023-10-08T16:04:17.626420+0000","last_became_peered":"2023-10-08T16:04:17.626420+0000","last_unstale":"2023-10-08T16:09:06.643506+0000","last_undegraded":"2023-10-08T16:09:06.643506+0000","last_fullsized":"2023-10-08T16:09:06.643506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011442964999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'586","reported_seq":654,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.635599+0000","last_change":"2023-10-08T16:08:50.786032+0000","last_active":"2023-10-08T16:09:06.635599+0000","last_peered":"2023-10-08T16:09:06.635599+0000","last_clean":"2023-10-08T16:09:06.635599+0000","last_became_active":"2023-10-08T16:04:17.618207+0000","last_became_peered":"2023-10-08T16:04:17.618207+0000","last_unstale":"2023-10-08T16:09:06.635599+0000","last_undegraded":"2023-10-08T16:09:06.635599+0000","last_fullsized":"2023-10-08T16:09:06.635599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:16:31.009207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042752309000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"28'401","reported_seq":469,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.647800+0000","last_change":"2023-10-08T16:08:50.725249+0000","last_active":"2023-10-08T16:09:06.647800+0000","last_peered":"2023-10-08T16:09:06.647800+0000","last_clean":"2023-10-08T16:09:06.647800+0000","last_became_active":"2023-10-08T16:04:17.627093+0000","last_became_peered":"2023-10-08T16:04:17.627093+0000","last_unstale":"2023-10-08T16:09:06.647800+0000","last_undegraded":"2023-10-08T16:09:06.647800+0000","last_fullsized":"2023-10-08T16:09:06.647800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:45.664795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020438813,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"28'943","reported_seq":1010,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649964+0000","last_change":"2023-10-08T16:08:50.753000+0000","last_active":"2023-10-08T16:09:06.649964+0000","last_peered":"2023-10-08T16:09:06.649964+0000","last_clean":"2023-10-08T16:09:06.649964+0000","last_became_active":"2023-10-08T16:04:17.629049+0000","last_became_peered":"2023-10-08T16:04:17.629049+0000","last_unstale":"2023-10-08T16:09:06.649964+0000","last_undegraded":"2023-10-08T16:09:06.649964+0000","last_fullsized":"2023-10-08T16:09:06.649964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:07.785877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01455822,"stat_sum":{"num_bytes":8206,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"28'746","reported_seq":814,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.636917+0000","last_change":"2023-10-08T16:08:50.714786+0000","last_active":"2023-10-08T16:09:06.636917+0000","last_peered":"2023-10-08T16:09:06.636917+0000","last_clean":"2023-10-08T16:09:06.636917+0000","last_became_active":"2023-10-08T16:04:17.632012+0000","last_became_peered":"2023-10-08T16:04:17.632012+0000","last_unstale":"2023-10-08T16:09:06.636917+0000","last_undegraded":"2023-10-08T16:09:06.636917+0000","last_fullsized":"2023-10-08T16:09:06.636917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010590815999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"28'514","reported_seq":582,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.627809+0000","last_change":"2023-10-08T16:08:50.747895+0000","last_active":"2023-10-08T16:09:06.627809+0000","last_peered":"2023-10-08T16:09:06.627809+0000","last_clean":"2023-10-08T16:09:06.627809+0000","last_became_active":"2023-10-08T16:04:17.623220+0000","last_became_peered":"2023-10-08T16:04:17.623220+0000","last_unstale":"2023-10-08T16:09:06.627809+0000","last_undegraded":"2023-10-08T16:09:06.627809+0000","last_fullsized":"2023-10-08T16:09:06.627809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:07.785877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010375987999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'747","reported_seq":765,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.776172+0000","last_change":"2023-10-08T16:04:16.660492+0000","last_active":"2023-10-08T16:08:57.776172+0000","last_peered":"2023-10-08T16:08:57.776172+0000","last_clean":"2023-10-08T16:08:57.776172+0000","last_became_active":"2023-10-08T16:04:16.660183+0000","last_became_peered":"2023-10-08T16:04:16.660183+0000","last_unstale":"2023-10-08T16:08:57.776172+0000","last_undegraded":"2023-10-08T16:08:57.776172+0000","last_fullsized":"2023-10-08T16:08:57.776172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:08.532886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":743,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'638","reported_seq":706,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.644690+0000","last_change":"2023-10-08T16:08:50.786087+0000","last_active":"2023-10-08T16:09:06.644690+0000","last_peered":"2023-10-08T16:09:06.644690+0000","last_clean":"2023-10-08T16:09:06.644690+0000","last_became_active":"2023-10-08T16:04:17.620532+0000","last_became_peered":"2023-10-08T16:04:17.620532+0000","last_unstale":"2023-10-08T16:09:06.644690+0000","last_undegraded":"2023-10-08T16:09:06.644690+0000","last_fullsized":"2023-10-08T16:09:06.644690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:48:25.093009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042650311000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"28'756","reported_seq":774,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:58.144652+0000","last_change":"2023-10-08T16:04:16.654209+0000","last_active":"2023-10-08T16:08:58.144652+0000","last_peered":"2023-10-08T16:08:58.144652+0000","last_clean":"2023-10-08T16:08:58.144652+0000","last_became_active":"2023-10-08T16:04:16.653936+0000","last_became_peered":"2023-10-08T16:04:16.653936+0000","last_unstale":"2023-10-08T16:08:58.144652+0000","last_undegraded":"2023-10-08T16:08:58.144652+0000","last_fullsized":"2023-10-08T16:08:58.144652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:39:19.429906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"28'11","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.775670+0000","last_change":"2023-10-08T16:04:16.656953+0000","last_active":"2023-10-08T16:08:57.775670+0000","last_peered":"2023-10-08T16:08:57.775670+0000","last_clean":"2023-10-08T16:08:57.775670+0000","last_became_active":"2023-10-08T16:04:16.656642+0000","last_became_peered":"2023-10-08T16:04:16.656642+0000","last_unstale":"2023-10-08T16:08:57.775670+0000","last_undegraded":"2023-10-08T16:08:57.775670+0000","last_fullsized":"2023-10-08T16:08:57.775670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:04.157234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'647","reported_seq":713,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.628901+0000","last_change":"2023-10-08T16:08:50.765265+0000","last_active":"2023-10-08T16:09:06.628901+0000","last_peered":"2023-10-08T16:09:06.628901+0000","last_clean":"2023-10-08T16:09:06.628901+0000","last_became_active":"2023-10-08T16:04:59.029346+0000","last_became_peered":"2023-10-08T16:04:59.029346+0000","last_unstale":"2023-10-08T16:09:06.628901+0000","last_undegraded":"2023-10-08T16:09:06.628901+0000","last_fullsized":"2023-10-08T16:09:06.628901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:26.162193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024714613999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1526","reported_seq":1544,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.705019+0000","last_change":"2023-10-08T16:04:16.651645+0000","last_active":"2023-10-08T16:08:50.705019+0000","last_peered":"2023-10-08T16:08:50.705019+0000","last_clean":"2023-10-08T16:08:50.705019+0000","last_became_active":"2023-10-08T16:04:16.651258+0000","last_became_peered":"2023-10-08T16:04:16.651258+0000","last_unstale":"2023-10-08T16:08:50.705019+0000","last_undegraded":"2023-10-08T16:08:50.705019+0000","last_fullsized":"2023-10-08T16:08:50.705019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1526,"log_dups_size":0,"ondisk_log_size":1526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:48.596542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1522,"num_write_kb":8929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"28'757","reported_seq":825,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.626273+0000","last_change":"2023-10-08T16:08:50.761686+0000","last_active":"2023-10-08T16:09:06.626273+0000","last_peered":"2023-10-08T16:09:06.626273+0000","last_clean":"2023-10-08T16:09:06.626273+0000","last_became_active":"2023-10-08T16:04:17.629765+0000","last_became_peered":"2023-10-08T16:04:17.629765+0000","last_unstale":"2023-10-08T16:09:06.626273+0000","last_undegraded":"2023-10-08T16:09:06.626273+0000","last_fullsized":"2023-10-08T16:09:06.626273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026861545000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'13","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.709453+0000","last_change":"2023-10-08T16:04:16.655712+0000","last_active":"2023-10-08T16:08:57.709453+0000","last_peered":"2023-10-08T16:08:57.709453+0000","last_clean":"2023-10-08T16:08:57.709453+0000","last_became_active":"2023-10-08T16:04:16.654002+0000","last_became_peered":"2023-10-08T16:04:16.654002+0000","last_unstale":"2023-10-08T16:08:57.709453+0000","last_undegraded":"2023-10-08T16:08:57.709453+0000","last_fullsized":"2023-10-08T16:08:57.709453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"28'595","reported_seq":662,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649572+0000","last_change":"2023-10-08T16:08:50.724955+0000","last_active":"2023-10-08T16:09:06.649572+0000","last_peered":"2023-10-08T16:09:06.649572+0000","last_clean":"2023-10-08T16:09:06.649572+0000","last_became_active":"2023-10-08T16:04:17.624071+0000","last_became_peered":"2023-10-08T16:04:17.624071+0000","last_unstale":"2023-10-08T16:09:06.649572+0000","last_undegraded":"2023-10-08T16:09:06.649572+0000","last_fullsized":"2023-10-08T16:09:06.649572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:42.972904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018261580999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"26'15","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.706688+0000","last_change":"2023-10-08T16:04:16.657245+0000","last_active":"2023-10-08T16:08:50.706688+0000","last_peered":"2023-10-08T16:08:50.706688+0000","last_clean":"2023-10-08T16:08:50.706688+0000","last_became_active":"2023-10-08T16:04:16.656992+0000","last_became_peered":"2023-10-08T16:04:16.656992+0000","last_unstale":"2023-10-08T16:08:50.706688+0000","last_undegraded":"2023-10-08T16:08:50.706688+0000","last_fullsized":"2023-10-08T16:08:50.706688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"28'498","reported_seq":566,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.648430+0000","last_change":"2023-10-08T16:08:50.783744+0000","last_active":"2023-10-08T16:09:06.648430+0000","last_peered":"2023-10-08T16:09:06.648430+0000","last_clean":"2023-10-08T16:09:06.648430+0000","last_became_active":"2023-10-08T16:04:17.621862+0000","last_became_peered":"2023-10-08T16:04:17.621862+0000","last_unstale":"2023-10-08T16:09:06.648430+0000","last_undegraded":"2023-10-08T16:09:06.648430+0000","last_fullsized":"2023-10-08T16:09:06.648430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:36.869466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045929303999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"28'55","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.158974+0000","last_change":"2023-10-08T16:04:16.656378+0000","last_active":"2023-10-08T16:09:06.158974+0000","last_peered":"2023-10-08T16:09:06.158974+0000","last_clean":"2023-10-08T16:09:06.158974+0000","last_became_active":"2023-10-08T16:04:16.656041+0000","last_became_peered":"2023-10-08T16:04:16.656041+0000","last_unstale":"2023-10-08T16:09:06.158974+0000","last_undegraded":"2023-10-08T16:09:06.158974+0000","last_fullsized":"2023-10-08T16:09:06.158974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:08.375883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'579","reported_seq":647,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649871+0000","last_change":"2023-10-08T16:08:50.749536+0000","last_active":"2023-10-08T16:09:06.649871+0000","last_peered":"2023-10-08T16:09:06.649871+0000","last_clean":"2023-10-08T16:09:06.649871+0000","last_became_active":"2023-10-08T16:04:17.620654+0000","last_became_peered":"2023-10-08T16:04:17.620654+0000","last_unstale":"2023-10-08T16:09:06.649871+0000","last_undegraded":"2023-10-08T16:09:06.649871+0000","last_fullsized":"2023-10-08T16:09:06.649871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:09.387194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010626305000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"28'802","reported_seq":820,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.709296+0000","last_change":"2023-10-08T16:04:16.653310+0000","last_active":"2023-10-08T16:08:57.709296+0000","last_peered":"2023-10-08T16:08:57.709296+0000","last_clean":"2023-10-08T16:08:57.709296+0000","last_became_active":"2023-10-08T16:04:16.653001+0000","last_became_peered":"2023-10-08T16:04:16.653001+0000","last_unstale":"2023-10-08T16:08:57.709296+0000","last_undegraded":"2023-10-08T16:08:57.709296+0000","last_fullsized":"2023-10-08T16:08:57.709296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:48.596542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194948,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":797,"num_write_kb":4446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"28'522","reported_seq":590,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646727+0000","last_change":"2023-10-08T16:08:50.725788+0000","last_active":"2023-10-08T16:09:06.646727+0000","last_peered":"2023-10-08T16:09:06.646727+0000","last_clean":"2023-10-08T16:09:06.646727+0000","last_became_active":"2023-10-08T16:04:17.631130+0000","last_became_peered":"2023-10-08T16:04:17.631130+0000","last_unstale":"2023-10-08T16:09:06.646727+0000","last_undegraded":"2023-10-08T16:09:06.646727+0000","last_fullsized":"2023-10-08T16:09:06.646727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:35.211718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013318705,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"26'1512","reported_seq":1530,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.743557+0000","last_change":"2023-10-08T16:04:16.661085+0000","last_active":"2023-10-08T16:08:50.743557+0000","last_peered":"2023-10-08T16:08:50.743557+0000","last_clean":"2023-10-08T16:08:50.743557+0000","last_became_active":"2023-10-08T16:04:16.660830+0000","last_became_peered":"2023-10-08T16:04:16.660830+0000","last_unstale":"2023-10-08T16:08:50.743557+0000","last_undegraded":"2023-10-08T16:08:50.743557+0000","last_fullsized":"2023-10-08T16:08:50.743557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1512,"log_dups_size":0,"ondisk_log_size":1512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:18.465207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1505,"num_write_kb":8987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"28'652","reported_seq":720,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.645919+0000","last_change":"2023-10-08T16:08:50.780644+0000","last_active":"2023-10-08T16:09:06.645919+0000","last_peered":"2023-10-08T16:09:06.645919+0000","last_clean":"2023-10-08T16:09:06.645919+0000","last_became_active":"2023-10-08T16:04:17.623038+0000","last_became_peered":"2023-10-08T16:04:17.623038+0000","last_unstale":"2023-10-08T16:09:06.645919+0000","last_undegraded":"2023-10-08T16:09:06.645919+0000","last_fullsized":"2023-10-08T16:09:06.645919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045488809999999998,"stat_sum":{"num_bytes":4107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"26'14","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.705165+0000","last_change":"2023-10-08T16:04:16.650083+0000","last_active":"2023-10-08T16:08:50.705165+0000","last_peered":"2023-10-08T16:08:50.705165+0000","last_clean":"2023-10-08T16:08:50.705165+0000","last_became_active":"2023-10-08T16:04:16.649675+0000","last_became_peered":"2023-10-08T16:04:16.649675+0000","last_unstale":"2023-10-08T16:08:50.705165+0000","last_undegraded":"2023-10-08T16:08:50.705165+0000","last_fullsized":"2023-10-08T16:08:50.705165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:04.030037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'966","reported_seq":1034,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646421+0000","last_change":"2023-10-08T16:08:50.725608+0000","last_active":"2023-10-08T16:09:06.646421+0000","last_peered":"2023-10-08T16:09:06.646421+0000","last_clean":"2023-10-08T16:09:06.646421+0000","last_became_active":"2023-10-08T16:04:17.628865+0000","last_became_peered":"2023-10-08T16:04:17.628865+0000","last_unstale":"2023-10-08T16:09:06.646421+0000","last_undegraded":"2023-10-08T16:09:06.646421+0000","last_fullsized":"2023-10-08T16:09:06.646421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":966,"log_dups_size":0,"ondisk_log_size":966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:46.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013199152,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"27'12","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:52.141852+0000","last_change":"2023-10-08T16:04:16.655486+0000","last_active":"2023-10-08T16:08:52.141852+0000","last_peered":"2023-10-08T16:08:52.141852+0000","last_clean":"2023-10-08T16:08:52.141852+0000","last_became_active":"2023-10-08T16:04:16.653342+0000","last_became_peered":"2023-10-08T16:04:16.653342+0000","last_unstale":"2023-10-08T16:08:52.141852+0000","last_undegraded":"2023-10-08T16:08:52.141852+0000","last_fullsized":"2023-10-08T16:08:52.141852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:04.157234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"28'290","reported_seq":358,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.636856+0000","last_change":"2023-10-08T16:08:50.717095+0000","last_active":"2023-10-08T16:09:06.636856+0000","last_peered":"2023-10-08T16:09:06.636856+0000","last_clean":"2023-10-08T16:09:06.636856+0000","last_became_active":"2023-10-08T16:04:17.624454+0000","last_became_peered":"2023-10-08T16:04:17.624454+0000","last_unstale":"2023-10-08T16:09:06.636856+0000","last_undegraded":"2023-10-08T16:09:06.636856+0000","last_fullsized":"2023-10-08T16:09:06.636856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012620849,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"26'22","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.737986+0000","last_change":"2023-10-08T16:04:16.659433+0000","last_active":"2023-10-08T16:08:50.737986+0000","last_peered":"2023-10-08T16:08:50.737986+0000","last_clean":"2023-10-08T16:08:50.737986+0000","last_became_active":"2023-10-08T16:04:16.658886+0000","last_became_peered":"2023-10-08T16:04:16.658886+0000","last_unstale":"2023-10-08T16:08:50.737986+0000","last_undegraded":"2023-10-08T16:08:50.737986+0000","last_fullsized":"2023-10-08T16:08:50.737986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:08.532886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"28'592","reported_seq":660,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.645466+0000","last_change":"2023-10-08T16:08:50.724877+0000","last_active":"2023-10-08T16:09:06.645466+0000","last_peered":"2023-10-08T16:09:06.645466+0000","last_clean":"2023-10-08T16:09:06.645466+0000","last_became_active":"2023-10-08T16:04:17.628605+0000","last_became_peered":"2023-10-08T16:04:17.628605+0000","last_unstale":"2023-10-08T16:09:06.645466+0000","last_undegraded":"2023-10-08T16:09:06.645466+0000","last_fullsized":"2023-10-08T16:09:06.645466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:02:45.593266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013094041000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'18","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.699963+0000","last_change":"2023-10-08T16:04:16.660881+0000","last_active":"2023-10-08T16:08:57.699963+0000","last_peered":"2023-10-08T16:08:57.699963+0000","last_clean":"2023-10-08T16:08:57.699963+0000","last_became_active":"2023-10-08T16:04:16.660651+0000","last_became_peered":"2023-10-08T16:04:16.660651+0000","last_unstale":"2023-10-08T16:08:57.699963+0000","last_undegraded":"2023-10-08T16:08:57.699963+0000","last_fullsized":"2023-10-08T16:08:57.699963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:54.682083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"28'296","reported_seq":364,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.633524+0000","last_change":"2023-10-08T16:08:50.725143+0000","last_active":"2023-10-08T16:09:06.633524+0000","last_peered":"2023-10-08T16:09:06.633524+0000","last_clean":"2023-10-08T16:09:06.633524+0000","last_became_active":"2023-10-08T16:04:17.628701+0000","last_became_peered":"2023-10-08T16:04:17.628701+0000","last_unstale":"2023-10-08T16:09:06.633524+0000","last_undegraded":"2023-10-08T16:09:06.633524+0000","last_fullsized":"2023-10-08T16:09:06.633524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:45.664795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012739413999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'276","reported_seq":294,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:53.142796+0000","last_change":"2023-10-08T16:04:16.652447+0000","last_active":"2023-10-08T16:08:53.142796+0000","last_peered":"2023-10-08T16:08:53.142796+0000","last_clean":"2023-10-08T16:08:53.142796+0000","last_became_active":"2023-10-08T16:04:16.651709+0000","last_became_peered":"2023-10-08T16:04:16.651709+0000","last_unstale":"2023-10-08T16:08:53.142796+0000","last_undegraded":"2023-10-08T16:08:53.142796+0000","last_fullsized":"2023-10-08T16:08:53.142796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:04.157234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"28'660","reported_seq":727,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646340+0000","last_change":"2023-10-08T16:08:50.727298+0000","last_active":"2023-10-08T16:09:06.646340+0000","last_peered":"2023-10-08T16:09:06.646340+0000","last_clean":"2023-10-08T16:09:06.646340+0000","last_became_active":"2023-10-08T16:04:17.630908+0000","last_became_peered":"2023-10-08T16:04:17.630908+0000","last_unstale":"2023-10-08T16:09:06.646340+0000","last_undegraded":"2023-10-08T16:09:06.646340+0000","last_fullsized":"2023-10-08T16:09:06.646340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:48.519448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014318363000000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"28'764","reported_seq":782,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.773013+0000","last_change":"2023-10-08T16:04:16.655771+0000","last_active":"2023-10-08T16:08:57.773013+0000","last_peered":"2023-10-08T16:08:57.773013+0000","last_clean":"2023-10-08T16:08:57.773013+0000","last_became_active":"2023-10-08T16:04:16.655245+0000","last_became_peered":"2023-10-08T16:04:16.655245+0000","last_unstale":"2023-10-08T16:08:57.773013+0000","last_undegraded":"2023-10-08T16:08:57.773013+0000","last_fullsized":"2023-10-08T16:08:57.773013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:48.596542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":759,"num_write_kb":4511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"28'465","reported_seq":533,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.647811+0000","last_change":"2023-10-08T16:08:50.726922+0000","last_active":"2023-10-08T16:09:06.647811+0000","last_peered":"2023-10-08T16:09:06.647811+0000","last_clean":"2023-10-08T16:09:06.647811+0000","last_became_active":"2023-10-08T16:04:17.627369+0000","last_became_peered":"2023-10-08T16:04:17.627369+0000","last_unstale":"2023-10-08T16:09:06.647811+0000","last_undegraded":"2023-10-08T16:09:06.647811+0000","last_fullsized":"2023-10-08T16:09:06.647811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020078136999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"28'12","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.770743+0000","last_change":"2023-10-08T16:04:16.654597+0000","last_active":"2023-10-08T16:08:57.770743+0000","last_peered":"2023-10-08T16:08:57.770743+0000","last_clean":"2023-10-08T16:08:57.770743+0000","last_became_active":"2023-10-08T16:04:16.654124+0000","last_became_peered":"2023-10-08T16:04:16.654124+0000","last_unstale":"2023-10-08T16:08:57.770743+0000","last_undegraded":"2023-10-08T16:08:57.770743+0000","last_fullsized":"2023-10-08T16:08:57.770743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'569","reported_seq":635,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649431+0000","last_change":"2023-10-08T16:08:50.749000+0000","last_active":"2023-10-08T16:09:06.649431+0000","last_peered":"2023-10-08T16:09:06.649431+0000","last_clean":"2023-10-08T16:09:06.649431+0000","last_became_active":"2023-10-08T16:04:58.693477+0000","last_became_peered":"2023-10-08T16:04:58.693477+0000","last_unstale":"2023-10-08T16:09:06.649431+0000","last_undegraded":"2023-10-08T16:09:06.649431+0000","last_fullsized":"2023-10-08T16:09:06.649431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:43:34.693379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0094988650000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.711580+0000","last_change":"2023-10-08T16:04:06.370834+0000","last_active":"2023-10-08T16:08:50.711580+0000","last_peered":"2023-10-08T16:08:50.711580+0000","last_clean":"2023-10-08T16:08:50.711580+0000","last_became_active":"2023-10-08T16:04:06.368022+0000","last_became_peered":"2023-10-08T16:04:06.368022+0000","last_unstale":"2023-10-08T16:08:50.711580+0000","last_undegraded":"2023-10-08T16:08:50.711580+0000","last_fullsized":"2023-10-08T16:08:50.711580+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:05.034115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:05.034115+0000","last_clean_scrub_stamp":"2023-10-08T16:04:05.034115+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:37.338076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"28'13","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.697048+0000","last_change":"2023-10-08T16:04:16.646681+0000","last_active":"2023-10-08T16:08:57.697048+0000","last_peered":"2023-10-08T16:08:57.697048+0000","last_clean":"2023-10-08T16:08:57.697048+0000","last_became_active":"2023-10-08T16:04:16.646086+0000","last_became_peered":"2023-10-08T16:04:16.646086+0000","last_unstale":"2023-10-08T16:08:57.697048+0000","last_undegraded":"2023-10-08T16:08:57.697048+0000","last_fullsized":"2023-10-08T16:08:57.697048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:24.778540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'510","reported_seq":578,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649793+0000","last_change":"2023-10-08T16:08:50.714760+0000","last_active":"2023-10-08T16:09:06.649793+0000","last_peered":"2023-10-08T16:09:06.649793+0000","last_clean":"2023-10-08T16:09:06.649793+0000","last_became_active":"2023-10-08T16:04:17.629127+0000","last_became_peered":"2023-10-08T16:04:17.629127+0000","last_unstale":"2023-10-08T16:09:06.649793+0000","last_undegraded":"2023-10-08T16:09:06.649793+0000","last_fullsized":"2023-10-08T16:09:06.649793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:33.720945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011169416999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"27'1504","reported_seq":1522,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:52.141724+0000","last_change":"2023-10-08T16:04:16.661382+0000","last_active":"2023-10-08T16:08:52.141724+0000","last_peered":"2023-10-08T16:08:52.141724+0000","last_clean":"2023-10-08T16:08:52.141724+0000","last_became_active":"2023-10-08T16:04:16.661186+0000","last_became_peered":"2023-10-08T16:04:16.661186+0000","last_unstale":"2023-10-08T16:08:52.141724+0000","last_undegraded":"2023-10-08T16:08:52.141724+0000","last_fullsized":"2023-10-08T16:08:52.141724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1504,"log_dups_size":0,"ondisk_log_size":1504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:06.774566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1499,"num_write_kb":8970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"28'493","reported_seq":561,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.644348+0000","last_change":"2023-10-08T16:08:50.779348+0000","last_active":"2023-10-08T16:09:06.644348+0000","last_peered":"2023-10-08T16:09:06.644348+0000","last_clean":"2023-10-08T16:09:06.644348+0000","last_became_active":"2023-10-08T16:04:17.615671+0000","last_became_peered":"2023-10-08T16:04:17.615671+0000","last_unstale":"2023-10-08T16:09:06.644348+0000","last_undegraded":"2023-10-08T16:09:06.644348+0000","last_fullsized":"2023-10-08T16:09:06.644348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:05.041349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.043805617999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"28'75","reported_seq":155,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:07.150577+0000","last_change":"2023-10-08T16:04:16.654721+0000","last_active":"2023-10-08T16:09:07.150577+0000","last_peered":"2023-10-08T16:09:07.150577+0000","last_clean":"2023-10-08T16:09:07.150577+0000","last_became_active":"2023-10-08T16:04:16.654359+0000","last_became_peered":"2023-10-08T16:04:16.654359+0000","last_unstale":"2023-10-08T16:09:07.150577+0000","last_undegraded":"2023-10-08T16:09:07.150577+0000","last_fullsized":"2023-10-08T16:09:07.150577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:04.030037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":279988,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":321,"num_write":71,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'386","reported_seq":453,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.621683+0000","last_change":"2023-10-08T16:08:50.765489+0000","last_active":"2023-10-08T16:09:06.621683+0000","last_peered":"2023-10-08T16:09:06.621683+0000","last_clean":"2023-10-08T16:09:06.621683+0000","last_became_active":"2023-10-08T16:04:17.624876+0000","last_became_peered":"2023-10-08T16:04:17.624876+0000","last_unstale":"2023-10-08T16:09:06.621683+0000","last_undegraded":"2023-10-08T16:09:06.621683+0000","last_fullsized":"2023-10-08T16:09:06.621683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:15.965581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024289327999999999,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"27'1399","reported_seq":1417,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:52.140934+0000","last_change":"2023-10-08T16:04:16.654812+0000","last_active":"2023-10-08T16:08:52.140934+0000","last_peered":"2023-10-08T16:08:52.140934+0000","last_clean":"2023-10-08T16:08:52.140934+0000","last_became_active":"2023-10-08T16:04:16.654454+0000","last_became_peered":"2023-10-08T16:04:16.654454+0000","last_unstale":"2023-10-08T16:08:52.140934+0000","last_undegraded":"2023-10-08T16:08:52.140934+0000","last_fullsized":"2023-10-08T16:08:52.140934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1399,"log_dups_size":0,"ondisk_log_size":1399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1390,"num_write_kb":8905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"28'618","reported_seq":686,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.642629+0000","last_change":"2023-10-08T16:08:50.750159+0000","last_active":"2023-10-08T16:09:06.642629+0000","last_peered":"2023-10-08T16:09:06.642629+0000","last_clean":"2023-10-08T16:09:06.642629+0000","last_became_active":"2023-10-08T16:04:17.619294+0000","last_became_peered":"2023-10-08T16:04:17.619294+0000","last_unstale":"2023-10-08T16:09:06.642629+0000","last_undegraded":"2023-10-08T16:09:06.642629+0000","last_fullsized":"2023-10-08T16:09:06.642629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:25.789851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011233748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"27'7","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.141419+0000","last_change":"2023-10-08T16:04:16.662004+0000","last_active":"2023-10-08T16:08:55.141419+0000","last_peered":"2023-10-08T16:08:55.141419+0000","last_clean":"2023-10-08T16:08:55.141419+0000","last_became_active":"2023-10-08T16:04:16.661756+0000","last_became_peered":"2023-10-08T16:04:16.661756+0000","last_unstale":"2023-10-08T16:08:55.141419+0000","last_undegraded":"2023-10-08T16:08:55.141419+0000","last_fullsized":"2023-10-08T16:08:55.141419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:06.774566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"28'513","reported_seq":581,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.648937+0000","last_change":"2023-10-08T16:08:50.726661+0000","last_active":"2023-10-08T16:09:06.648937+0000","last_peered":"2023-10-08T16:09:06.648937+0000","last_clean":"2023-10-08T16:09:06.648937+0000","last_became_active":"2023-10-08T16:04:17.616348+0000","last_became_peered":"2023-10-08T16:04:17.616348+0000","last_unstale":"2023-10-08T16:09:06.648937+0000","last_undegraded":"2023-10-08T16:09:06.648937+0000","last_fullsized":"2023-10-08T16:09:06.648937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:08.121055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016977602000000001,"stat_sum":{"num_bytes":4107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"26'21","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.712617+0000","last_change":"2023-10-08T16:04:16.662731+0000","last_active":"2023-10-08T16:08:50.712617+0000","last_peered":"2023-10-08T16:08:50.712617+0000","last_clean":"2023-10-08T16:08:50.712617+0000","last_became_active":"2023-10-08T16:04:16.662446+0000","last_became_peered":"2023-10-08T16:04:16.662446+0000","last_unstale":"2023-10-08T16:08:50.712617+0000","last_undegraded":"2023-10-08T16:08:50.712617+0000","last_fullsized":"2023-10-08T16:08:50.712617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:59.297962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'604","reported_seq":672,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.613363+0000","last_change":"2023-10-08T16:08:50.759947+0000","last_active":"2023-10-08T16:09:06.613363+0000","last_peered":"2023-10-08T16:09:06.613363+0000","last_clean":"2023-10-08T16:09:06.613363+0000","last_became_active":"2023-10-08T16:04:17.624319+0000","last_became_peered":"2023-10-08T16:04:17.624319+0000","last_unstale":"2023-10-08T16:09:06.613363+0000","last_undegraded":"2023-10-08T16:09:06.613363+0000","last_fullsized":"2023-10-08T16:09:06.613363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024480915999999998,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"28'47","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:07.155741+0000","last_change":"2023-10-08T16:04:16.661076+0000","last_active":"2023-10-08T16:09:07.155741+0000","last_peered":"2023-10-08T16:09:07.155741+0000","last_clean":"2023-10-08T16:09:07.155741+0000","last_became_active":"2023-10-08T16:04:16.660704+0000","last_became_peered":"2023-10-08T16:04:16.660704+0000","last_unstale":"2023-10-08T16:09:07.155741+0000","last_undegraded":"2023-10-08T16:09:07.155741+0000","last_fullsized":"2023-10-08T16:09:07.155741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"28'626","reported_seq":694,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646062+0000","last_change":"2023-10-08T16:08:50.715485+0000","last_active":"2023-10-08T16:09:06.646062+0000","last_peered":"2023-10-08T16:09:06.646062+0000","last_clean":"2023-10-08T16:09:06.646062+0000","last_became_active":"2023-10-08T16:04:17.631615+0000","last_became_peered":"2023-10-08T16:04:17.631615+0000","last_unstale":"2023-10-08T16:09:06.646062+0000","last_undegraded":"2023-10-08T16:09:06.646062+0000","last_fullsized":"2023-10-08T16:09:06.646062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.599406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011336120999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"27'12","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:53.144513+0000","last_change":"2023-10-08T16:04:16.659489+0000","last_active":"2023-10-08T16:08:53.144513+0000","last_peered":"2023-10-08T16:08:53.144513+0000","last_clean":"2023-10-08T16:08:53.144513+0000","last_became_active":"2023-10-08T16:04:16.659148+0000","last_became_peered":"2023-10-08T16:04:16.659148+0000","last_unstale":"2023-10-08T16:08:53.144513+0000","last_undegraded":"2023-10-08T16:08:53.144513+0000","last_fullsized":"2023-10-08T16:08:53.144513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'436","reported_seq":505,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.624840+0000","last_change":"2023-10-08T16:08:50.780938+0000","last_active":"2023-10-08T16:09:06.624840+0000","last_peered":"2023-10-08T16:09:06.624840+0000","last_clean":"2023-10-08T16:09:06.624840+0000","last_became_active":"2023-10-08T16:04:17.624385+0000","last_became_peered":"2023-10-08T16:04:17.624385+0000","last_unstale":"2023-10-08T16:09:06.624840+0000","last_undegraded":"2023-10-08T16:09:06.624840+0000","last_fullsized":"2023-10-08T16:09:06.624840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.044071592,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"26'758","reported_seq":776,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.711386+0000","last_change":"2023-10-08T16:04:16.662618+0000","last_active":"2023-10-08T16:08:50.711386+0000","last_peered":"2023-10-08T16:08:50.711386+0000","last_clean":"2023-10-08T16:08:50.711386+0000","last_became_active":"2023-10-08T16:04:16.662327+0000","last_became_peered":"2023-10-08T16:04:16.662327+0000","last_unstale":"2023-10-08T16:08:50.711386+0000","last_undegraded":"2023-10-08T16:08:50.711386+0000","last_fullsized":"2023-10-08T16:08:50.711386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:06:41.062441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":753,"num_write_kb":4504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'450","reported_seq":518,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.642591+0000","last_change":"2023-10-08T16:08:50.749200+0000","last_active":"2023-10-08T16:09:06.642591+0000","last_peered":"2023-10-08T16:09:06.642591+0000","last_clean":"2023-10-08T16:09:06.642591+0000","last_became_active":"2023-10-08T16:04:17.622898+0000","last_became_peered":"2023-10-08T16:04:17.622898+0000","last_unstale":"2023-10-08T16:09:06.642591+0000","last_undegraded":"2023-10-08T16:09:06.642591+0000","last_fullsized":"2023-10-08T16:09:06.642591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:47.130200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075401410000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'10","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.773333+0000","last_change":"2023-10-08T16:04:16.661483+0000","last_active":"2023-10-08T16:08:57.773333+0000","last_peered":"2023-10-08T16:08:57.773333+0000","last_clean":"2023-10-08T16:08:57.773333+0000","last_became_active":"2023-10-08T16:04:16.661055+0000","last_became_peered":"2023-10-08T16:04:16.661055+0000","last_unstale":"2023-10-08T16:08:57.773333+0000","last_undegraded":"2023-10-08T16:08:57.773333+0000","last_fullsized":"2023-10-08T16:08:57.773333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"28'501","reported_seq":569,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.626089+0000","last_change":"2023-10-08T16:08:50.713213+0000","last_active":"2023-10-08T16:09:06.626089+0000","last_peered":"2023-10-08T16:09:06.626089+0000","last_clean":"2023-10-08T16:09:06.626089+0000","last_became_active":"2023-10-08T16:04:17.626991+0000","last_became_peered":"2023-10-08T16:04:17.626991+0000","last_unstale":"2023-10-08T16:09:06.626089+0000","last_undegraded":"2023-10-08T16:09:06.626089+0000","last_fullsized":"2023-10-08T16:09:06.626089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:56.205550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010148346000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'11","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:52.136834+0000","last_change":"2023-10-08T16:04:16.657613+0000","last_active":"2023-10-08T16:08:52.136834+0000","last_peered":"2023-10-08T16:08:52.136834+0000","last_clean":"2023-10-08T16:08:52.136834+0000","last_became_active":"2023-10-08T16:04:16.657299+0000","last_became_peered":"2023-10-08T16:04:16.657299+0000","last_unstale":"2023-10-08T16:08:52.136834+0000","last_undegraded":"2023-10-08T16:08:52.136834+0000","last_fullsized":"2023-10-08T16:08:52.136834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:24.778540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"28'597","reported_seq":663,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.632951+0000","last_change":"2023-10-08T16:08:50.715044+0000","last_active":"2023-10-08T16:09:06.632951+0000","last_peered":"2023-10-08T16:09:06.632951+0000","last_clean":"2023-10-08T16:09:06.632951+0000","last_became_active":"2023-10-08T16:04:17.620693+0000","last_became_peered":"2023-10-08T16:04:17.620693+0000","last_unstale":"2023-10-08T16:09:06.632951+0000","last_undegraded":"2023-10-08T16:09:06.632951+0000","last_fullsized":"2023-10-08T16:09:06.632951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011078684,"stat_sum":{"num_bytes":4121,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'97","reported_seq":115,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.712638+0000","last_change":"2023-10-08T16:04:16.663488+0000","last_active":"2023-10-08T16:08:50.712638+0000","last_peered":"2023-10-08T16:08:50.712638+0000","last_clean":"2023-10-08T16:08:50.712638+0000","last_became_active":"2023-10-08T16:04:16.663184+0000","last_became_peered":"2023-10-08T16:04:16.663184+0000","last_unstale":"2023-10-08T16:08:50.712638+0000","last_undegraded":"2023-10-08T16:08:50.712638+0000","last_fullsized":"2023-10-08T16:08:50.712638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:26.863386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":4152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"28'778","reported_seq":846,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.637315+0000","last_change":"2023-10-08T16:08:50.716768+0000","last_active":"2023-10-08T16:09:06.637315+0000","last_peered":"2023-10-08T16:09:06.637315+0000","last_clean":"2023-10-08T16:09:06.637315+0000","last_became_active":"2023-10-08T16:04:17.622898+0000","last_became_peered":"2023-10-08T16:04:17.622898+0000","last_unstale":"2023-10-08T16:09:06.637315+0000","last_undegraded":"2023-10-08T16:09:06.637315+0000","last_fullsized":"2023-10-08T16:09:06.637315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:33.720945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012379262,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"28'812","reported_seq":879,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.648671+0000","last_change":"2023-10-08T16:08:50.726432+0000","last_active":"2023-10-08T16:09:06.648671+0000","last_peered":"2023-10-08T16:09:06.648671+0000","last_clean":"2023-10-08T16:09:06.648671+0000","last_became_active":"2023-10-08T16:04:17.617179+0000","last_became_peered":"2023-10-08T16:04:17.617179+0000","last_unstale":"2023-10-08T16:09:06.648671+0000","last_undegraded":"2023-10-08T16:09:06.648671+0000","last_fullsized":"2023-10-08T16:09:06.648671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:56.205550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016893819000000001,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"27'2503","reported_seq":2521,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:52.142091+0000","last_change":"2023-10-08T16:04:16.661467+0000","last_active":"2023-10-08T16:08:52.142091+0000","last_peered":"2023-10-08T16:08:52.142091+0000","last_clean":"2023-10-08T16:08:52.142091+0000","last_became_active":"2023-10-08T16:04:16.661215+0000","last_became_peered":"2023-10-08T16:04:16.661215+0000","last_unstale":"2023-10-08T16:08:52.142091+0000","last_undegraded":"2023-10-08T16:08:52.142091+0000","last_fullsized":"2023-10-08T16:08:52.142091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":2503,"log_dups_size":0,"ondisk_log_size":2503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2502,"num_write_kb":5839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'612","reported_seq":679,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.647511+0000","last_change":"2023-10-08T16:08:50.727342+0000","last_active":"2023-10-08T16:09:06.647511+0000","last_peered":"2023-10-08T16:09:06.647511+0000","last_clean":"2023-10-08T16:09:06.647511+0000","last_became_active":"2023-10-08T16:04:17.617216+0000","last_became_peered":"2023-10-08T16:04:17.617216+0000","last_unstale":"2023-10-08T16:09:06.647511+0000","last_undegraded":"2023-10-08T16:09:06.647511+0000","last_fullsized":"2023-10-08T16:09:06.647511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:07.051965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020241687000000001,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1662","reported_seq":1680,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.915060+0000","last_change":"2023-10-08T16:04:16.661825+0000","last_active":"2023-10-08T16:09:06.915060+0000","last_peered":"2023-10-08T16:09:06.915060+0000","last_clean":"2023-10-08T16:09:06.915060+0000","last_became_active":"2023-10-08T16:04:16.661224+0000","last_became_peered":"2023-10-08T16:04:16.661224+0000","last_unstale":"2023-10-08T16:09:06.915060+0000","last_undegraded":"2023-10-08T16:09:06.915060+0000","last_fullsized":"2023-10-08T16:09:06.915060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1662,"log_dups_size":0,"ondisk_log_size":1662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:08.375883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9345162,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1650,"num_write_kb":9972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"28'531","reported_seq":599,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.648573+0000","last_change":"2023-10-08T16:08:50.784243+0000","last_active":"2023-10-08T16:09:06.648573+0000","last_peered":"2023-10-08T16:09:06.648573+0000","last_clean":"2023-10-08T16:09:06.648573+0000","last_became_active":"2023-10-08T16:04:17.621550+0000","last_became_peered":"2023-10-08T16:04:17.621550+0000","last_unstale":"2023-10-08T16:09:06.648573+0000","last_undegraded":"2023-10-08T16:09:06.648573+0000","last_fullsized":"2023-10-08T16:09:06.648573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:33.720945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.046468506999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"26'764","reported_seq":782,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.704289+0000","last_change":"2023-10-08T16:04:16.662223+0000","last_active":"2023-10-08T16:08:50.704289+0000","last_peered":"2023-10-08T16:08:50.704289+0000","last_clean":"2023-10-08T16:08:50.704289+0000","last_became_active":"2023-10-08T16:04:16.661907+0000","last_became_peered":"2023-10-08T16:04:16.661907+0000","last_unstale":"2023-10-08T16:08:50.704289+0000","last_undegraded":"2023-10-08T16:08:50.704289+0000","last_fullsized":"2023-10-08T16:08:50.704289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:04.030037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":4591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"28'524","reported_seq":592,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.637537+0000","last_change":"2023-10-08T16:08:50.715393+0000","last_active":"2023-10-08T16:09:06.637537+0000","last_peered":"2023-10-08T16:09:06.637537+0000","last_clean":"2023-10-08T16:09:06.637537+0000","last_became_active":"2023-10-08T16:04:17.627562+0000","last_became_peered":"2023-10-08T16:04:17.627562+0000","last_unstale":"2023-10-08T16:09:06.637537+0000","last_undegraded":"2023-10-08T16:09:06.637537+0000","last_fullsized":"2023-10-08T16:09:06.637537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:08.121055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011393438000000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"27'2621","reported_seq":2639,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:51.147036+0000","last_change":"2023-10-08T16:04:16.663088+0000","last_active":"2023-10-08T16:08:51.147036+0000","last_peered":"2023-10-08T16:08:51.147036+0000","last_clean":"2023-10-08T16:08:51.147036+0000","last_became_active":"2023-10-08T16:04:16.662714+0000","last_became_peered":"2023-10-08T16:04:16.662714+0000","last_unstale":"2023-10-08T16:08:51.147036+0000","last_undegraded":"2023-10-08T16:08:51.147036+0000","last_fullsized":"2023-10-08T16:08:51.147036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":2621,"log_dups_size":0,"ondisk_log_size":2621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:54.682083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2619,"num_write_kb":5944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":82,"num_object_clones":21,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":8,"num_read":31,"num_read_kb":21,"num_write":110,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37743,"ondisk_log_size":37743,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":85124036,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":62,"num_read_kb":321,"num_write":17972,"num_write_kb":93766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":170311680,"data_stored":170248072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18059,"ondisk_log_size":18059,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574912,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":348308,"kb_used_data":38732,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94023532,"statfs":{"total":96636764160,"available":96280096768,"internally_reserved":0,"allocated":39661568,"data_stored":39449571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.83199999999999996,"15min":0.86199999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.2070000000000001,"5min":1.976,"15min":1.976},"last":1.1890000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82699999999999996,"15min":0.85999999999999999},"min":{"1min":0.379,"5min":0.314,"15min":0.314},"max":{"1min":1.2150000000000001,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.877}]},{"osd":1,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.85799999999999998,"15min":0.86799999999999999},"min":{"1min":0.45600000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.837,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.88900000000000001,"15min":0.90900000000000003},"min":{"1min":0.55000000000000004,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.24,"5min":1.54,"15min":1.54},"last":1.24}]},{"osd":2,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.90300000000000002,"15min":0.90500000000000003},"min":{"1min":0.60899999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.26,"5min":1.478,"15min":1.478},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.89000000000000001,"15min":0.92200000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.415,"5min":1.948,"15min":1.948},"last":1.1639999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96599999999999997,"15min":0.97899999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.008,"5min":1.014,"15min":1.048},"min":{"1min":0.70599999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3360000000000001,"5min":1.552,"15min":1.552},"last":0.98499999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.97899999999999998,"15min":1},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.5600000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.0609999999999999,"15min":1.083},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.083}]},{"osd":5,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.0249999999999999,"15min":1.0569999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6479999999999999,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0920000000000001,"15min":1.1220000000000001},"min":{"1min":0.52600000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.4990000000000001,"5min":1.726,"15min":1.726},"last":1.272}]},{"osd":6,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.161,"15min":1.212},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.6240000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.222},{"interface":"front","average":{"1min":1.149,"5min":1.1739999999999999,"15min":1.1970000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.296}]}]},{"osd":6,"up_from":13,"seq":55834574913,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319052,"kb_used_data":17668,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94052788,"statfs":{"total":96636764160,"available":96310054912,"internally_reserved":0,"allocated":18092032,"data_stored":17887733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.77100000000000002,"15min":0.76700000000000002},"min":{"1min":0.45400000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":3.8290000000000002,"5min":3.8290000000000002,"15min":3.8290000000000002},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.999,"5min":0.83399999999999996,"15min":0.748},"min":{"1min":0.48999999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":3.8519999999999999,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":1.179}]},{"osd":1,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.91000000000000003,"15min":0.91200000000000003},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3740000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.02}]},{"osd":2,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86799999999999999,"15min":0.84999999999999998},"min":{"1min":0.60299999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1830000000000001,"5min":1.25,"15min":1.25},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.90600000000000003,"15min":0.91500000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.24,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.1080000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.92200000000000004,"15min":0.85999999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.4199999999999999,"5min":2.173,"15min":2.173},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.998,"15min":0.96199999999999997},"min":{"1min":0.58099999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2350000000000001,"5min":1.381,"15min":1.381},"last":0.97199999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.96999999999999997,"15min":0.998},"min":{"1min":0.55600000000000005,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.373,"5min":1.413,"15min":1.413},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.01,"5min":1.0489999999999999,"15min":1.022},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.383,"5min":2.25,"15min":2.25},"last":1.0640000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0820000000000001,"15min":1.04},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.319,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":1.141},{"interface":"front","average":{"1min":1.319,"5min":1.3080000000000001,"15min":1.2030000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":6.0439999999999996,"5min":17.428999999999998,"15min":17.428999999999998},"last":1.2390000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.1579999999999999,"15min":1.1020000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":6.0229999999999997,"5min":6.0229999999999997,"15min":6.0229999999999997},"last":1.296},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.224,"15min":1.202},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":3.706,"5min":3.706,"15min":3.706},"last":1.3180000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":330424,"kb_used_data":20848,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94041416,"statfs":{"total":96636764160,"available":96298409984,"internally_reserved":0,"allocated":21348352,"data_stored":21141337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.80000000000000004,"15min":0.876},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.024,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.81100000000000005,"15min":0.81899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":4.2839999999999998,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.79500000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":0.86699999999999999,"15min":0.83999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":4.399,"5min":4.399,"15min":4.399},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.89200000000000002,"15min":0.89500000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":4.5149999999999997,"5min":4.5149999999999997,"15min":4.5149999999999997},"last":1.111}]},{"osd":2,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.85499999999999998,"15min":0.89400000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.089,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.90200000000000002,"15min":0.89800000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.0700000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":0.98999999999999999,"15min":1.0009999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":4.7140000000000004,"5min":4.7140000000000004,"15min":4.7140000000000004},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.044,"15min":1.0600000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":4.6920000000000002,"5min":4.6920000000000002,"15min":4.6920000000000002},"last":1.1499999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":1.014,"15min":1.0449999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.5800000000000001,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.996},{"interface":"front","average":{"1min":0.89800000000000002,"5min":1.012,"15min":1.095},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.224,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.0289999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0489999999999999,"15min":1.079},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.198},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.1180000000000001,"15min":1.208},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2390000000000001,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.1839999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.101,"15min":1.2},"min":{"1min":0.61799999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.228,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.228},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.169,"15min":1.1890000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.387}]}]},{"osd":4,"up_from":13,"seq":55834574913,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":334488,"kb_used_data":29008,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94037352,"statfs":{"total":96636764160,"available":96294248448,"internally_reserved":0,"allocated":29704192,"data_stored":29497190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.80100000000000005,"15min":0.81299999999999994},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.2250000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79700000000000004,"15min":0.78700000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.163,"5min":1.641,"15min":1.641},"last":1.0409999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.84199999999999997},"min":{"1min":0.36299999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1779999999999999,"5min":1.292,"15min":1.292},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.89000000000000001,"15min":0.874},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.248,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.80300000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.86199999999999999,"15min":0.873},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1659999999999999,"5min":1.276,"15min":1.276},"last":1.081},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.012,"15min":0.96399999999999997},"min":{"1min":0.56200000000000006,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.339,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.1950000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.92200000000000004,"15min":0.96599999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2709999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0389999999999999,"15min":1.091},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2330000000000001,"5min":1.448,"15min":1.448},"last":1.1579999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.0169999999999999,"15min":1.0209999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2629999999999999,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.002,"5min":1.1000000000000001,"15min":1.075},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.208,"5min":9.8480000000000008,"15min":9.8480000000000008},"last":0.76900000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.044,"15min":1.1319999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.248,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1539999999999999,"15min":1.1699999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3939999999999999,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.1020000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1919999999999999,"15min":1.1699999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.3280000000000001,"5min":8.8290000000000006,"15min":8.8290000000000006},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1870000000000001,"15min":1.2629999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3859999999999999,"5min":1.71,"15min":1.71},"last":1.22}]}]},{"osd":3,"up_from":13,"seq":55834574912,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":318408,"kb_used_data":17024,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94053432,"statfs":{"total":96636764160,"available":96310714368,"internally_reserved":0,"allocated":17432576,"data_stored":17223470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65300000000000002,"15min":0.66000000000000003},"min":{"1min":0.52400000000000002,"5min":0.214,"15min":0.214},"max":{"1min":0.89100000000000001,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70299999999999996,"15min":0.71099999999999997},"min":{"1min":0.40999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.026,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":0.73599999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.69999999999999996,"15min":0.65600000000000003},"min":{"1min":0.42399999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1120000000000001,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.85099999999999998,"15min":0.76900000000000002},"min":{"1min":0.45700000000000002,"5min":0.249,"15min":0.249},"max":{"1min":1.3420000000000001,"5min":8.3059999999999992,"15min":8.3059999999999992},"last":0.79100000000000004}]},{"osd":2,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.1100000000000001,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.81299999999999994,"15min":0.78500000000000003},"min":{"1min":0.53900000000000003,"5min":0.433,"15min":0.433},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.65900000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.99299999999999999,"15min":1.0309999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.2310000000000001,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":0.996},{"interface":"front","average":{"1min":1.04,"5min":0.997,"15min":1.0049999999999999},"min":{"1min":0.74399999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3919999999999999,"5min":2.202,"15min":2.202},"last":1.1259999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0569999999999999,"15min":1.0820000000000001},"min":{"1min":0.69099999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.4379999999999999,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.012,"5min":1.0760000000000001,"15min":1.099},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.341,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.345}]},{"osd":6,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0620000000000001,"15min":1.0680000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3220000000000001,"5min":2.113,"15min":2.113},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1299999999999999,"15min":1.1679999999999999},"min":{"1min":0.72999999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.5129999999999999,"5min":3.351,"15min":3.351},"last":1.24}]},{"osd":7,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.1459999999999999,"15min":1.2110000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.353,"5min":2.984,"15min":2.984},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.1799999999999999,"15min":1.141},"min":{"1min":0.69999999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":6.3940000000000001,"5min":6.3940000000000001,"15min":6.3940000000000001},"last":1.177}]}]},{"osd":2,"up_from":13,"seq":55834574912,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310200,"kb_used_data":4720,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94061640,"statfs":{"total":96636764160,"available":96319119360,"internally_reserved":0,"allocated":4833280,"data_stored":4631728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.36099999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63,"15min":0.621},"min":{"1min":0.44800000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.83899999999999997,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.68500000000000005}]},{"osd":1,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.72199999999999998,"15min":0.748},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.753,"15min":0.74099999999999999},"min":{"1min":0.52400000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.76700000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.74399999999999999,"15min":0.75900000000000001},"min":{"1min":0.57899999999999996,"5min":0.315,"15min":0.315},"max":{"1min":0.871,"5min":1.454,"15min":1.454},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.86399999999999999,"15min":0.874},"min":{"1min":0.505,"5min":0.433,"15min":0.433},"max":{"1min":1.115,"5min":1.306,"15min":1.306},"last":1.1080000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.97299999999999998,"15min":1.0149999999999999},"min":{"1min":0.60499999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2250000000000001,"5min":1.954,"15min":1.954},"last":1.212},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.998,"15min":1.0349999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.377,"5min":1.804,"15min":1.804},"last":1.052}]},{"osd":5,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.96499999999999997,"15min":1.0149999999999999},"min":{"1min":0.61699999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.401,"5min":1.873,"15min":1.873},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0569999999999999,"15min":1.0960000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.206,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.024}]},{"osd":6,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.05,"15min":1.0860000000000001},"min":{"1min":0.70399999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.329,"5min":1.974,"15min":1.974},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.995,"5min":1.0469999999999999,"15min":1.079},"min":{"1min":0.66300000000000003,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.361,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.1779999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.1140000000000001,"15min":1.147},"min":{"1min":0.84999999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.3029999999999999,"5min":1.915,"15min":1.915},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.115,"15min":1.1599999999999999},"min":{"1min":0.79100000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.4219999999999999,"5min":2.524,"15min":2.524},"last":1.2549999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326288,"kb_used_data":20808,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94045552,"statfs":{"total":96636764160,"available":96302645248,"internally_reserved":0,"allocated":21307392,"data_stored":21108603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60399999999999998,"15min":0.60799999999999998},"min":{"1min":0.315,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.98999999999999999,"5min":1.024,"15min":1.024},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.65700000000000003,"15min":0.65100000000000002},"min":{"1min":0.39100000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.74199999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68200000000000005,"15min":0.65000000000000002},"min":{"1min":0.42899999999999999,"5min":0.373,"15min":0.373},"max":{"1min":1.3129999999999999,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":1.159},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.747,"15min":0.76300000000000001},"min":{"1min":0.53100000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.80200000000000005}]},{"osd":3,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79500000000000004,"15min":0.83799999999999997},"min":{"1min":0.51200000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.224,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.76400000000000001,"15min":0.76300000000000001},"min":{"1min":0.47199999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.153,"5min":1.25,"15min":1.25},"last":0.89600000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.90900000000000003,"15min":0.93200000000000005},"min":{"1min":0.60399999999999998,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.173,"5min":1.492,"15min":1.492},"last":1.02},{"interface":"front","average":{"1min":0.91200000000000003,"5min":1.0169999999999999,"15min":1.0149999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2210000000000001,"5min":3.5910000000000002,"15min":3.5910000000000002},"last":1.3320000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":1.03,"15min":1.0369999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.2829999999999999,"5min":3.6280000000000001,"15min":3.6280000000000001},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.109,"5min":1.075,"15min":1.113},"min":{"1min":0.69499999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.4650000000000001,"5min":1.641,"15min":1.641},"last":1.0009999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0409999999999999,"15min":1.091},"min":{"1min":0.71299999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.4299999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.117,"15min":1.1419999999999999},"min":{"1min":0.71099999999999997,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3660000000000001,"5min":3.657,"15min":3.657},"last":1.4870000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.103,"15min":1.1499999999999999},"min":{"1min":0.751,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.548,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.079,"5min":1.085,"15min":1.1220000000000001},"min":{"1min":0.68200000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3260000000000001,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.1910000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574912,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":330996,"kb_used_data":21420,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94040844,"statfs":{"total":96636764160,"available":96297824256,"internally_reserved":0,"allocated":21934080,"data_stored":21706793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.66000000000000003,"15min":0.64500000000000002},"min":{"1min":0.46000000000000002,"5min":0.318,"15min":0.318},"max":{"1min":3.9449999999999998,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.40699999999999997,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1659999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.68999999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.72099999999999997,"15min":0.70299999999999996},"min":{"1min":0.52100000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.755},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.77800000000000002,"15min":0.77400000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.3340000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.83399999999999996}]},{"osd":3,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.42699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":4.2229999999999999,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.84099999999999997,"15min":0.82299999999999995},"min":{"1min":0.628,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.88300000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.99199999999999999,"15min":0.999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.722,"5min":1.734,"15min":1.734},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.97299999999999998,"15min":1.014},"min":{"1min":0.63400000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.286,"5min":1.552,"15min":1.552},"last":1.006}]},{"osd":5,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.98399999999999999,"15min":1.0109999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.361,"5min":1.601,"15min":1.601},"last":1.157},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.0740000000000001,"15min":1.0760000000000001},"min":{"1min":0.76900000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.133}]},{"osd":6,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.115,"15min":1.129},"min":{"1min":0.71899999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.056},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1060000000000001,"15min":1.087},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.0900000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.161,"15min":1.157},"min":{"1min":0.81499999999999995,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.0940000000000001,"15min":1.1160000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":1.228}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20983808,"data_stored":20972130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20979712,"data_stored":20971680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4476928,"data_stored":4474292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17068032,"data_stored":17057848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17743872,"data_stored":17734414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":38711296,"data_stored":38705844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":24687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":16404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":36917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":45103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":16417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":49208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":32800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":32840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:09:15.033 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-08T16:09:15.033 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:09:15.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.137+0000 7fdfaf59e700 1 Processor -- start 2023-10-08T16:09:15.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.137+0000 7fdfaf59e700 1 -- start start 2023-10-08T16:09:15.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.141+0000 7fdfaf59e700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fdfb00b06f0 0x7fdfb00aea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:15.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.141+0000 7fdfaf59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb00b1260 con 0x7fdfb0142840 2023-10-08T16:09:15.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.141+0000 7fdfaf59e700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb00adda0 con 0x7fdfb0067ea0 2023-10-08T16:09:15.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.141+0000 7fdfaf59e700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb00ad980 con 0x7fdfb00b06f0 2023-10-08T16:09:15.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.141+0000 7fdfaed9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdfb0142840 0x7fdfb013e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56292/0 (socket says 172.21.15.133:56292) 2023-10-08T16:09:15.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.141+0000 7fdfaed9d700 1 -- 172.21.15.133:0/2226462067 learned_addr learned my addr 172.21.15.133:0/2226462067 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:09:15.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.141+0000 7fdfadd9b700 1 --2- 172.21.15.133:0/2226462067 >> v2:172.21.15.190:3300/0 conn(0x7fdfb00b06f0 0x7fdfb00aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:15.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.141+0000 7fdfad59a700 1 -- 172.21.15.133:0/2226462067 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028864495 0 0) 0x7fdfb00b1260 con 0x7fdfb0142840 2023-10-08T16:09:15.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.141+0000 7fdfad59a700 1 -- 172.21.15.133:0/2226462067 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf9c003570 con 0x7fdfb0142840 2023-10-08T16:09:15.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.141+0000 7fdfadd9b700 1 -- 172.21.15.133:0/2226462067 >> v1:172.21.15.190:6789/0 conn(0x7fdfb0067ea0 legacy=0x7fdfb0142130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:15.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.141+0000 7fdfadd9b700 1 -- 172.21.15.133:0/2226462067 >> v1:172.21.15.133:6789/0 conn(0x7fdfb0142840 legacy=0x7fdfb013e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:15.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.141+0000 7fdfadd9b700 1 -- 172.21.15.133:0/2226462067 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb00b0c10 con 0x7fdfb00b06f0 2023-10-08T16:09:15.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.141+0000 7fdfadd9b700 1 --2- 172.21.15.133:0/2226462067 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfb00b06f0 0x7fdfb00aea70 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00098e0 tx=0x7fdfa00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6a30735f7d42443 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:15.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.141+0000 7fdfad59a700 1 -- 172.21.15.133:0/2226462067 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa000b640 con 0x7fdfb00b06f0 2023-10-08T16:09:15.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.141+0000 7fdfad59a700 1 -- 172.21.15.133:0/2226462067 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa000b7a0 con 0x7fdfb00b06f0 2023-10-08T16:09:15.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.141+0000 7fdfad59a700 1 -- 172.21.15.133:0/2226462067 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa000bb20 con 0x7fdfb00b06f0 2023-10-08T16:09:15.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.141+0000 7fdfaf59e700 1 -- 172.21.15.133:0/2226462067 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfb00b06f0 msgr2=0x7fdfb00aea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:15.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.141+0000 7fdfaf59e700 1 --2- 172.21.15.133:0/2226462067 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfb00b06f0 0x7fdfb00aea70 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00098e0 tx=0x7fdfa00091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.141+0000 7fdfaf59e700 1 -- 172.21.15.133:0/2226462067 shutdown_connections 2023-10-08T16:09:15.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.141+0000 7fdfaf59e700 1 --2- 172.21.15.133:0/2226462067 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfb00b06f0 0x7fdfb00aea70 unknown :-1 s=CLOSED pgs=2241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.141+0000 7fdfaf59e700 1 -- 172.21.15.133:0/2226462067 >> 172.21.15.133:0/2226462067 conn(0x7fdfb0063670 msgr2=0x7fdfb00b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:15.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.141+0000 7fdfaf59e700 1 -- 172.21.15.133:0/2226462067 shutdown_connections 2023-10-08T16:09:15.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.141+0000 7fdfaf59e700 1 -- 172.21.15.133:0/2226462067 wait complete. 2023-10-08T16:09:15.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.145+0000 7fdfaf59e700 1 Processor -- start 2023-10-08T16:09:15.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.145+0000 7fdfaf59e700 1 -- start start 2023-10-08T16:09:15.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.145+0000 7fdfaf59e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdfb0067ea0 0x7fdfb0141840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:15.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.145+0000 7fdfaf59e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfb00b06f0 0x7fdfb0151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:15.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.145+0000 7fdfaf59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfb0142840 0x7fdfb0139d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:15.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.145+0000 7fdfaf59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb0156480 con 0x7fdfb0142840 2023-10-08T16:09:15.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.145+0000 7fdfaf59e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb01559a0 con 0x7fdfb00b06f0 2023-10-08T16:09:15.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.145+0000 7fdfaf59e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb0155c80 con 0x7fdfb0067ea0 2023-10-08T16:09:15.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.145+0000 7fdfaed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfb0142840 0x7fdfb0139d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:15.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.145+0000 7fdfaed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfb0142840 0x7fdfb0139d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48396/0 (socket says 172.21.15.133:48396) 2023-10-08T16:09:15.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.145+0000 7fdfaed9d700 1 -- 172.21.15.133:0/336027137 learned_addr learned my addr 172.21.15.133:0/336027137 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:15.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.145+0000 7fdfadd9b700 1 --2- 172.21.15.133:0/336027137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfb00b06f0 0x7fdfb0151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:15.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.145+0000 7fdfae59c700 1 --2- 172.21.15.133:0/336027137 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdfb0067ea0 0x7fdfb0141840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:15.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.145+0000 7fdfaed9d700 1 -- 172.21.15.133:0/336027137 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdfb0067ea0 msgr2=0x7fdfb0141840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:15.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.145+0000 7fdfaed9d700 1 --2- 172.21.15.133:0/336027137 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdfb0067ea0 0x7fdfb0141840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.145+0000 7fdfaed9d700 1 -- 172.21.15.133:0/336027137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfb00b06f0 msgr2=0x7fdfb0151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:15.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.145+0000 7fdfaed9d700 1 --2- 172.21.15.133:0/336027137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfb00b06f0 0x7fdfb0151fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.145+0000 7fdfaed9d700 1 -- 172.21.15.133:0/336027137 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa0009420 con 0x7fdfb0142840 2023-10-08T16:09:15.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.145+0000 7fdfaed9d700 1 --2- 172.21.15.133:0/336027137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfb0142840 0x7fdfb0139d50 secure :-1 s=READY pgs=4356 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8001460 tx=0x7fdfa8001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:15.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.145+0000 7fdfa67fc700 1 -- 172.21.15.133:0/336027137 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa800a870 con 0x7fdfb0142840 2023-10-08T16:09:15.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.145+0000 7fdfa67fc700 1 -- 172.21.15.133:0/336027137 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa800a9d0 con 0x7fdfb0142840 2023-10-08T16:09:15.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.145+0000 7fdfaf59e700 1 -- 172.21.15.133:0/336027137 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb0155f60 con 0x7fdfb0142840 2023-10-08T16:09:15.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.145+0000 7fdfa67fc700 1 -- 172.21.15.133:0/336027137 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa800ad50 con 0x7fdfb0142840 2023-10-08T16:09:15.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.145+0000 7fdfaf59e700 1 -- 172.21.15.133:0/336027137 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb013ef00 con 0x7fdfb0142840 2023-10-08T16:09:15.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.149+0000 7fdfaf59e700 1 -- 172.21.15.133:0/336027137 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb01561a0 con 0x7fdfb0142840 2023-10-08T16:09:15.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.149+0000 7fdfa67fc700 1 -- 172.21.15.133:0/336027137 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdfa8007300 con 0x7fdfb0142840 2023-10-08T16:09:15.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.149+0000 7fdfa67fc700 1 --2- 172.21.15.133:0/336027137 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fdf90060550 0x7fdf90062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:15.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.149+0000 7fdfa67fc700 1 -- 172.21.15.133:0/336027137 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fdfa807cae0 con 0x7fdfb0142840 2023-10-08T16:09:15.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.149+0000 7fdfae59c700 1 --2- 172.21.15.133:0/336027137 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fdf90060550 0x7fdf90062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:15.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.149+0000 7fdfae59c700 1 --2- 172.21.15.133:0/336027137 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fdf90060550 0x7fdf90062a00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdf98003aa0 tx=0x7fdf98000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:15.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.153+0000 7fdfa67fc700 1 -- 172.21.15.133:0/336027137 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdfb01561a0 con 0x7fdfb0142840 2023-10-08T16:09:15.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.305+0000 7fdfaf59e700 1 -- 172.21.15.133:0/336027137 --> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdfb01561a0 con 0x7fdf90060550 2023-10-08T16:09:15.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.321+0000 7fdfa67fc700 1 -- 172.21.15.133:0/336027137 <== mgr.4104 v2:172.21.15.133:6832/33362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289814 (secure 0 0 0) 0x7fdfb01561a0 con 0x7fdf90060550 2023-10-08T16:09:15.332 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:09:15.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.325+0000 7fdfaf59e700 1 -- 172.21.15.133:0/336027137 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fdf90060550 msgr2=0x7fdf90062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:15.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.325+0000 7fdfaf59e700 1 --2- 172.21.15.133:0/336027137 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fdf90060550 0x7fdf90062a00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdf98003aa0 tx=0x7fdf98000bc0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.325+0000 7fdfaf59e700 1 -- 172.21.15.133:0/336027137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfb0142840 msgr2=0x7fdfb0139d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:15.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.325+0000 7fdfaf59e700 1 --2- 172.21.15.133:0/336027137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfb0142840 0x7fdfb0139d50 secure :-1 s=READY pgs=4356 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8001460 tx=0x7fdfa8001a40 comp rx=0 tx=0).stop 2023-10-08T16:09:15.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.325+0000 7fdfaf59e700 1 -- 172.21.15.133:0/336027137 shutdown_connections 2023-10-08T16:09:15.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.325+0000 7fdfaf59e700 1 --2- 172.21.15.133:0/336027137 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fdf90060550 0x7fdf90062a00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.325+0000 7fdfaf59e700 1 --2- 172.21.15.133:0/336027137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfb0142840 0x7fdfb0139d50 unknown :-1 s=CLOSED pgs=4356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.325+0000 7fdfaf59e700 1 --2- 172.21.15.133:0/336027137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfb00b06f0 0x7fdfb0151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.325+0000 7fdfaf59e700 1 --2- 172.21.15.133:0/336027137 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdfb0067ea0 0x7fdfb0141840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.325+0000 7fdfaf59e700 1 -- 172.21.15.133:0/336027137 >> 172.21.15.133:0/336027137 conn(0x7fdfb0063670 msgr2=0x7fdfb0142130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:15.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.329+0000 7fdfaf59e700 1 -- 172.21.15.133:0/336027137 shutdown_connections 2023-10-08T16:09:15.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.329+0000 7fdfaf59e700 1 -- 172.21.15.133:0/336027137 wait complete. 2023-10-08T16:09:15.338 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-10-08T16:09:15.348 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2023-10-08T16:09:14.939367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":85841592,"num_objects":127,"num_object_clones":21,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":8,"num_read":209,"num_read_kb":442,"num_write":18241,"num_write_kb":96379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55919,"ondisk_log_size":55919,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2618164,"kb_used_data":170228,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752356556,"statfs":{"total":773094113280,"available":770413113344,"internally_reserved":0,"allocated":174313472,"data_stored":172646425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":558481,"num_objects":6,"num_object_clones":3,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":3,"num_read":7,"num_read_kb":8,"num_write":111,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004158"},"pg_stats":[{"pgid":"3.3f","version":"28'511","reported_seq":579,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646405+0000","last_change":"2023-10-08T16:08:50.725515+0000","last_active":"2023-10-08T16:09:06.646405+0000","last_peered":"2023-10-08T16:09:06.646405+0000","last_clean":"2023-10-08T16:09:06.646405+0000","last_became_active":"2023-10-08T16:04:17.626468+0000","last_became_peered":"2023-10-08T16:04:17.626468+0000","last_unstale":"2023-10-08T16:09:06.646405+0000","last_undegraded":"2023-10-08T16:09:06.646405+0000","last_fullsized":"2023-10-08T16:09:06.646405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:37.040973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012965628,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"28'502","reported_seq":570,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.632342+0000","last_change":"2023-10-08T16:08:50.761523+0000","last_active":"2023-10-08T16:09:06.632342+0000","last_peered":"2023-10-08T16:09:06.632342+0000","last_clean":"2023-10-08T16:09:06.632342+0000","last_became_active":"2023-10-08T16:04:17.623968+0000","last_became_peered":"2023-10-08T16:04:17.623968+0000","last_unstale":"2023-10-08T16:09:06.632342+0000","last_undegraded":"2023-10-08T16:09:06.632342+0000","last_fullsized":"2023-10-08T16:09:06.632342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025754998000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"28'750","reported_seq":817,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.628419+0000","last_change":"2023-10-08T16:08:50.782249+0000","last_active":"2023-10-08T16:09:06.628419+0000","last_peered":"2023-10-08T16:09:06.628419+0000","last_clean":"2023-10-08T16:09:06.628419+0000","last_became_active":"2023-10-08T16:04:17.624219+0000","last_became_peered":"2023-10-08T16:04:17.624219+0000","last_unstale":"2023-10-08T16:09:06.628419+0000","last_undegraded":"2023-10-08T16:09:06.628419+0000","last_fullsized":"2023-10-08T16:09:06.628419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:07.785877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.046708411999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'447","reported_seq":515,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.640828+0000","last_change":"2023-10-08T16:08:50.726275+0000","last_active":"2023-10-08T16:09:06.640828+0000","last_peered":"2023-10-08T16:09:06.640828+0000","last_clean":"2023-10-08T16:09:06.640828+0000","last_became_active":"2023-10-08T16:04:17.628308+0000","last_became_peered":"2023-10-08T16:04:17.628308+0000","last_unstale":"2023-10-08T16:09:06.640828+0000","last_undegraded":"2023-10-08T16:09:06.640828+0000","last_fullsized":"2023-10-08T16:09:06.640828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:48.519448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019603182,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'456","reported_seq":523,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646223+0000","last_change":"2023-10-08T16:08:50.725181+0000","last_active":"2023-10-08T16:09:06.646223+0000","last_peered":"2023-10-08T16:09:06.646223+0000","last_clean":"2023-10-08T16:09:06.646223+0000","last_became_active":"2023-10-08T16:04:17.625650+0000","last_became_peered":"2023-10-08T16:04:17.625650+0000","last_unstale":"2023-10-08T16:09:06.646223+0000","last_undegraded":"2023-10-08T16:09:06.646223+0000","last_fullsized":"2023-10-08T16:09:06.646223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:42.972904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013008828,"stat_sum":{"num_bytes":4107,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'638","reported_seq":703,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.630901+0000","last_change":"2023-10-08T16:08:50.747973+0000","last_active":"2023-10-08T16:09:06.630901+0000","last_peered":"2023-10-08T16:09:06.630901+0000","last_clean":"2023-10-08T16:09:06.630901+0000","last_became_active":"2023-10-08T16:04:59.029141+0000","last_became_peered":"2023-10-08T16:04:59.029141+0000","last_unstale":"2023-10-08T16:09:06.630901+0000","last_undegraded":"2023-10-08T16:09:06.630901+0000","last_fullsized":"2023-10-08T16:09:06.630901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:26:02.042909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010017161,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"28'439","reported_seq":507,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.645595+0000","last_change":"2023-10-08T16:08:50.721969+0000","last_active":"2023-10-08T16:09:06.645595+0000","last_peered":"2023-10-08T16:09:06.645595+0000","last_clean":"2023-10-08T16:09:06.645595+0000","last_became_active":"2023-10-08T16:04:17.631722+0000","last_became_peered":"2023-10-08T16:04:17.631722+0000","last_unstale":"2023-10-08T16:09:06.645595+0000","last_undegraded":"2023-10-08T16:09:06.645595+0000","last_fullsized":"2023-10-08T16:09:06.645595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:52.670934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010482406,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'606","reported_seq":673,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650514+0000","last_change":"2023-10-08T16:08:50.714547+0000","last_active":"2023-10-08T16:09:06.650514+0000","last_peered":"2023-10-08T16:09:06.650514+0000","last_clean":"2023-10-08T16:09:06.650514+0000","last_became_active":"2023-10-08T16:04:17.628987+0000","last_became_peered":"2023-10-08T16:04:17.628987+0000","last_unstale":"2023-10-08T16:09:06.650514+0000","last_undegraded":"2023-10-08T16:09:06.650514+0000","last_fullsized":"2023-10-08T16:09:06.650514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:26.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011543940000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"28'702","reported_seq":770,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650736+0000","last_change":"2023-10-08T16:08:50.727041+0000","last_active":"2023-10-08T16:09:06.650736+0000","last_peered":"2023-10-08T16:09:06.650736+0000","last_clean":"2023-10-08T16:09:06.650736+0000","last_became_active":"2023-10-08T16:04:17.636350+0000","last_became_peered":"2023-10-08T16:04:17.636350+0000","last_unstale":"2023-10-08T16:09:06.650736+0000","last_undegraded":"2023-10-08T16:09:06.650736+0000","last_fullsized":"2023-10-08T16:09:06.650736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:38:37.066127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014319053,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'946","reported_seq":1024,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.636787+0000","last_change":"2023-10-08T16:08:50.720768+0000","last_active":"2023-10-08T16:09:06.636787+0000","last_peered":"2023-10-08T16:09:06.636787+0000","last_clean":"2023-10-08T16:09:06.636787+0000","last_became_active":"2023-10-08T16:04:58.696602+0000","last_became_peered":"2023-10-08T16:04:58.696602+0000","last_unstale":"2023-10-08T16:09:06.636787+0000","last_undegraded":"2023-10-08T16:09:06.636787+0000","last_fullsized":"2023-10-08T16:09:06.636787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":946,"log_dups_size":0,"ondisk_log_size":946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:04.594336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014587116000000001,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"28'515","reported_seq":583,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.647874+0000","last_change":"2023-10-08T16:08:50.717913+0000","last_active":"2023-10-08T16:09:06.647874+0000","last_peered":"2023-10-08T16:09:06.647874+0000","last_clean":"2023-10-08T16:09:06.647874+0000","last_became_active":"2023-10-08T16:04:17.627965+0000","last_became_peered":"2023-10-08T16:04:17.627965+0000","last_unstale":"2023-10-08T16:09:06.647874+0000","last_undegraded":"2023-10-08T16:09:06.647874+0000","last_fullsized":"2023-10-08T16:09:06.647874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012809017000000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'622","reported_seq":690,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.651027+0000","last_change":"2023-10-08T16:08:50.748915+0000","last_active":"2023-10-08T16:09:06.651027+0000","last_peered":"2023-10-08T16:09:06.651027+0000","last_clean":"2023-10-08T16:09:06.651027+0000","last_became_active":"2023-10-08T16:04:17.616988+0000","last_became_peered":"2023-10-08T16:04:17.616988+0000","last_unstale":"2023-10-08T16:09:06.651027+0000","last_undegraded":"2023-10-08T16:09:06.651027+0000","last_fullsized":"2023-10-08T16:09:06.651027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:49.607853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010221923000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"28'578","reported_seq":646,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.636406+0000","last_change":"2023-10-08T16:08:50.715034+0000","last_active":"2023-10-08T16:09:06.636406+0000","last_peered":"2023-10-08T16:09:06.636406+0000","last_clean":"2023-10-08T16:09:06.636406+0000","last_became_active":"2023-10-08T16:04:17.625529+0000","last_became_peered":"2023-10-08T16:04:17.625529+0000","last_unstale":"2023-10-08T16:09:06.636406+0000","last_undegraded":"2023-10-08T16:09:06.636406+0000","last_fullsized":"2023-10-08T16:09:06.636406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:07.051965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011264827,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"28'489","reported_seq":557,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.629848+0000","last_change":"2023-10-08T16:08:50.772353+0000","last_active":"2023-10-08T16:09:06.629848+0000","last_peered":"2023-10-08T16:09:06.629848+0000","last_clean":"2023-10-08T16:09:06.629848+0000","last_became_active":"2023-10-08T16:04:17.624197+0000","last_became_peered":"2023-10-08T16:04:17.624197+0000","last_unstale":"2023-10-08T16:09:06.629848+0000","last_undegraded":"2023-10-08T16:09:06.629848+0000","last_fullsized":"2023-10-08T16:09:06.629848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:08.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037453408000000001,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"28'586","reported_seq":654,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.639903+0000","last_change":"2023-10-08T16:08:50.764291+0000","last_active":"2023-10-08T16:09:06.639903+0000","last_peered":"2023-10-08T16:09:06.639903+0000","last_clean":"2023-10-08T16:09:06.639903+0000","last_became_active":"2023-10-08T16:04:17.620391+0000","last_became_peered":"2023-10-08T16:04:17.620391+0000","last_unstale":"2023-10-08T16:09:06.639903+0000","last_undegraded":"2023-10-08T16:09:06.639903+0000","last_fullsized":"2023-10-08T16:09:06.639903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:08.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029228837000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"28'650","reported_seq":717,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649001+0000","last_change":"2023-10-08T16:08:50.723712+0000","last_active":"2023-10-08T16:09:06.649001+0000","last_peered":"2023-10-08T16:09:06.649001+0000","last_clean":"2023-10-08T16:09:06.649001+0000","last_became_active":"2023-10-08T16:04:17.619843+0000","last_became_peered":"2023-10-08T16:04:17.619843+0000","last_unstale":"2023-10-08T16:09:06.649001+0000","last_undegraded":"2023-10-08T16:09:06.649001+0000","last_fullsized":"2023-10-08T16:09:06.649001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.599406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018851915,"stat_sum":{"num_bytes":4105,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"28'622","reported_seq":690,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650219+0000","last_change":"2023-10-08T16:08:50.725684+0000","last_active":"2023-10-08T16:09:06.650219+0000","last_peered":"2023-10-08T16:09:06.650219+0000","last_clean":"2023-10-08T16:09:06.650219+0000","last_became_active":"2023-10-08T16:04:17.625580+0000","last_became_peered":"2023-10-08T16:04:17.625580+0000","last_unstale":"2023-10-08T16:09:06.650219+0000","last_undegraded":"2023-10-08T16:09:06.650219+0000","last_fullsized":"2023-10-08T16:09:06.650219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:46.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018077737,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"28'589","reported_seq":656,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.636598+0000","last_change":"2023-10-08T16:08:50.751069+0000","last_active":"2023-10-08T16:09:06.636598+0000","last_peered":"2023-10-08T16:09:06.636598+0000","last_clean":"2023-10-08T16:09:06.636598+0000","last_became_active":"2023-10-08T16:04:17.627197+0000","last_became_peered":"2023-10-08T16:04:17.627197+0000","last_unstale":"2023-10-08T16:09:06.636598+0000","last_undegraded":"2023-10-08T16:09:06.636598+0000","last_fullsized":"2023-10-08T16:09:06.636598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:09.387194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098294880000000008,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"28'596","reported_seq":664,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646672+0000","last_change":"2023-10-08T16:08:50.727158+0000","last_active":"2023-10-08T16:09:06.646672+0000","last_peered":"2023-10-08T16:09:06.646672+0000","last_clean":"2023-10-08T16:09:06.646672+0000","last_became_active":"2023-10-08T16:04:17.625586+0000","last_became_peered":"2023-10-08T16:04:17.625586+0000","last_unstale":"2023-10-08T16:09:06.646672+0000","last_undegraded":"2023-10-08T16:09:06.646672+0000","last_fullsized":"2023-10-08T16:09:06.646672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.599406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014288673999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"28'769","reported_seq":837,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646513+0000","last_change":"2023-10-08T16:08:50.717675+0000","last_active":"2023-10-08T16:09:06.646513+0000","last_peered":"2023-10-08T16:09:06.646513+0000","last_clean":"2023-10-08T16:09:06.646513+0000","last_became_active":"2023-10-08T16:04:17.623200+0000","last_became_peered":"2023-10-08T16:04:17.623200+0000","last_unstale":"2023-10-08T16:09:06.646513+0000","last_undegraded":"2023-10-08T16:09:06.646513+0000","last_fullsized":"2023-10-08T16:09:06.646513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:36.869466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012983668,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"28'725","reported_seq":794,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650301+0000","last_change":"2023-10-08T16:08:50.784761+0000","last_active":"2023-10-08T16:09:06.650301+0000","last_peered":"2023-10-08T16:09:06.650301+0000","last_clean":"2023-10-08T16:09:06.650301+0000","last_became_active":"2023-10-08T16:04:17.623945+0000","last_became_peered":"2023-10-08T16:04:17.623945+0000","last_unstale":"2023-10-08T16:09:06.650301+0000","last_undegraded":"2023-10-08T16:09:06.650301+0000","last_fullsized":"2023-10-08T16:09:06.650301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:15.965581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045353759,"stat_sum":{"num_bytes":4128,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"28'829","reported_seq":920,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650027+0000","last_change":"2023-10-08T16:08:50.723672+0000","last_active":"2023-10-08T16:09:06.650027+0000","last_peered":"2023-10-08T16:09:06.650027+0000","last_clean":"2023-10-08T16:09:06.650027+0000","last_became_active":"2023-10-08T16:04:17.623904+0000","last_became_peered":"2023-10-08T16:04:17.623904+0000","last_unstale":"2023-10-08T16:09:06.650027+0000","last_undegraded":"2023-10-08T16:09:06.650027+0000","last_fullsized":"2023-10-08T16:09:06.650027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:52.670934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019052278999999998,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":25,"num_read_kb":20,"num_write":31,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'549","reported_seq":616,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.638800+0000","last_change":"2023-10-08T16:08:50.714440+0000","last_active":"2023-10-08T16:09:06.638800+0000","last_peered":"2023-10-08T16:09:06.638800+0000","last_clean":"2023-10-08T16:09:06.638800+0000","last_became_active":"2023-10-08T16:04:17.618549+0000","last_became_peered":"2023-10-08T16:04:17.618549+0000","last_unstale":"2023-10-08T16:09:06.638800+0000","last_undegraded":"2023-10-08T16:09:06.638800+0000","last_fullsized":"2023-10-08T16:09:06.638800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011087115999999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'657","reported_seq":724,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649258+0000","last_change":"2023-10-08T16:08:50.724464+0000","last_active":"2023-10-08T16:09:06.649258+0000","last_peered":"2023-10-08T16:09:06.649258+0000","last_clean":"2023-10-08T16:09:06.649258+0000","last_became_active":"2023-10-08T16:04:17.627673+0000","last_became_peered":"2023-10-08T16:04:17.627673+0000","last_unstale":"2023-10-08T16:09:06.649258+0000","last_undegraded":"2023-10-08T16:09:06.649258+0000","last_fullsized":"2023-10-08T16:09:06.649258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:26.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019445790000000001,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"28'468","reported_seq":536,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.629597+0000","last_change":"2023-10-08T16:08:50.715828+0000","last_active":"2023-10-08T16:09:06.629597+0000","last_peered":"2023-10-08T16:09:06.629597+0000","last_clean":"2023-10-08T16:09:06.629597+0000","last_became_active":"2023-10-08T16:04:17.628793+0000","last_became_peered":"2023-10-08T16:04:17.628793+0000","last_unstale":"2023-10-08T16:09:06.629597+0000","last_undegraded":"2023-10-08T16:09:06.629597+0000","last_fullsized":"2023-10-08T16:09:06.629597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:15.965581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011350429,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"28'659","reported_seq":727,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649543+0000","last_change":"2023-10-08T16:08:50.720438+0000","last_active":"2023-10-08T16:09:06.649543+0000","last_peered":"2023-10-08T16:09:06.649543+0000","last_clean":"2023-10-08T16:09:06.649543+0000","last_became_active":"2023-10-08T16:04:17.625220+0000","last_became_peered":"2023-10-08T16:04:17.625220+0000","last_unstale":"2023-10-08T16:09:06.649543+0000","last_undegraded":"2023-10-08T16:09:06.649543+0000","last_fullsized":"2023-10-08T16:09:06.649543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:08.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013452108000000001,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'351","reported_seq":419,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.612968+0000","last_change":"2023-10-08T16:08:50.761809+0000","last_active":"2023-10-08T16:09:06.612968+0000","last_peered":"2023-10-08T16:09:06.612968+0000","last_clean":"2023-10-08T16:09:06.612968+0000","last_became_active":"2023-10-08T16:04:17.629574+0000","last_became_peered":"2023-10-08T16:04:17.629574+0000","last_unstale":"2023-10-08T16:09:06.612968+0000","last_undegraded":"2023-10-08T16:09:06.612968+0000","last_fullsized":"2023-10-08T16:09:06.612968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:26.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024743081,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"28'585","reported_seq":653,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.643506+0000","last_change":"2023-10-08T16:08:50.715713+0000","last_active":"2023-10-08T16:09:06.643506+0000","last_peered":"2023-10-08T16:09:06.643506+0000","last_clean":"2023-10-08T16:09:06.643506+0000","last_became_active":"2023-10-08T16:04:17.626420+0000","last_became_peered":"2023-10-08T16:04:17.626420+0000","last_unstale":"2023-10-08T16:09:06.643506+0000","last_undegraded":"2023-10-08T16:09:06.643506+0000","last_fullsized":"2023-10-08T16:09:06.643506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011442964999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'586","reported_seq":654,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.635599+0000","last_change":"2023-10-08T16:08:50.786032+0000","last_active":"2023-10-08T16:09:06.635599+0000","last_peered":"2023-10-08T16:09:06.635599+0000","last_clean":"2023-10-08T16:09:06.635599+0000","last_became_active":"2023-10-08T16:04:17.618207+0000","last_became_peered":"2023-10-08T16:04:17.618207+0000","last_unstale":"2023-10-08T16:09:06.635599+0000","last_undegraded":"2023-10-08T16:09:06.635599+0000","last_fullsized":"2023-10-08T16:09:06.635599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:16:31.009207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042752309000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"28'401","reported_seq":469,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.647800+0000","last_change":"2023-10-08T16:08:50.725249+0000","last_active":"2023-10-08T16:09:06.647800+0000","last_peered":"2023-10-08T16:09:06.647800+0000","last_clean":"2023-10-08T16:09:06.647800+0000","last_became_active":"2023-10-08T16:04:17.627093+0000","last_became_peered":"2023-10-08T16:04:17.627093+0000","last_unstale":"2023-10-08T16:09:06.647800+0000","last_undegraded":"2023-10-08T16:09:06.647800+0000","last_fullsized":"2023-10-08T16:09:06.647800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:45.664795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020438813,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"28'943","reported_seq":1010,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649964+0000","last_change":"2023-10-08T16:08:50.753000+0000","last_active":"2023-10-08T16:09:06.649964+0000","last_peered":"2023-10-08T16:09:06.649964+0000","last_clean":"2023-10-08T16:09:06.649964+0000","last_became_active":"2023-10-08T16:04:17.629049+0000","last_became_peered":"2023-10-08T16:04:17.629049+0000","last_unstale":"2023-10-08T16:09:06.649964+0000","last_undegraded":"2023-10-08T16:09:06.649964+0000","last_fullsized":"2023-10-08T16:09:06.649964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:07.785877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01455822,"stat_sum":{"num_bytes":8206,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"28'746","reported_seq":814,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.636917+0000","last_change":"2023-10-08T16:08:50.714786+0000","last_active":"2023-10-08T16:09:06.636917+0000","last_peered":"2023-10-08T16:09:06.636917+0000","last_clean":"2023-10-08T16:09:06.636917+0000","last_became_active":"2023-10-08T16:04:17.632012+0000","last_became_peered":"2023-10-08T16:04:17.632012+0000","last_unstale":"2023-10-08T16:09:06.636917+0000","last_undegraded":"2023-10-08T16:09:06.636917+0000","last_fullsized":"2023-10-08T16:09:06.636917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010590815999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"28'514","reported_seq":582,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.627809+0000","last_change":"2023-10-08T16:08:50.747895+0000","last_active":"2023-10-08T16:09:06.627809+0000","last_peered":"2023-10-08T16:09:06.627809+0000","last_clean":"2023-10-08T16:09:06.627809+0000","last_became_active":"2023-10-08T16:04:17.623220+0000","last_became_peered":"2023-10-08T16:04:17.623220+0000","last_unstale":"2023-10-08T16:09:06.627809+0000","last_undegraded":"2023-10-08T16:09:06.627809+0000","last_fullsized":"2023-10-08T16:09:06.627809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:07.785877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010375987999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'747","reported_seq":765,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.776172+0000","last_change":"2023-10-08T16:04:16.660492+0000","last_active":"2023-10-08T16:08:57.776172+0000","last_peered":"2023-10-08T16:08:57.776172+0000","last_clean":"2023-10-08T16:08:57.776172+0000","last_became_active":"2023-10-08T16:04:16.660183+0000","last_became_peered":"2023-10-08T16:04:16.660183+0000","last_unstale":"2023-10-08T16:08:57.776172+0000","last_undegraded":"2023-10-08T16:08:57.776172+0000","last_fullsized":"2023-10-08T16:08:57.776172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:08.532886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":743,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'638","reported_seq":706,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.644690+0000","last_change":"2023-10-08T16:08:50.786087+0000","last_active":"2023-10-08T16:09:06.644690+0000","last_peered":"2023-10-08T16:09:06.644690+0000","last_clean":"2023-10-08T16:09:06.644690+0000","last_became_active":"2023-10-08T16:04:17.620532+0000","last_became_peered":"2023-10-08T16:04:17.620532+0000","last_unstale":"2023-10-08T16:09:06.644690+0000","last_undegraded":"2023-10-08T16:09:06.644690+0000","last_fullsized":"2023-10-08T16:09:06.644690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:48:25.093009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042650311000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"28'756","reported_seq":774,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:58.144652+0000","last_change":"2023-10-08T16:04:16.654209+0000","last_active":"2023-10-08T16:08:58.144652+0000","last_peered":"2023-10-08T16:08:58.144652+0000","last_clean":"2023-10-08T16:08:58.144652+0000","last_became_active":"2023-10-08T16:04:16.653936+0000","last_became_peered":"2023-10-08T16:04:16.653936+0000","last_unstale":"2023-10-08T16:08:58.144652+0000","last_undegraded":"2023-10-08T16:08:58.144652+0000","last_fullsized":"2023-10-08T16:08:58.144652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:39:19.429906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"28'11","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.775670+0000","last_change":"2023-10-08T16:04:16.656953+0000","last_active":"2023-10-08T16:08:57.775670+0000","last_peered":"2023-10-08T16:08:57.775670+0000","last_clean":"2023-10-08T16:08:57.775670+0000","last_became_active":"2023-10-08T16:04:16.656642+0000","last_became_peered":"2023-10-08T16:04:16.656642+0000","last_unstale":"2023-10-08T16:08:57.775670+0000","last_undegraded":"2023-10-08T16:08:57.775670+0000","last_fullsized":"2023-10-08T16:08:57.775670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:04.157234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'647","reported_seq":713,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.628901+0000","last_change":"2023-10-08T16:08:50.765265+0000","last_active":"2023-10-08T16:09:06.628901+0000","last_peered":"2023-10-08T16:09:06.628901+0000","last_clean":"2023-10-08T16:09:06.628901+0000","last_became_active":"2023-10-08T16:04:59.029346+0000","last_became_peered":"2023-10-08T16:04:59.029346+0000","last_unstale":"2023-10-08T16:09:06.628901+0000","last_undegraded":"2023-10-08T16:09:06.628901+0000","last_fullsized":"2023-10-08T16:09:06.628901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:26.162193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024714613999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1526","reported_seq":1544,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.705019+0000","last_change":"2023-10-08T16:04:16.651645+0000","last_active":"2023-10-08T16:08:50.705019+0000","last_peered":"2023-10-08T16:08:50.705019+0000","last_clean":"2023-10-08T16:08:50.705019+0000","last_became_active":"2023-10-08T16:04:16.651258+0000","last_became_peered":"2023-10-08T16:04:16.651258+0000","last_unstale":"2023-10-08T16:08:50.705019+0000","last_undegraded":"2023-10-08T16:08:50.705019+0000","last_fullsized":"2023-10-08T16:08:50.705019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1526,"log_dups_size":0,"ondisk_log_size":1526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:48.596542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1522,"num_write_kb":8929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"28'757","reported_seq":825,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.626273+0000","last_change":"2023-10-08T16:08:50.761686+0000","last_active":"2023-10-08T16:09:06.626273+0000","last_peered":"2023-10-08T16:09:06.626273+0000","last_clean":"2023-10-08T16:09:06.626273+0000","last_became_active":"2023-10-08T16:04:17.629765+0000","last_became_peered":"2023-10-08T16:04:17.629765+0000","last_unstale":"2023-10-08T16:09:06.626273+0000","last_undegraded":"2023-10-08T16:09:06.626273+0000","last_fullsized":"2023-10-08T16:09:06.626273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026861545000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'13","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.709453+0000","last_change":"2023-10-08T16:04:16.655712+0000","last_active":"2023-10-08T16:08:57.709453+0000","last_peered":"2023-10-08T16:08:57.709453+0000","last_clean":"2023-10-08T16:08:57.709453+0000","last_became_active":"2023-10-08T16:04:16.654002+0000","last_became_peered":"2023-10-08T16:04:16.654002+0000","last_unstale":"2023-10-08T16:08:57.709453+0000","last_undegraded":"2023-10-08T16:08:57.709453+0000","last_fullsized":"2023-10-08T16:08:57.709453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"28'595","reported_seq":662,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649572+0000","last_change":"2023-10-08T16:08:50.724955+0000","last_active":"2023-10-08T16:09:06.649572+0000","last_peered":"2023-10-08T16:09:06.649572+0000","last_clean":"2023-10-08T16:09:06.649572+0000","last_became_active":"2023-10-08T16:04:17.624071+0000","last_became_peered":"2023-10-08T16:04:17.624071+0000","last_unstale":"2023-10-08T16:09:06.649572+0000","last_undegraded":"2023-10-08T16:09:06.649572+0000","last_fullsized":"2023-10-08T16:09:06.649572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:42.972904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018261580999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"26'15","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.706688+0000","last_change":"2023-10-08T16:04:16.657245+0000","last_active":"2023-10-08T16:08:50.706688+0000","last_peered":"2023-10-08T16:08:50.706688+0000","last_clean":"2023-10-08T16:08:50.706688+0000","last_became_active":"2023-10-08T16:04:16.656992+0000","last_became_peered":"2023-10-08T16:04:16.656992+0000","last_unstale":"2023-10-08T16:08:50.706688+0000","last_undegraded":"2023-10-08T16:08:50.706688+0000","last_fullsized":"2023-10-08T16:08:50.706688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"28'498","reported_seq":566,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.648430+0000","last_change":"2023-10-08T16:08:50.783744+0000","last_active":"2023-10-08T16:09:06.648430+0000","last_peered":"2023-10-08T16:09:06.648430+0000","last_clean":"2023-10-08T16:09:06.648430+0000","last_became_active":"2023-10-08T16:04:17.621862+0000","last_became_peered":"2023-10-08T16:04:17.621862+0000","last_unstale":"2023-10-08T16:09:06.648430+0000","last_undegraded":"2023-10-08T16:09:06.648430+0000","last_fullsized":"2023-10-08T16:09:06.648430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:36.869466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045929303999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"28'55","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.158974+0000","last_change":"2023-10-08T16:04:16.656378+0000","last_active":"2023-10-08T16:09:06.158974+0000","last_peered":"2023-10-08T16:09:06.158974+0000","last_clean":"2023-10-08T16:09:06.158974+0000","last_became_active":"2023-10-08T16:04:16.656041+0000","last_became_peered":"2023-10-08T16:04:16.656041+0000","last_unstale":"2023-10-08T16:09:06.158974+0000","last_undegraded":"2023-10-08T16:09:06.158974+0000","last_fullsized":"2023-10-08T16:09:06.158974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:08.375883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'579","reported_seq":647,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649871+0000","last_change":"2023-10-08T16:08:50.749536+0000","last_active":"2023-10-08T16:09:06.649871+0000","last_peered":"2023-10-08T16:09:06.649871+0000","last_clean":"2023-10-08T16:09:06.649871+0000","last_became_active":"2023-10-08T16:04:17.620654+0000","last_became_peered":"2023-10-08T16:04:17.620654+0000","last_unstale":"2023-10-08T16:09:06.649871+0000","last_undegraded":"2023-10-08T16:09:06.649871+0000","last_fullsized":"2023-10-08T16:09:06.649871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:09.387194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010626305000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"28'802","reported_seq":820,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.709296+0000","last_change":"2023-10-08T16:04:16.653310+0000","last_active":"2023-10-08T16:08:57.709296+0000","last_peered":"2023-10-08T16:08:57.709296+0000","last_clean":"2023-10-08T16:08:57.709296+0000","last_became_active":"2023-10-08T16:04:16.653001+0000","last_became_peered":"2023-10-08T16:04:16.653001+0000","last_unstale":"2023-10-08T16:08:57.709296+0000","last_undegraded":"2023-10-08T16:08:57.709296+0000","last_fullsized":"2023-10-08T16:08:57.709296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:48.596542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194948,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":797,"num_write_kb":4446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"28'522","reported_seq":590,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646727+0000","last_change":"2023-10-08T16:08:50.725788+0000","last_active":"2023-10-08T16:09:06.646727+0000","last_peered":"2023-10-08T16:09:06.646727+0000","last_clean":"2023-10-08T16:09:06.646727+0000","last_became_active":"2023-10-08T16:04:17.631130+0000","last_became_peered":"2023-10-08T16:04:17.631130+0000","last_unstale":"2023-10-08T16:09:06.646727+0000","last_undegraded":"2023-10-08T16:09:06.646727+0000","last_fullsized":"2023-10-08T16:09:06.646727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:35.211718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013318705,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"26'1512","reported_seq":1530,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.743557+0000","last_change":"2023-10-08T16:04:16.661085+0000","last_active":"2023-10-08T16:08:50.743557+0000","last_peered":"2023-10-08T16:08:50.743557+0000","last_clean":"2023-10-08T16:08:50.743557+0000","last_became_active":"2023-10-08T16:04:16.660830+0000","last_became_peered":"2023-10-08T16:04:16.660830+0000","last_unstale":"2023-10-08T16:08:50.743557+0000","last_undegraded":"2023-10-08T16:08:50.743557+0000","last_fullsized":"2023-10-08T16:08:50.743557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1512,"log_dups_size":0,"ondisk_log_size":1512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:18.465207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1505,"num_write_kb":8987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"28'652","reported_seq":720,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.645919+0000","last_change":"2023-10-08T16:08:50.780644+0000","last_active":"2023-10-08T16:09:06.645919+0000","last_peered":"2023-10-08T16:09:06.645919+0000","last_clean":"2023-10-08T16:09:06.645919+0000","last_became_active":"2023-10-08T16:04:17.623038+0000","last_became_peered":"2023-10-08T16:04:17.623038+0000","last_unstale":"2023-10-08T16:09:06.645919+0000","last_undegraded":"2023-10-08T16:09:06.645919+0000","last_fullsized":"2023-10-08T16:09:06.645919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045488809999999998,"stat_sum":{"num_bytes":4107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"26'14","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.705165+0000","last_change":"2023-10-08T16:04:16.650083+0000","last_active":"2023-10-08T16:08:50.705165+0000","last_peered":"2023-10-08T16:08:50.705165+0000","last_clean":"2023-10-08T16:08:50.705165+0000","last_became_active":"2023-10-08T16:04:16.649675+0000","last_became_peered":"2023-10-08T16:04:16.649675+0000","last_unstale":"2023-10-08T16:08:50.705165+0000","last_undegraded":"2023-10-08T16:08:50.705165+0000","last_fullsized":"2023-10-08T16:08:50.705165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:04.030037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'966","reported_seq":1034,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646421+0000","last_change":"2023-10-08T16:08:50.725608+0000","last_active":"2023-10-08T16:09:06.646421+0000","last_peered":"2023-10-08T16:09:06.646421+0000","last_clean":"2023-10-08T16:09:06.646421+0000","last_became_active":"2023-10-08T16:04:17.628865+0000","last_became_peered":"2023-10-08T16:04:17.628865+0000","last_unstale":"2023-10-08T16:09:06.646421+0000","last_undegraded":"2023-10-08T16:09:06.646421+0000","last_fullsized":"2023-10-08T16:09:06.646421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":966,"log_dups_size":0,"ondisk_log_size":966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:46.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013199152,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"27'12","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:52.141852+0000","last_change":"2023-10-08T16:04:16.655486+0000","last_active":"2023-10-08T16:08:52.141852+0000","last_peered":"2023-10-08T16:08:52.141852+0000","last_clean":"2023-10-08T16:08:52.141852+0000","last_became_active":"2023-10-08T16:04:16.653342+0000","last_became_peered":"2023-10-08T16:04:16.653342+0000","last_unstale":"2023-10-08T16:08:52.141852+0000","last_undegraded":"2023-10-08T16:08:52.141852+0000","last_fullsized":"2023-10-08T16:08:52.141852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:04.157234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"28'290","reported_seq":358,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.636856+0000","last_change":"2023-10-08T16:08:50.717095+0000","last_active":"2023-10-08T16:09:06.636856+0000","last_peered":"2023-10-08T16:09:06.636856+0000","last_clean":"2023-10-08T16:09:06.636856+0000","last_became_active":"2023-10-08T16:04:17.624454+0000","last_became_peered":"2023-10-08T16:04:17.624454+0000","last_unstale":"2023-10-08T16:09:06.636856+0000","last_undegraded":"2023-10-08T16:09:06.636856+0000","last_fullsized":"2023-10-08T16:09:06.636856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012620849,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"26'22","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.737986+0000","last_change":"2023-10-08T16:04:16.659433+0000","last_active":"2023-10-08T16:08:50.737986+0000","last_peered":"2023-10-08T16:08:50.737986+0000","last_clean":"2023-10-08T16:08:50.737986+0000","last_became_active":"2023-10-08T16:04:16.658886+0000","last_became_peered":"2023-10-08T16:04:16.658886+0000","last_unstale":"2023-10-08T16:08:50.737986+0000","last_undegraded":"2023-10-08T16:08:50.737986+0000","last_fullsized":"2023-10-08T16:08:50.737986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:08.532886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"28'592","reported_seq":660,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.645466+0000","last_change":"2023-10-08T16:08:50.724877+0000","last_active":"2023-10-08T16:09:06.645466+0000","last_peered":"2023-10-08T16:09:06.645466+0000","last_clean":"2023-10-08T16:09:06.645466+0000","last_became_active":"2023-10-08T16:04:17.628605+0000","last_became_peered":"2023-10-08T16:04:17.628605+0000","last_unstale":"2023-10-08T16:09:06.645466+0000","last_undegraded":"2023-10-08T16:09:06.645466+0000","last_fullsized":"2023-10-08T16:09:06.645466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:02:45.593266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013094041000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'18","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.699963+0000","last_change":"2023-10-08T16:04:16.660881+0000","last_active":"2023-10-08T16:08:57.699963+0000","last_peered":"2023-10-08T16:08:57.699963+0000","last_clean":"2023-10-08T16:08:57.699963+0000","last_became_active":"2023-10-08T16:04:16.660651+0000","last_became_peered":"2023-10-08T16:04:16.660651+0000","last_unstale":"2023-10-08T16:08:57.699963+0000","last_undegraded":"2023-10-08T16:08:57.699963+0000","last_fullsized":"2023-10-08T16:08:57.699963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:54.682083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"28'296","reported_seq":364,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.633524+0000","last_change":"2023-10-08T16:08:50.725143+0000","last_active":"2023-10-08T16:09:06.633524+0000","last_peered":"2023-10-08T16:09:06.633524+0000","last_clean":"2023-10-08T16:09:06.633524+0000","last_became_active":"2023-10-08T16:04:17.628701+0000","last_became_peered":"2023-10-08T16:04:17.628701+0000","last_unstale":"2023-10-08T16:09:06.633524+0000","last_undegraded":"2023-10-08T16:09:06.633524+0000","last_fullsized":"2023-10-08T16:09:06.633524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:45.664795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012739413999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'276","reported_seq":294,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:53.142796+0000","last_change":"2023-10-08T16:04:16.652447+0000","last_active":"2023-10-08T16:08:53.142796+0000","last_peered":"2023-10-08T16:08:53.142796+0000","last_clean":"2023-10-08T16:08:53.142796+0000","last_became_active":"2023-10-08T16:04:16.651709+0000","last_became_peered":"2023-10-08T16:04:16.651709+0000","last_unstale":"2023-10-08T16:08:53.142796+0000","last_undegraded":"2023-10-08T16:08:53.142796+0000","last_fullsized":"2023-10-08T16:08:53.142796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:04.157234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"28'660","reported_seq":727,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646340+0000","last_change":"2023-10-08T16:08:50.727298+0000","last_active":"2023-10-08T16:09:06.646340+0000","last_peered":"2023-10-08T16:09:06.646340+0000","last_clean":"2023-10-08T16:09:06.646340+0000","last_became_active":"2023-10-08T16:04:17.630908+0000","last_became_peered":"2023-10-08T16:04:17.630908+0000","last_unstale":"2023-10-08T16:09:06.646340+0000","last_undegraded":"2023-10-08T16:09:06.646340+0000","last_fullsized":"2023-10-08T16:09:06.646340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:48.519448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014318363000000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"28'764","reported_seq":782,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.773013+0000","last_change":"2023-10-08T16:04:16.655771+0000","last_active":"2023-10-08T16:08:57.773013+0000","last_peered":"2023-10-08T16:08:57.773013+0000","last_clean":"2023-10-08T16:08:57.773013+0000","last_became_active":"2023-10-08T16:04:16.655245+0000","last_became_peered":"2023-10-08T16:04:16.655245+0000","last_unstale":"2023-10-08T16:08:57.773013+0000","last_undegraded":"2023-10-08T16:08:57.773013+0000","last_fullsized":"2023-10-08T16:08:57.773013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:48.596542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":759,"num_write_kb":4511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"28'465","reported_seq":533,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.647811+0000","last_change":"2023-10-08T16:08:50.726922+0000","last_active":"2023-10-08T16:09:06.647811+0000","last_peered":"2023-10-08T16:09:06.647811+0000","last_clean":"2023-10-08T16:09:06.647811+0000","last_became_active":"2023-10-08T16:04:17.627369+0000","last_became_peered":"2023-10-08T16:04:17.627369+0000","last_unstale":"2023-10-08T16:09:06.647811+0000","last_undegraded":"2023-10-08T16:09:06.647811+0000","last_fullsized":"2023-10-08T16:09:06.647811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020078136999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"28'12","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.770743+0000","last_change":"2023-10-08T16:04:16.654597+0000","last_active":"2023-10-08T16:08:57.770743+0000","last_peered":"2023-10-08T16:08:57.770743+0000","last_clean":"2023-10-08T16:08:57.770743+0000","last_became_active":"2023-10-08T16:04:16.654124+0000","last_became_peered":"2023-10-08T16:04:16.654124+0000","last_unstale":"2023-10-08T16:08:57.770743+0000","last_undegraded":"2023-10-08T16:08:57.770743+0000","last_fullsized":"2023-10-08T16:08:57.770743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'569","reported_seq":635,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649431+0000","last_change":"2023-10-08T16:08:50.749000+0000","last_active":"2023-10-08T16:09:06.649431+0000","last_peered":"2023-10-08T16:09:06.649431+0000","last_clean":"2023-10-08T16:09:06.649431+0000","last_became_active":"2023-10-08T16:04:58.693477+0000","last_became_peered":"2023-10-08T16:04:58.693477+0000","last_unstale":"2023-10-08T16:09:06.649431+0000","last_undegraded":"2023-10-08T16:09:06.649431+0000","last_fullsized":"2023-10-08T16:09:06.649431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:43:34.693379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0094988650000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.711580+0000","last_change":"2023-10-08T16:04:06.370834+0000","last_active":"2023-10-08T16:08:50.711580+0000","last_peered":"2023-10-08T16:08:50.711580+0000","last_clean":"2023-10-08T16:08:50.711580+0000","last_became_active":"2023-10-08T16:04:06.368022+0000","last_became_peered":"2023-10-08T16:04:06.368022+0000","last_unstale":"2023-10-08T16:08:50.711580+0000","last_undegraded":"2023-10-08T16:08:50.711580+0000","last_fullsized":"2023-10-08T16:08:50.711580+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:05.034115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:05.034115+0000","last_clean_scrub_stamp":"2023-10-08T16:04:05.034115+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:37.338076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"28'13","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.697048+0000","last_change":"2023-10-08T16:04:16.646681+0000","last_active":"2023-10-08T16:08:57.697048+0000","last_peered":"2023-10-08T16:08:57.697048+0000","last_clean":"2023-10-08T16:08:57.697048+0000","last_became_active":"2023-10-08T16:04:16.646086+0000","last_became_peered":"2023-10-08T16:04:16.646086+0000","last_unstale":"2023-10-08T16:08:57.697048+0000","last_undegraded":"2023-10-08T16:08:57.697048+0000","last_fullsized":"2023-10-08T16:08:57.697048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:24.778540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'510","reported_seq":578,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649793+0000","last_change":"2023-10-08T16:08:50.714760+0000","last_active":"2023-10-08T16:09:06.649793+0000","last_peered":"2023-10-08T16:09:06.649793+0000","last_clean":"2023-10-08T16:09:06.649793+0000","last_became_active":"2023-10-08T16:04:17.629127+0000","last_became_peered":"2023-10-08T16:04:17.629127+0000","last_unstale":"2023-10-08T16:09:06.649793+0000","last_undegraded":"2023-10-08T16:09:06.649793+0000","last_fullsized":"2023-10-08T16:09:06.649793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:33.720945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011169416999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"27'1504","reported_seq":1522,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:52.141724+0000","last_change":"2023-10-08T16:04:16.661382+0000","last_active":"2023-10-08T16:08:52.141724+0000","last_peered":"2023-10-08T16:08:52.141724+0000","last_clean":"2023-10-08T16:08:52.141724+0000","last_became_active":"2023-10-08T16:04:16.661186+0000","last_became_peered":"2023-10-08T16:04:16.661186+0000","last_unstale":"2023-10-08T16:08:52.141724+0000","last_undegraded":"2023-10-08T16:08:52.141724+0000","last_fullsized":"2023-10-08T16:08:52.141724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1504,"log_dups_size":0,"ondisk_log_size":1504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:06.774566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1499,"num_write_kb":8970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"28'493","reported_seq":561,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.644348+0000","last_change":"2023-10-08T16:08:50.779348+0000","last_active":"2023-10-08T16:09:06.644348+0000","last_peered":"2023-10-08T16:09:06.644348+0000","last_clean":"2023-10-08T16:09:06.644348+0000","last_became_active":"2023-10-08T16:04:17.615671+0000","last_became_peered":"2023-10-08T16:04:17.615671+0000","last_unstale":"2023-10-08T16:09:06.644348+0000","last_undegraded":"2023-10-08T16:09:06.644348+0000","last_fullsized":"2023-10-08T16:09:06.644348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:05.041349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.043805617999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"28'75","reported_seq":155,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:07.150577+0000","last_change":"2023-10-08T16:04:16.654721+0000","last_active":"2023-10-08T16:09:07.150577+0000","last_peered":"2023-10-08T16:09:07.150577+0000","last_clean":"2023-10-08T16:09:07.150577+0000","last_became_active":"2023-10-08T16:04:16.654359+0000","last_became_peered":"2023-10-08T16:04:16.654359+0000","last_unstale":"2023-10-08T16:09:07.150577+0000","last_undegraded":"2023-10-08T16:09:07.150577+0000","last_fullsized":"2023-10-08T16:09:07.150577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:04.030037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":279988,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":321,"num_write":71,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'386","reported_seq":453,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.621683+0000","last_change":"2023-10-08T16:08:50.765489+0000","last_active":"2023-10-08T16:09:06.621683+0000","last_peered":"2023-10-08T16:09:06.621683+0000","last_clean":"2023-10-08T16:09:06.621683+0000","last_became_active":"2023-10-08T16:04:17.624876+0000","last_became_peered":"2023-10-08T16:04:17.624876+0000","last_unstale":"2023-10-08T16:09:06.621683+0000","last_undegraded":"2023-10-08T16:09:06.621683+0000","last_fullsized":"2023-10-08T16:09:06.621683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:15.965581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024289327999999999,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"27'1399","reported_seq":1417,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:52.140934+0000","last_change":"2023-10-08T16:04:16.654812+0000","last_active":"2023-10-08T16:08:52.140934+0000","last_peered":"2023-10-08T16:08:52.140934+0000","last_clean":"2023-10-08T16:08:52.140934+0000","last_became_active":"2023-10-08T16:04:16.654454+0000","last_became_peered":"2023-10-08T16:04:16.654454+0000","last_unstale":"2023-10-08T16:08:52.140934+0000","last_undegraded":"2023-10-08T16:08:52.140934+0000","last_fullsized":"2023-10-08T16:08:52.140934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1399,"log_dups_size":0,"ondisk_log_size":1399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1390,"num_write_kb":8905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"28'618","reported_seq":686,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.642629+0000","last_change":"2023-10-08T16:08:50.750159+0000","last_active":"2023-10-08T16:09:06.642629+0000","last_peered":"2023-10-08T16:09:06.642629+0000","last_clean":"2023-10-08T16:09:06.642629+0000","last_became_active":"2023-10-08T16:04:17.619294+0000","last_became_peered":"2023-10-08T16:04:17.619294+0000","last_unstale":"2023-10-08T16:09:06.642629+0000","last_undegraded":"2023-10-08T16:09:06.642629+0000","last_fullsized":"2023-10-08T16:09:06.642629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:25.789851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011233748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"27'7","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.141419+0000","last_change":"2023-10-08T16:04:16.662004+0000","last_active":"2023-10-08T16:08:55.141419+0000","last_peered":"2023-10-08T16:08:55.141419+0000","last_clean":"2023-10-08T16:08:55.141419+0000","last_became_active":"2023-10-08T16:04:16.661756+0000","last_became_peered":"2023-10-08T16:04:16.661756+0000","last_unstale":"2023-10-08T16:08:55.141419+0000","last_undegraded":"2023-10-08T16:08:55.141419+0000","last_fullsized":"2023-10-08T16:08:55.141419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:06.774566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"28'513","reported_seq":581,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.648937+0000","last_change":"2023-10-08T16:08:50.726661+0000","last_active":"2023-10-08T16:09:06.648937+0000","last_peered":"2023-10-08T16:09:06.648937+0000","last_clean":"2023-10-08T16:09:06.648937+0000","last_became_active":"2023-10-08T16:04:17.616348+0000","last_became_peered":"2023-10-08T16:04:17.616348+0000","last_unstale":"2023-10-08T16:09:06.648937+0000","last_undegraded":"2023-10-08T16:09:06.648937+0000","last_fullsized":"2023-10-08T16:09:06.648937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:08.121055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016977602000000001,"stat_sum":{"num_bytes":4107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"26'21","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.712617+0000","last_change":"2023-10-08T16:04:16.662731+0000","last_active":"2023-10-08T16:08:50.712617+0000","last_peered":"2023-10-08T16:08:50.712617+0000","last_clean":"2023-10-08T16:08:50.712617+0000","last_became_active":"2023-10-08T16:04:16.662446+0000","last_became_peered":"2023-10-08T16:04:16.662446+0000","last_unstale":"2023-10-08T16:08:50.712617+0000","last_undegraded":"2023-10-08T16:08:50.712617+0000","last_fullsized":"2023-10-08T16:08:50.712617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:59.297962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'604","reported_seq":672,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.613363+0000","last_change":"2023-10-08T16:08:50.759947+0000","last_active":"2023-10-08T16:09:06.613363+0000","last_peered":"2023-10-08T16:09:06.613363+0000","last_clean":"2023-10-08T16:09:06.613363+0000","last_became_active":"2023-10-08T16:04:17.624319+0000","last_became_peered":"2023-10-08T16:04:17.624319+0000","last_unstale":"2023-10-08T16:09:06.613363+0000","last_undegraded":"2023-10-08T16:09:06.613363+0000","last_fullsized":"2023-10-08T16:09:06.613363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024480915999999998,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"28'47","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:07.155741+0000","last_change":"2023-10-08T16:04:16.661076+0000","last_active":"2023-10-08T16:09:07.155741+0000","last_peered":"2023-10-08T16:09:07.155741+0000","last_clean":"2023-10-08T16:09:07.155741+0000","last_became_active":"2023-10-08T16:04:16.660704+0000","last_became_peered":"2023-10-08T16:04:16.660704+0000","last_unstale":"2023-10-08T16:09:07.155741+0000","last_undegraded":"2023-10-08T16:09:07.155741+0000","last_fullsized":"2023-10-08T16:09:07.155741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"28'626","reported_seq":694,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646062+0000","last_change":"2023-10-08T16:08:50.715485+0000","last_active":"2023-10-08T16:09:06.646062+0000","last_peered":"2023-10-08T16:09:06.646062+0000","last_clean":"2023-10-08T16:09:06.646062+0000","last_became_active":"2023-10-08T16:04:17.631615+0000","last_became_peered":"2023-10-08T16:04:17.631615+0000","last_unstale":"2023-10-08T16:09:06.646062+0000","last_undegraded":"2023-10-08T16:09:06.646062+0000","last_fullsized":"2023-10-08T16:09:06.646062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.599406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011336120999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"27'12","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:53.144513+0000","last_change":"2023-10-08T16:04:16.659489+0000","last_active":"2023-10-08T16:08:53.144513+0000","last_peered":"2023-10-08T16:08:53.144513+0000","last_clean":"2023-10-08T16:08:53.144513+0000","last_became_active":"2023-10-08T16:04:16.659148+0000","last_became_peered":"2023-10-08T16:04:16.659148+0000","last_unstale":"2023-10-08T16:08:53.144513+0000","last_undegraded":"2023-10-08T16:08:53.144513+0000","last_fullsized":"2023-10-08T16:08:53.144513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'436","reported_seq":505,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.624840+0000","last_change":"2023-10-08T16:08:50.780938+0000","last_active":"2023-10-08T16:09:06.624840+0000","last_peered":"2023-10-08T16:09:06.624840+0000","last_clean":"2023-10-08T16:09:06.624840+0000","last_became_active":"2023-10-08T16:04:17.624385+0000","last_became_peered":"2023-10-08T16:04:17.624385+0000","last_unstale":"2023-10-08T16:09:06.624840+0000","last_undegraded":"2023-10-08T16:09:06.624840+0000","last_fullsized":"2023-10-08T16:09:06.624840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.044071592,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"26'758","reported_seq":776,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.711386+0000","last_change":"2023-10-08T16:04:16.662618+0000","last_active":"2023-10-08T16:08:50.711386+0000","last_peered":"2023-10-08T16:08:50.711386+0000","last_clean":"2023-10-08T16:08:50.711386+0000","last_became_active":"2023-10-08T16:04:16.662327+0000","last_became_peered":"2023-10-08T16:04:16.662327+0000","last_unstale":"2023-10-08T16:08:50.711386+0000","last_undegraded":"2023-10-08T16:08:50.711386+0000","last_fullsized":"2023-10-08T16:08:50.711386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:06:41.062441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":753,"num_write_kb":4504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'450","reported_seq":518,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.642591+0000","last_change":"2023-10-08T16:08:50.749200+0000","last_active":"2023-10-08T16:09:06.642591+0000","last_peered":"2023-10-08T16:09:06.642591+0000","last_clean":"2023-10-08T16:09:06.642591+0000","last_became_active":"2023-10-08T16:04:17.622898+0000","last_became_peered":"2023-10-08T16:04:17.622898+0000","last_unstale":"2023-10-08T16:09:06.642591+0000","last_undegraded":"2023-10-08T16:09:06.642591+0000","last_fullsized":"2023-10-08T16:09:06.642591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:47.130200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075401410000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'10","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.773333+0000","last_change":"2023-10-08T16:04:16.661483+0000","last_active":"2023-10-08T16:08:57.773333+0000","last_peered":"2023-10-08T16:08:57.773333+0000","last_clean":"2023-10-08T16:08:57.773333+0000","last_became_active":"2023-10-08T16:04:16.661055+0000","last_became_peered":"2023-10-08T16:04:16.661055+0000","last_unstale":"2023-10-08T16:08:57.773333+0000","last_undegraded":"2023-10-08T16:08:57.773333+0000","last_fullsized":"2023-10-08T16:08:57.773333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"28'501","reported_seq":569,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.626089+0000","last_change":"2023-10-08T16:08:50.713213+0000","last_active":"2023-10-08T16:09:06.626089+0000","last_peered":"2023-10-08T16:09:06.626089+0000","last_clean":"2023-10-08T16:09:06.626089+0000","last_became_active":"2023-10-08T16:04:17.626991+0000","last_became_peered":"2023-10-08T16:04:17.626991+0000","last_unstale":"2023-10-08T16:09:06.626089+0000","last_undegraded":"2023-10-08T16:09:06.626089+0000","last_fullsized":"2023-10-08T16:09:06.626089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:56.205550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010148346000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'11","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:52.136834+0000","last_change":"2023-10-08T16:04:16.657613+0000","last_active":"2023-10-08T16:08:52.136834+0000","last_peered":"2023-10-08T16:08:52.136834+0000","last_clean":"2023-10-08T16:08:52.136834+0000","last_became_active":"2023-10-08T16:04:16.657299+0000","last_became_peered":"2023-10-08T16:04:16.657299+0000","last_unstale":"2023-10-08T16:08:52.136834+0000","last_undegraded":"2023-10-08T16:08:52.136834+0000","last_fullsized":"2023-10-08T16:08:52.136834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:24.778540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"28'597","reported_seq":663,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.632951+0000","last_change":"2023-10-08T16:08:50.715044+0000","last_active":"2023-10-08T16:09:06.632951+0000","last_peered":"2023-10-08T16:09:06.632951+0000","last_clean":"2023-10-08T16:09:06.632951+0000","last_became_active":"2023-10-08T16:04:17.620693+0000","last_became_peered":"2023-10-08T16:04:17.620693+0000","last_unstale":"2023-10-08T16:09:06.632951+0000","last_undegraded":"2023-10-08T16:09:06.632951+0000","last_fullsized":"2023-10-08T16:09:06.632951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011078684,"stat_sum":{"num_bytes":4121,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'97","reported_seq":115,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.712638+0000","last_change":"2023-10-08T16:04:16.663488+0000","last_active":"2023-10-08T16:08:50.712638+0000","last_peered":"2023-10-08T16:08:50.712638+0000","last_clean":"2023-10-08T16:08:50.712638+0000","last_became_active":"2023-10-08T16:04:16.663184+0000","last_became_peered":"2023-10-08T16:04:16.663184+0000","last_unstale":"2023-10-08T16:08:50.712638+0000","last_undegraded":"2023-10-08T16:08:50.712638+0000","last_fullsized":"2023-10-08T16:08:50.712638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:26.863386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":4152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"28'778","reported_seq":846,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.637315+0000","last_change":"2023-10-08T16:08:50.716768+0000","last_active":"2023-10-08T16:09:06.637315+0000","last_peered":"2023-10-08T16:09:06.637315+0000","last_clean":"2023-10-08T16:09:06.637315+0000","last_became_active":"2023-10-08T16:04:17.622898+0000","last_became_peered":"2023-10-08T16:04:17.622898+0000","last_unstale":"2023-10-08T16:09:06.637315+0000","last_undegraded":"2023-10-08T16:09:06.637315+0000","last_fullsized":"2023-10-08T16:09:06.637315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:33.720945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012379262,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"28'812","reported_seq":879,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.648671+0000","last_change":"2023-10-08T16:08:50.726432+0000","last_active":"2023-10-08T16:09:06.648671+0000","last_peered":"2023-10-08T16:09:06.648671+0000","last_clean":"2023-10-08T16:09:06.648671+0000","last_became_active":"2023-10-08T16:04:17.617179+0000","last_became_peered":"2023-10-08T16:04:17.617179+0000","last_unstale":"2023-10-08T16:09:06.648671+0000","last_undegraded":"2023-10-08T16:09:06.648671+0000","last_fullsized":"2023-10-08T16:09:06.648671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:56.205550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016893819000000001,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"27'2503","reported_seq":2521,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:52.142091+0000","last_change":"2023-10-08T16:04:16.661467+0000","last_active":"2023-10-08T16:08:52.142091+0000","last_peered":"2023-10-08T16:08:52.142091+0000","last_clean":"2023-10-08T16:08:52.142091+0000","last_became_active":"2023-10-08T16:04:16.661215+0000","last_became_peered":"2023-10-08T16:04:16.661215+0000","last_unstale":"2023-10-08T16:08:52.142091+0000","last_undegraded":"2023-10-08T16:08:52.142091+0000","last_fullsized":"2023-10-08T16:08:52.142091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":2503,"log_dups_size":0,"ondisk_log_size":2503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2502,"num_write_kb":5839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'612","reported_seq":679,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.647511+0000","last_change":"2023-10-08T16:08:50.727342+0000","last_active":"2023-10-08T16:09:06.647511+0000","last_peered":"2023-10-08T16:09:06.647511+0000","last_clean":"2023-10-08T16:09:06.647511+0000","last_became_active":"2023-10-08T16:04:17.617216+0000","last_became_peered":"2023-10-08T16:04:17.617216+0000","last_unstale":"2023-10-08T16:09:06.647511+0000","last_undegraded":"2023-10-08T16:09:06.647511+0000","last_fullsized":"2023-10-08T16:09:06.647511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:07.051965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020241687000000001,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1662","reported_seq":1680,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.915060+0000","last_change":"2023-10-08T16:04:16.661825+0000","last_active":"2023-10-08T16:09:06.915060+0000","last_peered":"2023-10-08T16:09:06.915060+0000","last_clean":"2023-10-08T16:09:06.915060+0000","last_became_active":"2023-10-08T16:04:16.661224+0000","last_became_peered":"2023-10-08T16:04:16.661224+0000","last_unstale":"2023-10-08T16:09:06.915060+0000","last_undegraded":"2023-10-08T16:09:06.915060+0000","last_fullsized":"2023-10-08T16:09:06.915060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1662,"log_dups_size":0,"ondisk_log_size":1662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:08.375883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9345162,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1650,"num_write_kb":9972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"28'531","reported_seq":599,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.648573+0000","last_change":"2023-10-08T16:08:50.784243+0000","last_active":"2023-10-08T16:09:06.648573+0000","last_peered":"2023-10-08T16:09:06.648573+0000","last_clean":"2023-10-08T16:09:06.648573+0000","last_became_active":"2023-10-08T16:04:17.621550+0000","last_became_peered":"2023-10-08T16:04:17.621550+0000","last_unstale":"2023-10-08T16:09:06.648573+0000","last_undegraded":"2023-10-08T16:09:06.648573+0000","last_fullsized":"2023-10-08T16:09:06.648573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:33.720945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.046468506999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"26'764","reported_seq":782,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.704289+0000","last_change":"2023-10-08T16:04:16.662223+0000","last_active":"2023-10-08T16:08:50.704289+0000","last_peered":"2023-10-08T16:08:50.704289+0000","last_clean":"2023-10-08T16:08:50.704289+0000","last_became_active":"2023-10-08T16:04:16.661907+0000","last_became_peered":"2023-10-08T16:04:16.661907+0000","last_unstale":"2023-10-08T16:08:50.704289+0000","last_undegraded":"2023-10-08T16:08:50.704289+0000","last_fullsized":"2023-10-08T16:08:50.704289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:04.030037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":4591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"28'524","reported_seq":592,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.637537+0000","last_change":"2023-10-08T16:08:50.715393+0000","last_active":"2023-10-08T16:09:06.637537+0000","last_peered":"2023-10-08T16:09:06.637537+0000","last_clean":"2023-10-08T16:09:06.637537+0000","last_became_active":"2023-10-08T16:04:17.627562+0000","last_became_peered":"2023-10-08T16:04:17.627562+0000","last_unstale":"2023-10-08T16:09:06.637537+0000","last_undegraded":"2023-10-08T16:09:06.637537+0000","last_fullsized":"2023-10-08T16:09:06.637537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:08.121055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011393438000000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"27'2621","reported_seq":2639,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:51.147036+0000","last_change":"2023-10-08T16:04:16.663088+0000","last_active":"2023-10-08T16:08:51.147036+0000","last_peered":"2023-10-08T16:08:51.147036+0000","last_clean":"2023-10-08T16:08:51.147036+0000","last_became_active":"2023-10-08T16:04:16.662714+0000","last_became_peered":"2023-10-08T16:04:16.662714+0000","last_unstale":"2023-10-08T16:08:51.147036+0000","last_undegraded":"2023-10-08T16:08:51.147036+0000","last_fullsized":"2023-10-08T16:08:51.147036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":2621,"log_dups_size":0,"ondisk_log_size":2621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:54.682083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2619,"num_write_kb":5944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":82,"num_object_clones":21,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":8,"num_read":31,"num_read_kb":21,"num_write":110,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37743,"ondisk_log_size":37743,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":85124036,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":62,"num_read_kb":321,"num_write":17972,"num_write_kb":93766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":170311680,"data_stored":170248072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18059,"ondisk_log_size":18059,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574912,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":348308,"kb_used_data":38732,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94023532,"statfs":{"total":96636764160,"available":96280096768,"internally_reserved":0,"allocated":39661568,"data_stored":39449571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.83199999999999996,"15min":0.86199999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.2070000000000001,"5min":1.976,"15min":1.976},"last":1.1890000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82699999999999996,"15min":0.85999999999999999},"min":{"1min":0.379,"5min":0.314,"15min":0.314},"max":{"1min":1.2150000000000001,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.877}]},{"osd":1,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.85799999999999998,"15min":0.86799999999999999},"min":{"1min":0.45600000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.837,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.88900000000000001,"15min":0.90900000000000003},"min":{"1min":0.55000000000000004,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.24,"5min":1.54,"15min":1.54},"last":1.24}]},{"osd":2,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.90300000000000002,"15min":0.90500000000000003},"min":{"1min":0.60899999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.26,"5min":1.478,"15min":1.478},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.89000000000000001,"15min":0.92200000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.415,"5min":1.948,"15min":1.948},"last":1.1639999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96599999999999997,"15min":0.97899999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.008,"5min":1.014,"15min":1.048},"min":{"1min":0.70599999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3360000000000001,"5min":1.552,"15min":1.552},"last":0.98499999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.97899999999999998,"15min":1},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.5600000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.0609999999999999,"15min":1.083},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.083}]},{"osd":5,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.0249999999999999,"15min":1.0569999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6479999999999999,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0920000000000001,"15min":1.1220000000000001},"min":{"1min":0.52600000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.4990000000000001,"5min":1.726,"15min":1.726},"last":1.272}]},{"osd":6,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.161,"15min":1.212},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.6240000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.222},{"interface":"front","average":{"1min":1.149,"5min":1.1739999999999999,"15min":1.1970000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.296}]}]},{"osd":6,"up_from":13,"seq":55834574913,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319052,"kb_used_data":17668,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94052788,"statfs":{"total":96636764160,"available":96310054912,"internally_reserved":0,"allocated":18092032,"data_stored":17887733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.77100000000000002,"15min":0.76700000000000002},"min":{"1min":0.45400000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":3.8290000000000002,"5min":3.8290000000000002,"15min":3.8290000000000002},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.999,"5min":0.83399999999999996,"15min":0.748},"min":{"1min":0.48999999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":3.8519999999999999,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":1.179}]},{"osd":1,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.91000000000000003,"15min":0.91200000000000003},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3740000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.02}]},{"osd":2,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86799999999999999,"15min":0.84999999999999998},"min":{"1min":0.60299999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1830000000000001,"5min":1.25,"15min":1.25},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.90600000000000003,"15min":0.91500000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.24,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.1080000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.92200000000000004,"15min":0.85999999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.4199999999999999,"5min":2.173,"15min":2.173},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.998,"15min":0.96199999999999997},"min":{"1min":0.58099999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2350000000000001,"5min":1.381,"15min":1.381},"last":0.97199999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.96999999999999997,"15min":0.998},"min":{"1min":0.55600000000000005,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.373,"5min":1.413,"15min":1.413},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.01,"5min":1.0489999999999999,"15min":1.022},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.383,"5min":2.25,"15min":2.25},"last":1.0640000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0820000000000001,"15min":1.04},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.319,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":1.141},{"interface":"front","average":{"1min":1.319,"5min":1.3080000000000001,"15min":1.2030000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":6.0439999999999996,"5min":17.428999999999998,"15min":17.428999999999998},"last":1.2390000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.1579999999999999,"15min":1.1020000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":6.0229999999999997,"5min":6.0229999999999997,"15min":6.0229999999999997},"last":1.296},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.224,"15min":1.202},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":3.706,"5min":3.706,"15min":3.706},"last":1.3180000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":330424,"kb_used_data":20848,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94041416,"statfs":{"total":96636764160,"available":96298409984,"internally_reserved":0,"allocated":21348352,"data_stored":21141337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.80000000000000004,"15min":0.876},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.024,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.81100000000000005,"15min":0.81899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":4.2839999999999998,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.79500000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":0.86699999999999999,"15min":0.83999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":4.399,"5min":4.399,"15min":4.399},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.89200000000000002,"15min":0.89500000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":4.5149999999999997,"5min":4.5149999999999997,"15min":4.5149999999999997},"last":1.111}]},{"osd":2,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.85499999999999998,"15min":0.89400000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.089,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.90200000000000002,"15min":0.89800000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.0700000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":0.98999999999999999,"15min":1.0009999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":4.7140000000000004,"5min":4.7140000000000004,"15min":4.7140000000000004},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.044,"15min":1.0600000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":4.6920000000000002,"5min":4.6920000000000002,"15min":4.6920000000000002},"last":1.1499999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":1.014,"15min":1.0449999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.5800000000000001,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.996},{"interface":"front","average":{"1min":0.89800000000000002,"5min":1.012,"15min":1.095},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.224,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.0289999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0489999999999999,"15min":1.079},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.198},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.1180000000000001,"15min":1.208},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2390000000000001,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.1839999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.101,"15min":1.2},"min":{"1min":0.61799999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.228,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.228},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.169,"15min":1.1890000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.387}]}]},{"osd":4,"up_from":13,"seq":55834574913,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":334488,"kb_used_data":29008,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94037352,"statfs":{"total":96636764160,"available":96294248448,"internally_reserved":0,"allocated":29704192,"data_stored":29497190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.80100000000000005,"15min":0.81299999999999994},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.2250000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79700000000000004,"15min":0.78700000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.163,"5min":1.641,"15min":1.641},"last":1.0409999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.84199999999999997},"min":{"1min":0.36299999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1779999999999999,"5min":1.292,"15min":1.292},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.89000000000000001,"15min":0.874},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.248,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.80300000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.86199999999999999,"15min":0.873},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1659999999999999,"5min":1.276,"15min":1.276},"last":1.081},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.012,"15min":0.96399999999999997},"min":{"1min":0.56200000000000006,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.339,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.1950000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.92200000000000004,"15min":0.96599999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2709999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0389999999999999,"15min":1.091},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2330000000000001,"5min":1.448,"15min":1.448},"last":1.1579999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.0169999999999999,"15min":1.0209999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2629999999999999,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.002,"5min":1.1000000000000001,"15min":1.075},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.208,"5min":9.8480000000000008,"15min":9.8480000000000008},"last":0.76900000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.044,"15min":1.1319999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.248,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1539999999999999,"15min":1.1699999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3939999999999999,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.1020000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1919999999999999,"15min":1.1699999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.3280000000000001,"5min":8.8290000000000006,"15min":8.8290000000000006},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1870000000000001,"15min":1.2629999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3859999999999999,"5min":1.71,"15min":1.71},"last":1.22}]}]},{"osd":3,"up_from":13,"seq":55834574912,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":318408,"kb_used_data":17024,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94053432,"statfs":{"total":96636764160,"available":96310714368,"internally_reserved":0,"allocated":17432576,"data_stored":17223470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65300000000000002,"15min":0.66000000000000003},"min":{"1min":0.52400000000000002,"5min":0.214,"15min":0.214},"max":{"1min":0.89100000000000001,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70299999999999996,"15min":0.71099999999999997},"min":{"1min":0.40999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.026,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":0.73599999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.69999999999999996,"15min":0.65600000000000003},"min":{"1min":0.42399999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1120000000000001,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.85099999999999998,"15min":0.76900000000000002},"min":{"1min":0.45700000000000002,"5min":0.249,"15min":0.249},"max":{"1min":1.3420000000000001,"5min":8.3059999999999992,"15min":8.3059999999999992},"last":0.79100000000000004}]},{"osd":2,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.1100000000000001,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.81299999999999994,"15min":0.78500000000000003},"min":{"1min":0.53900000000000003,"5min":0.433,"15min":0.433},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.65900000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.99299999999999999,"15min":1.0309999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.2310000000000001,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":0.996},{"interface":"front","average":{"1min":1.04,"5min":0.997,"15min":1.0049999999999999},"min":{"1min":0.74399999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3919999999999999,"5min":2.202,"15min":2.202},"last":1.1259999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0569999999999999,"15min":1.0820000000000001},"min":{"1min":0.69099999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.4379999999999999,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.012,"5min":1.0760000000000001,"15min":1.099},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.341,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.345}]},{"osd":6,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0620000000000001,"15min":1.0680000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3220000000000001,"5min":2.113,"15min":2.113},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1299999999999999,"15min":1.1679999999999999},"min":{"1min":0.72999999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.5129999999999999,"5min":3.351,"15min":3.351},"last":1.24}]},{"osd":7,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.1459999999999999,"15min":1.2110000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.353,"5min":2.984,"15min":2.984},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.1799999999999999,"15min":1.141},"min":{"1min":0.69999999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":6.3940000000000001,"5min":6.3940000000000001,"15min":6.3940000000000001},"last":1.177}]}]},{"osd":2,"up_from":13,"seq":55834574912,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310200,"kb_used_data":4720,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94061640,"statfs":{"total":96636764160,"available":96319119360,"internally_reserved":0,"allocated":4833280,"data_stored":4631728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.36099999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63,"15min":0.621},"min":{"1min":0.44800000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.83899999999999997,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.68500000000000005}]},{"osd":1,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.72199999999999998,"15min":0.748},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.753,"15min":0.74099999999999999},"min":{"1min":0.52400000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.76700000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.74399999999999999,"15min":0.75900000000000001},"min":{"1min":0.57899999999999996,"5min":0.315,"15min":0.315},"max":{"1min":0.871,"5min":1.454,"15min":1.454},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.86399999999999999,"15min":0.874},"min":{"1min":0.505,"5min":0.433,"15min":0.433},"max":{"1min":1.115,"5min":1.306,"15min":1.306},"last":1.1080000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.97299999999999998,"15min":1.0149999999999999},"min":{"1min":0.60499999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2250000000000001,"5min":1.954,"15min":1.954},"last":1.212},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.998,"15min":1.0349999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.377,"5min":1.804,"15min":1.804},"last":1.052}]},{"osd":5,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.96499999999999997,"15min":1.0149999999999999},"min":{"1min":0.61699999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.401,"5min":1.873,"15min":1.873},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0569999999999999,"15min":1.0960000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.206,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.024}]},{"osd":6,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.05,"15min":1.0860000000000001},"min":{"1min":0.70399999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.329,"5min":1.974,"15min":1.974},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.995,"5min":1.0469999999999999,"15min":1.079},"min":{"1min":0.66300000000000003,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.361,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.1779999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.1140000000000001,"15min":1.147},"min":{"1min":0.84999999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.3029999999999999,"5min":1.915,"15min":1.915},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.115,"15min":1.1599999999999999},"min":{"1min":0.79100000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.4219999999999999,"5min":2.524,"15min":2.524},"last":1.2549999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326288,"kb_used_data":20808,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94045552,"statfs":{"total":96636764160,"available":96302645248,"internally_reserved":0,"allocated":21307392,"data_stored":21108603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60399999999999998,"15min":0.60799999999999998},"min":{"1min":0.315,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.98999999999999999,"5min":1.024,"15min":1.024},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.65700000000000003,"15min":0.65100000000000002},"min":{"1min":0.39100000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.74199999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68200000000000005,"15min":0.65000000000000002},"min":{"1min":0.42899999999999999,"5min":0.373,"15min":0.373},"max":{"1min":1.3129999999999999,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":1.159},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.747,"15min":0.76300000000000001},"min":{"1min":0.53100000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.80200000000000005}]},{"osd":3,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79500000000000004,"15min":0.83799999999999997},"min":{"1min":0.51200000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.224,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.76400000000000001,"15min":0.76300000000000001},"min":{"1min":0.47199999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.153,"5min":1.25,"15min":1.25},"last":0.89600000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.90900000000000003,"15min":0.93200000000000005},"min":{"1min":0.60399999999999998,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.173,"5min":1.492,"15min":1.492},"last":1.02},{"interface":"front","average":{"1min":0.91200000000000003,"5min":1.0169999999999999,"15min":1.0149999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2210000000000001,"5min":3.5910000000000002,"15min":3.5910000000000002},"last":1.3320000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":1.03,"15min":1.0369999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.2829999999999999,"5min":3.6280000000000001,"15min":3.6280000000000001},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.109,"5min":1.075,"15min":1.113},"min":{"1min":0.69499999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.4650000000000001,"5min":1.641,"15min":1.641},"last":1.0009999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0409999999999999,"15min":1.091},"min":{"1min":0.71299999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.4299999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.117,"15min":1.1419999999999999},"min":{"1min":0.71099999999999997,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3660000000000001,"5min":3.657,"15min":3.657},"last":1.4870000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.103,"15min":1.1499999999999999},"min":{"1min":0.751,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.548,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.079,"5min":1.085,"15min":1.1220000000000001},"min":{"1min":0.68200000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3260000000000001,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.1910000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574912,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":330996,"kb_used_data":21420,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94040844,"statfs":{"total":96636764160,"available":96297824256,"internally_reserved":0,"allocated":21934080,"data_stored":21706793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.66000000000000003,"15min":0.64500000000000002},"min":{"1min":0.46000000000000002,"5min":0.318,"15min":0.318},"max":{"1min":3.9449999999999998,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.40699999999999997,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1659999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.68999999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.72099999999999997,"15min":0.70299999999999996},"min":{"1min":0.52100000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.755},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.77800000000000002,"15min":0.77400000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.3340000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.83399999999999996}]},{"osd":3,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.42699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":4.2229999999999999,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.84099999999999997,"15min":0.82299999999999995},"min":{"1min":0.628,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.88300000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.99199999999999999,"15min":0.999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.722,"5min":1.734,"15min":1.734},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.97299999999999998,"15min":1.014},"min":{"1min":0.63400000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.286,"5min":1.552,"15min":1.552},"last":1.006}]},{"osd":5,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.98399999999999999,"15min":1.0109999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.361,"5min":1.601,"15min":1.601},"last":1.157},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.0740000000000001,"15min":1.0760000000000001},"min":{"1min":0.76900000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.133}]},{"osd":6,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.115,"15min":1.129},"min":{"1min":0.71899999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.056},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1060000000000001,"15min":1.087},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.0900000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.161,"15min":1.157},"min":{"1min":0.81499999999999995,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.0940000000000001,"15min":1.1160000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":1.228}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20983808,"data_stored":20972130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20979712,"data_stored":20971680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4476928,"data_stored":4474292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17068032,"data_stored":17057848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17743872,"data_stored":17734414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":38711296,"data_stored":38705844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":24687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":16404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":36917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":45103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":16417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":49208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":32800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":32840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:09:15.355 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:09:15.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc20d745700 1 Processor -- start 2023-10-08T16:09:15.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc20d745700 1 -- start start 2023-10-08T16:09:15.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc20d745700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc2080ad4a0 0x7fc208138e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:15.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc20d745700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2080ae860 con 0x7fc208139340 2023-10-08T16:09:15.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc20d745700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2080ae5f0 con 0x7fc2080b1dc0 2023-10-08T16:09:15.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc20d745700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2080ac1e0 con 0x7fc2080ad4a0 2023-10-08T16:09:15.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc2077fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc2080ad4a0 0x7fc208138e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:15.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc2077fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc2080ad4a0 0x7fc208138e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48408/0 (socket says 172.21.15.133:48408) 2023-10-08T16:09:15.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc2077fe700 1 -- 172.21.15.133:0/2039118094 learned_addr learned my addr 172.21.15.133:0/2039118094 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:15.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc20cf44700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc208139340 0x7fc208149a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56296/0 (socket says 172.21.15.133:56296) 2023-10-08T16:09:15.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc2077fe700 1 -- 172.21.15.133:0/2039118094 >> v1:172.21.15.190:6789/0 conn(0x7fc2080b1dc0 legacy=0x7fc2080acd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:15.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc2077fe700 1 -- 172.21.15.133:0/2039118094 >> v1:172.21.15.133:6789/0 conn(0x7fc208139340 legacy=0x7fc208149a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:15.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc2077fe700 1 -- 172.21.15.133:0/2039118094 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2080ac4c0 con 0x7fc2080ad4a0 2023-10-08T16:09:15.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc206ffd700 1 -- 172.21.15.133:0/2039118094 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1291205220 0 0) 0x7fc2080ae860 con 0x7fc208139340 2023-10-08T16:09:15.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc2077fe700 1 --2- 172.21.15.133:0/2039118094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2080ad4a0 0x7fc208138e00 secure :-1 s=READY pgs=4358 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8009f20 tx=0x7fc1f8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcbf58c779c08ef7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:15.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc206ffd700 1 -- 172.21.15.133:0/2039118094 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f800e070 con 0x7fc2080ad4a0 2023-10-08T16:09:15.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc206ffd700 1 -- 172.21.15.133:0/2039118094 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f800ba80 con 0x7fc2080ad4a0 2023-10-08T16:09:15.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc206ffd700 1 -- 172.21.15.133:0/2039118094 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f80092e0 con 0x7fc2080ad4a0 2023-10-08T16:09:15.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc20d745700 1 -- 172.21.15.133:0/2039118094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2080ad4a0 msgr2=0x7fc208138e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:15.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc20d745700 1 --2- 172.21.15.133:0/2039118094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2080ad4a0 0x7fc208138e00 secure :-1 s=READY pgs=4358 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8009f20 tx=0x7fc1f8009840 comp rx=0 tx=0).stop 2023-10-08T16:09:15.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc20d745700 1 -- 172.21.15.133:0/2039118094 shutdown_connections 2023-10-08T16:09:15.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc20d745700 1 --2- 172.21.15.133:0/2039118094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2080ad4a0 0x7fc208138e00 unknown :-1 s=CLOSED pgs=4358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc20d745700 1 -- 172.21.15.133:0/2039118094 >> 172.21.15.133:0/2039118094 conn(0x7fc208063670 msgr2=0x7fc2080b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:15.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc20d745700 1 -- 172.21.15.133:0/2039118094 shutdown_connections 2023-10-08T16:09:15.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc20d745700 1 -- 172.21.15.133:0/2039118094 wait complete. 2023-10-08T16:09:15.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc20d745700 1 Processor -- start 2023-10-08T16:09:15.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc20d745700 1 -- start start 2023-10-08T16:09:15.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc20d745700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2080ad4a0 0x7fc2080b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:15.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc20d745700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2080b1dc0 0x7fc2081438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:15.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc20d745700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc208139340 0x7fc2081378d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:15.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc20d745700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2080b3c00 con 0x7fc208139340 2023-10-08T16:09:15.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc20d745700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc208143e30 con 0x7fc2080b1dc0 2023-10-08T16:09:15.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc20d745700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2080b3e00 con 0x7fc2080ad4a0 2023-10-08T16:09:15.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc20cf44700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc208139340 0x7fc2081378d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:15.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc20cf44700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc208139340 0x7fc2081378d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48412/0 (socket says 172.21.15.133:48412) 2023-10-08T16:09:15.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc20cf44700 1 -- 172.21.15.133:0/1835108171 learned_addr learned my addr 172.21.15.133:0/1835108171 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:15.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc207fff700 1 --2- 172.21.15.133:0/1835108171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2080ad4a0 0x7fc2080b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:15.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.461+0000 7fc2077fe700 1 --2- 172.21.15.133:0/1835108171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2080b1dc0 0x7fc2081438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:15.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.465+0000 7fc20cf44700 1 -- 172.21.15.133:0/1835108171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2080ad4a0 msgr2=0x7fc2080b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:15.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.465+0000 7fc20cf44700 1 --2- 172.21.15.133:0/1835108171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2080ad4a0 0x7fc2080b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.465+0000 7fc20cf44700 1 -- 172.21.15.133:0/1835108171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2080b1dc0 msgr2=0x7fc2081438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:15.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.465+0000 7fc20cf44700 1 --2- 172.21.15.133:0/1835108171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2080b1dc0 0x7fc2081438f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.465+0000 7fc20cf44700 1 -- 172.21.15.133:0/1835108171 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f8009ae0 con 0x7fc208139340 2023-10-08T16:09:15.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.465+0000 7fc2077fe700 1 --2- 172.21.15.133:0/1835108171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2080b1dc0 0x7fc2081438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:15.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.465+0000 7fc20cf44700 1 --2- 172.21.15.133:0/1835108171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc208139340 0x7fc2081378d0 secure :-1 s=READY pgs=4359 cs=0 l=1 rev1=1 crypto rx=0x7fc20000c530 tx=0x7fc200007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:15.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.465+0000 7fc1fffff700 1 -- 172.21.15.133:0/1835108171 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc200005a70 con 0x7fc208139340 2023-10-08T16:09:15.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.465+0000 7fc1fffff700 1 -- 172.21.15.133:0/1835108171 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc200005bd0 con 0x7fc208139340 2023-10-08T16:09:15.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.465+0000 7fc20d745700 1 -- 172.21.15.133:0/1835108171 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2080ab270 con 0x7fc208139340 2023-10-08T16:09:15.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.465+0000 7fc1fffff700 1 -- 172.21.15.133:0/1835108171 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2000070d0 con 0x7fc208139340 2023-10-08T16:09:15.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.465+0000 7fc20d745700 1 -- 172.21.15.133:0/1835108171 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2081402b0 con 0x7fc208139340 2023-10-08T16:09:15.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.465+0000 7fc20d745700 1 -- 172.21.15.133:0/1835108171 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2080ab0d0 con 0x7fc208139340 2023-10-08T16:09:15.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.465+0000 7fc1fffff700 1 -- 172.21.15.133:0/1835108171 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc2000074c0 con 0x7fc208139340 2023-10-08T16:09:15.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.469+0000 7fc1fffff700 1 --2- 172.21.15.133:0/1835108171 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fc1e8060550 0x7fc1e8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:15.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.469+0000 7fc1fffff700 1 -- 172.21.15.133:0/1835108171 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fc20007bc30 con 0x7fc208139340 2023-10-08T16:09:15.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.469+0000 7fc207fff700 1 --2- 172.21.15.133:0/1835108171 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fc1e8060550 0x7fc1e8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:15.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.469+0000 7fc207fff700 1 --2- 172.21.15.133:0/1835108171 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fc1e8060550 0x7fc1e8062a00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0003a80 tx=0x7fc1f0007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:15.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.477+0000 7fc1fffff700 1 -- 172.21.15.133:0/1835108171 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc2080ab0d0 con 0x7fc208139340 2023-10-08T16:09:15.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.637+0000 7fc20d745700 1 -- 172.21.15.133:0/1835108171 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2080ab0d0 con 0x7fc208139340 2023-10-08T16:09:15.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.641+0000 7fc1fffff700 1 -- 172.21.15.133:0/1835108171 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+15654 (secure 0 0 0) 0x7fc2080ab0d0 con 0x7fc208139340 2023-10-08T16:09:15.647 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:09:15.647 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":28,"fsid":"f2546191-d59e-4805-8e1b-3d8d3d1dad86","created":"2023-10-08T16:03:52.631855+0000","modified":"2023-10-08T16:08:57.686321+0000","last_up_change":"2023-10-08T16:04:04.030581+0000","last_in_change":"2023-10-08T16:03:54.835293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:04.898316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:14.869859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:15.983795+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":27,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8c5deadf-a203-4d30-aa7f-6e2e492b6ffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6809","nonce":33493},{"type":"v1","addr":"172.21.15.133:6811","nonce":33493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":33493},{"type":"v1","addr":"172.21.15.133:6815","nonce":33493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":33493},{"type":"v1","addr":"172.21.15.133:6822","nonce":33493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":33493},{"type":"v1","addr":"172.21.15.133:6818","nonce":33493}]},"public_addr":"172.21.15.133:6811/33493","cluster_addr":"172.21.15.133:6815/33493","heartbeat_back_addr":"172.21.15.133:6822/33493","heartbeat_front_addr":"172.21.15.133:6818/33493","state":["exists","up"]},{"osd":1,"uuid":"9b081c42-c915-48c3-a1ad-410f09a78576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":33490},{"type":"v1","addr":"172.21.15.133:6801","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":33490},{"type":"v1","addr":"172.21.15.133:6803","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":33490},{"type":"v1","addr":"172.21.15.133:6807","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":33490},{"type":"v1","addr":"172.21.15.133:6805","nonce":33490}]},"public_addr":"172.21.15.133:6801/33490","cluster_addr":"172.21.15.133:6803/33490","heartbeat_back_addr":"172.21.15.133:6807/33490","heartbeat_front_addr":"172.21.15.133:6805/33490","state":["exists","up"]},{"osd":2,"uuid":"88ecda43-01cd-4644-ab0c-92c91fd38966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":33492},{"type":"v1","addr":"172.21.15.133:6825","nonce":33492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":33492},{"type":"v1","addr":"172.21.15.133:6827","nonce":33492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":33492},{"type":"v1","addr":"172.21.15.133:6831","nonce":33492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":33492},{"type":"v1","addr":"172.21.15.133:6829","nonce":33492}]},"public_addr":"172.21.15.133:6825/33492","cluster_addr":"172.21.15.133:6827/33492","heartbeat_back_addr":"172.21.15.133:6831/33492","heartbeat_front_addr":"172.21.15.133:6829/33492","state":["exists","up"]},{"osd":3,"uuid":"39faf38d-b8e2-4e11-9b3b-84dc834c977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":33491},{"type":"v1","addr":"172.21.15.133:6810","nonce":33491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":33491},{"type":"v1","addr":"172.21.15.133:6814","nonce":33491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":33491},{"type":"v1","addr":"172.21.15.133:6823","nonce":33491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":33491},{"type":"v1","addr":"172.21.15.133:6819","nonce":33491}]},"public_addr":"172.21.15.133:6810/33491","cluster_addr":"172.21.15.133:6814/33491","heartbeat_back_addr":"172.21.15.133:6823/33491","heartbeat_front_addr":"172.21.15.133:6819/33491","state":["exists","up"]},{"osd":4,"uuid":"4c097e61-1cad-4b61-9183-4e7bc486bd32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":33678},{"type":"v1","addr":"172.21.15.190:6810","nonce":33678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":33678},{"type":"v1","addr":"172.21.15.190:6814","nonce":33678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":33678},{"type":"v1","addr":"172.21.15.190:6822","nonce":33678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":33678},{"type":"v1","addr":"172.21.15.190:6818","nonce":33678}]},"public_addr":"172.21.15.190:6810/33678","cluster_addr":"172.21.15.190:6814/33678","heartbeat_back_addr":"172.21.15.190:6822/33678","heartbeat_front_addr":"172.21.15.190:6818/33678","state":["exists","up"]},{"osd":5,"uuid":"05f072e0-7bc0-40f0-8cb6-8e322c82d6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":33676},{"type":"v1","addr":"172.21.15.190:6811","nonce":33676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":33676},{"type":"v1","addr":"172.21.15.190:6815","nonce":33676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":33676},{"type":"v1","addr":"172.21.15.190:6823","nonce":33676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":33676},{"type":"v1","addr":"172.21.15.190:6819","nonce":33676}]},"public_addr":"172.21.15.190:6811/33676","cluster_addr":"172.21.15.190:6815/33676","heartbeat_back_addr":"172.21.15.190:6823/33676","heartbeat_front_addr":"172.21.15.190:6819/33676","state":["exists","up"]},{"osd":6,"uuid":"1bcce8d7-14f3-442d-b135-68c7d66cdedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":33677},{"type":"v1","addr":"172.21.15.190:6801","nonce":33677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":33677},{"type":"v1","addr":"172.21.15.190:6803","nonce":33677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":33677},{"type":"v1","addr":"172.21.15.190:6807","nonce":33677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":33677},{"type":"v1","addr":"172.21.15.190:6805","nonce":33677}]},"public_addr":"172.21.15.190:6801/33677","cluster_addr":"172.21.15.190:6803/33677","heartbeat_back_addr":"172.21.15.190:6807/33677","heartbeat_front_addr":"172.21.15.190:6805/33677","state":["exists","up"]},{"osd":7,"uuid":"9157dbf7-2bf9-43d7-a89a-a8e3dae7514c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":33686},{"type":"v1","addr":"172.21.15.190:6825","nonce":33686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":33686},{"type":"v1","addr":"172.21.15.190:6827","nonce":33686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":33686},{"type":"v1","addr":"172.21.15.190:6831","nonce":33686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":33686},{"type":"v1","addr":"172.21.15.190:6829","nonce":33686}]},"public_addr":"172.21.15.190:6825/33686","cluster_addr":"172.21.15.190:6827/33686","heartbeat_back_addr":"172.21.15.190:6831/33686","heartbeat_front_addr":"172.21.15.190:6829/33686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.886742+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.199618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.871695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.115926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.069650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.841448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.132320+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.315132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":14,"length":6}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:15.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.641+0000 7fc20d745700 1 -- 172.21.15.133:0/1835108171 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fc1e8060550 msgr2=0x7fc1e8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:15.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.641+0000 7fc20d745700 1 --2- 172.21.15.133:0/1835108171 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fc1e8060550 0x7fc1e8062a00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0003a80 tx=0x7fc1f0007ec0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.641+0000 7fc20d745700 1 -- 172.21.15.133:0/1835108171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc208139340 msgr2=0x7fc2081378d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:15.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.641+0000 7fc20d745700 1 --2- 172.21.15.133:0/1835108171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc208139340 0x7fc2081378d0 secure :-1 s=READY pgs=4359 cs=0 l=1 rev1=1 crypto rx=0x7fc20000c530 tx=0x7fc200007f90 comp rx=0 tx=0).stop 2023-10-08T16:09:15.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.641+0000 7fc20d745700 1 -- 172.21.15.133:0/1835108171 shutdown_connections 2023-10-08T16:09:15.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.641+0000 7fc20d745700 1 --2- 172.21.15.133:0/1835108171 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fc1e8060550 0x7fc1e8062a00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.641+0000 7fc20d745700 1 --2- 172.21.15.133:0/1835108171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc208139340 0x7fc2081378d0 unknown :-1 s=CLOSED pgs=4359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.641+0000 7fc20d745700 1 --2- 172.21.15.133:0/1835108171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2080b1dc0 0x7fc2081438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.641+0000 7fc20d745700 1 --2- 172.21.15.133:0/1835108171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2080ad4a0 0x7fc2080b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.641+0000 7fc20d745700 1 -- 172.21.15.133:0/1835108171 >> 172.21.15.133:0/1835108171 conn(0x7fc208063670 msgr2=0x7fc20806fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:15.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.645+0000 7fc20d745700 1 -- 172.21.15.133:0/1835108171 shutdown_connections 2023-10-08T16:09:15.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:15.645+0000 7fc20d745700 1 -- 172.21.15.133:0/1835108171 wait complete. 2023-10-08T16:09:16.663 INFO:tasks.ceph:Scrubbing osd.0 2023-10-08T16:09:16.663 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-08T16:09:16.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.785+0000 7fb46113e700 1 Processor -- start 2023-10-08T16:09:16.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.785+0000 7fb46113e700 1 -- start start 2023-10-08T16:09:16.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.785+0000 7fb46113e700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb45c13c9f0 0x7fb45c14df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.785+0000 7fb46113e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45c0b1d70 con 0x7fb45c145b70 2023-10-08T16:09:16.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.785+0000 7fb46113e700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45c0b1b00 con 0x7fb45c0b9680 2023-10-08T16:09:16.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.785+0000 7fb46113e700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45c0b2610 con 0x7fb45c13c9f0 2023-10-08T16:09:16.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.785+0000 7fb45a59c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb45c145b70 0x7fb45c13c2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56308/0 (socket says 172.21.15.133:56308) 2023-10-08T16:09:16.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.785+0000 7fb45a59c700 1 -- 172.21.15.133:0/3434211835 learned_addr learned my addr 172.21.15.133:0/3434211835 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:09:16.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.785+0000 7fb45b59e700 1 --2- 172.21.15.133:0/3434211835 >> v2:172.21.15.190:3300/0 conn(0x7fb45c13c9f0 0x7fb45c14df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.785+0000 7fb459d9b700 1 -- 172.21.15.133:0/3434211835 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 854572859 0 0) 0x7fb45c0b1d70 con 0x7fb45c145b70 2023-10-08T16:09:16.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.785+0000 7fb459d9b700 1 -- 172.21.15.133:0/3434211835 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb448003570 con 0x7fb45c145b70 2023-10-08T16:09:16.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.785+0000 7fb45b59e700 1 -- 172.21.15.133:0/3434211835 >> v1:172.21.15.190:6789/0 conn(0x7fb45c0b9680 legacy=0x7fb45c0b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.785+0000 7fb45b59e700 1 -- 172.21.15.133:0/3434211835 >> v1:172.21.15.133:6789/0 conn(0x7fb45c145b70 legacy=0x7fb45c13c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.785+0000 7fb45b59e700 1 -- 172.21.15.133:0/3434211835 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c0b28f0 con 0x7fb45c13c9f0 2023-10-08T16:09:16.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.785+0000 7fb45b59e700 1 --2- 172.21.15.133:0/3434211835 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb45c13c9f0 0x7fb45c14df20 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7fb4540098e0 tx=0x7fb4540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abc60f83813383e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:16.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.785+0000 7fb459d9b700 1 -- 172.21.15.133:0/3434211835 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45400b640 con 0x7fb45c13c9f0 2023-10-08T16:09:16.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.785+0000 7fb459d9b700 1 -- 172.21.15.133:0/3434211835 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45400b7a0 con 0x7fb45c13c9f0 2023-10-08T16:09:16.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.785+0000 7fb459d9b700 1 -- 172.21.15.133:0/3434211835 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45400bb40 con 0x7fb45c13c9f0 2023-10-08T16:09:16.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.789+0000 7fb46113e700 1 -- 172.21.15.133:0/3434211835 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb45c13c9f0 msgr2=0x7fb45c14df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.789+0000 7fb46113e700 1 --2- 172.21.15.133:0/3434211835 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb45c13c9f0 0x7fb45c14df20 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7fb4540098e0 tx=0x7fb4540091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.789+0000 7fb46113e700 1 -- 172.21.15.133:0/3434211835 shutdown_connections 2023-10-08T16:09:16.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.789+0000 7fb46113e700 1 --2- 172.21.15.133:0/3434211835 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb45c13c9f0 0x7fb45c14df20 unknown :-1 s=CLOSED pgs=2244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.789+0000 7fb46113e700 1 -- 172.21.15.133:0/3434211835 >> 172.21.15.133:0/3434211835 conn(0x7fb45c067df0 msgr2=0x7fb45c0681f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:16.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.789+0000 7fb46113e700 1 -- 172.21.15.133:0/3434211835 shutdown_connections 2023-10-08T16:09:16.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.789+0000 7fb46113e700 1 -- 172.21.15.133:0/3434211835 wait complete. 2023-10-08T16:09:16.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.789+0000 7fb46113e700 1 Processor -- start 2023-10-08T16:09:16.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.789+0000 7fb46113e700 1 -- start start 2023-10-08T16:09:16.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.789+0000 7fb46113e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb45c0b9680 0x7fb45c148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.789+0000 7fb46113e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb45c13c9f0 0x7fb45c1558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.789+0000 7fb46113e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb45c145b70 0x7fb45c0aca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.789+0000 7fb46113e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0ae290 con 0x7fb45c145b70 2023-10-08T16:09:16.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.789+0000 7fb46113e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c142320 con 0x7fb45c13c9f0 2023-10-08T16:09:16.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.789+0000 7fb46113e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c142600 con 0x7fb45c0b9680 2023-10-08T16:09:16.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.789+0000 7fb45b59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb45c145b70 0x7fb45c0aca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.789+0000 7fb45a59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb45c13c9f0 0x7fb45c1558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.789+0000 7fb45b59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb45c145b70 0x7fb45c0aca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48422/0 (socket says 172.21.15.133:48422) 2023-10-08T16:09:16.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.789+0000 7fb45b59e700 1 -- 172.21.15.133:0/2492555720 learned_addr learned my addr 172.21.15.133:0/2492555720 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:16.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.789+0000 7fb45ad9d700 1 --2- 172.21.15.133:0/2492555720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb45c0b9680 0x7fb45c148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.793+0000 7fb45b59e700 1 -- 172.21.15.133:0/2492555720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb45c0b9680 msgr2=0x7fb45c148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.793+0000 7fb45b59e700 1 --2- 172.21.15.133:0/2492555720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb45c0b9680 0x7fb45c148060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.793+0000 7fb45b59e700 1 -- 172.21.15.133:0/2492555720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb45c13c9f0 msgr2=0x7fb45c1558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.793+0000 7fb45b59e700 1 --2- 172.21.15.133:0/2492555720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb45c13c9f0 0x7fb45c1558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.793+0000 7fb45b59e700 1 -- 172.21.15.133:0/2492555720 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb454009420 con 0x7fb45c145b70 2023-10-08T16:09:16.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.793+0000 7fb45a59c700 1 --2- 172.21.15.133:0/2492555720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb45c13c9f0 0x7fb45c1558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:16.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.793+0000 7fb45ad9d700 1 --2- 172.21.15.133:0/2492555720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb45c0b9680 0x7fb45c148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:16.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.793+0000 7fb45b59e700 1 --2- 172.21.15.133:0/2492555720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb45c145b70 0x7fb45c0aca80 secure :-1 s=READY pgs=4361 cs=0 l=1 rev1=1 crypto rx=0x7fb4540093f0 tx=0x7fb454017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:16.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.793+0000 7fb452ffd700 1 -- 172.21.15.133:0/2492555720 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454006af0 con 0x7fb45c145b70 2023-10-08T16:09:16.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.793+0000 7fb46113e700 1 -- 172.21.15.133:0/2492555720 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45c155e30 con 0x7fb45c145b70 2023-10-08T16:09:16.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.793+0000 7fb452ffd700 1 -- 172.21.15.133:0/2492555720 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45400bb20 con 0x7fb45c145b70 2023-10-08T16:09:16.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.793+0000 7fb46113e700 1 -- 172.21.15.133:0/2492555720 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45c142b20 con 0x7fb45c145b70 2023-10-08T16:09:16.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.793+0000 7fb452ffd700 1 -- 172.21.15.133:0/2492555720 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454011670 con 0x7fb45c145b70 2023-10-08T16:09:16.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.793+0000 7fb46113e700 1 -- 172.21.15.133:0/2492555720 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb45c142490 con 0x7fb45c145b70 2023-10-08T16:09:16.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.797+0000 7fb452ffd700 1 -- 172.21.15.133:0/2492555720 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb454011a60 con 0x7fb45c145b70 2023-10-08T16:09:16.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.797+0000 7fb452ffd700 1 --2- 172.21.15.133:0/2492555720 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb43c060550 0x7fb43c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.797+0000 7fb452ffd700 1 -- 172.21.15.133:0/2492555720 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fb45407e860 con 0x7fb45c145b70 2023-10-08T16:09:16.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.797+0000 7fb45ad9d700 1 --2- 172.21.15.133:0/2492555720 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb43c060550 0x7fb43c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.797+0000 7fb452ffd700 1 --2- 172.21.15.133:0/2492555720 >> [v2:172.21.15.133:6809/33493,v1:172.21.15.133:6811/33493] conn(0x7fb43c0688c0 0x7fb43c06ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.797+0000 7fb452ffd700 1 -- 172.21.15.133:0/2492555720 --> [v2:172.21.15.133:6809/33493,v1:172.21.15.133:6811/33493] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb43c06b420 con 0x7fb43c0688c0 2023-10-08T16:09:16.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.797+0000 7fb452ffd700 1 -- 172.21.15.133:0/2492555720 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb45407ec30 con 0x7fb45c145b70 2023-10-08T16:09:16.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.797+0000 7fb45a59c700 1 --2- 172.21.15.133:0/2492555720 >> [v2:172.21.15.133:6809/33493,v1:172.21.15.133:6811/33493] conn(0x7fb43c0688c0 0x7fb43c06ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.797+0000 7fb45ad9d700 1 --2- 172.21.15.133:0/2492555720 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb43c060550 0x7fb43c062a00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb44c001d20 tx=0x7fb44c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:16.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.797+0000 7fb45a59c700 1 --2- 172.21.15.133:0/2492555720 >> [v2:172.21.15.133:6809/33493,v1:172.21.15.133:6811/33493] conn(0x7fb43c0688c0 0x7fb43c06ad50 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:16.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.797+0000 7fb452ffd700 1 -- 172.21.15.133:0/2492555720 <== osd.0 v2:172.21.15.133:6809/33493 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb43c06b420 con 0x7fb43c0688c0 2023-10-08T16:09:16.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.813+0000 7fb46113e700 1 -- 172.21.15.133:0/2492555720 --> [v2:172.21.15.133:6809/33493,v1:172.21.15.133:6811/33493] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb45c142770 con 0x7fb43c0688c0 2023-10-08T16:09:16.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.813+0000 7fb452ffd700 1 -- 172.21.15.133:0/2492555720 <== osd.0 v2:172.21.15.133:6809/33493 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb45c142770 con 0x7fb43c0688c0 2023-10-08T16:09:16.817 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-10-08T16:09:16.817 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T16:09:16.817 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-10-08T16:09:16.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.813+0000 7fb46113e700 1 -- 172.21.15.133:0/2492555720 >> [v2:172.21.15.133:6809/33493,v1:172.21.15.133:6811/33493] conn(0x7fb43c0688c0 msgr2=0x7fb43c06ad50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.813+0000 7fb46113e700 1 --2- 172.21.15.133:0/2492555720 >> [v2:172.21.15.133:6809/33493,v1:172.21.15.133:6811/33493] conn(0x7fb43c0688c0 0x7fb43c06ad50 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.813+0000 7fb46113e700 1 -- 172.21.15.133:0/2492555720 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb43c060550 msgr2=0x7fb43c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.813+0000 7fb46113e700 1 --2- 172.21.15.133:0/2492555720 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb43c060550 0x7fb43c062a00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb44c001d20 tx=0x7fb44c009040 comp rx=0 tx=0).stop 2023-10-08T16:09:16.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.813+0000 7fb46113e700 1 -- 172.21.15.133:0/2492555720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb45c145b70 msgr2=0x7fb45c0aca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.813+0000 7fb46113e700 1 --2- 172.21.15.133:0/2492555720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb45c145b70 0x7fb45c0aca80 secure :-1 s=READY pgs=4361 cs=0 l=1 rev1=1 crypto rx=0x7fb4540093f0 tx=0x7fb454017000 comp rx=0 tx=0).stop 2023-10-08T16:09:16.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.813+0000 7fb45b59e700 1 -- 172.21.15.133:0/2492555720 reap_dead start 2023-10-08T16:09:16.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.813+0000 7fb46113e700 1 -- 172.21.15.133:0/2492555720 shutdown_connections 2023-10-08T16:09:16.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.813+0000 7fb46113e700 1 -- 172.21.15.133:0/2492555720 >> 172.21.15.133:0/2492555720 conn(0x7fb45c067df0 msgr2=0x7fb45c0b0870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:16.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.813+0000 7fb46113e700 1 -- 172.21.15.133:0/2492555720 shutdown_connections 2023-10-08T16:09:16.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.813+0000 7fb46113e700 1 -- 172.21.15.133:0/2492555720 wait complete. 2023-10-08T16:09:16.829 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-08T16:09:16.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe343066700 1 Processor -- start 2023-10-08T16:09:16.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe343066700 1 -- start start 2023-10-08T16:09:16.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe343066700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe33c0b6d10 0x7fe33c0682d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe343066700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe33c068810 0x7fe33c1467d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe343066700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe33c0b2e70 con 0x7fe33c146d10 2023-10-08T16:09:16.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe343066700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe33c0b1eb0 con 0x7fe33c068810 2023-10-08T16:09:16.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe343066700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c068c60 con 0x7fe33c0b6d10 2023-10-08T16:09:16.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe342865700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe33c146d10 0x7fe33c149dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56320/0 (socket says 172.21.15.133:56320) 2023-10-08T16:09:16.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe342865700 1 -- 172.21.15.133:0/1453142105 learned_addr learned my addr 172.21.15.133:0/1453142105 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:09:16.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe341863700 1 --2- 172.21.15.133:0/1453142105 >> v2:172.21.15.190:3300/0 conn(0x7fe33c068810 0x7fe33c1467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe342064700 1 --2- 172.21.15.133:0/1453142105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe33c0b6d10 0x7fe33c0682d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe341062700 1 -- 172.21.15.133:0/1453142105 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4252599247 0 0) 0x7fe33c0b2e70 con 0x7fe33c146d10 2023-10-08T16:09:16.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe341062700 1 -- 172.21.15.133:0/1453142105 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe328003570 con 0x7fe33c146d10 2023-10-08T16:09:16.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe341863700 1 -- 172.21.15.133:0/1453142105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe33c0b6d10 msgr2=0x7fe33c0682d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:16.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe341863700 1 --2- 172.21.15.133:0/1453142105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe33c0b6d10 0x7fe33c0682d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe341863700 1 -- 172.21.15.133:0/1453142105 >> v1:172.21.15.133:6789/0 conn(0x7fe33c146d10 legacy=0x7fe33c149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe341863700 1 -- 172.21.15.133:0/1453142105 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33c0b3150 con 0x7fe33c068810 2023-10-08T16:09:16.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe341863700 1 --2- 172.21.15.133:0/1453142105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe33c068810 0x7fe33c1467d0 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0098e0 tx=0x7fe32c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6818eaf45770798d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:16.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe341062700 1 -- 172.21.15.133:0/1453142105 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32c011630 con 0x7fe33c068810 2023-10-08T16:09:16.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe341062700 1 -- 172.21.15.133:0/1453142105 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32c011790 con 0x7fe33c068810 2023-10-08T16:09:16.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe341062700 1 -- 172.21.15.133:0/1453142105 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32c011b30 con 0x7fe33c068810 2023-10-08T16:09:16.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe343066700 1 -- 172.21.15.133:0/1453142105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe33c068810 msgr2=0x7fe33c1467d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe343066700 1 --2- 172.21.15.133:0/1453142105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe33c068810 0x7fe33c1467d0 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0098e0 tx=0x7fe32c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe343066700 1 -- 172.21.15.133:0/1453142105 shutdown_connections 2023-10-08T16:09:16.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe343066700 1 --2- 172.21.15.133:0/1453142105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe33c068810 0x7fe33c1467d0 unknown :-1 s=CLOSED pgs=2245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe343066700 1 --2- 172.21.15.133:0/1453142105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe33c0b6d10 0x7fe33c0682d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe343066700 1 -- 172.21.15.133:0/1453142105 >> 172.21.15.133:0/1453142105 conn(0x7fe33c062ba0 msgr2=0x7fe33c062fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:16.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe343066700 1 -- 172.21.15.133:0/1453142105 shutdown_connections 2023-10-08T16:09:16.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.941+0000 7fe343066700 1 -- 172.21.15.133:0/1453142105 wait complete. 2023-10-08T16:09:16.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.945+0000 7fe343066700 1 Processor -- start 2023-10-08T16:09:16.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.945+0000 7fe343066700 1 -- start start 2023-10-08T16:09:16.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.945+0000 7fe343066700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe33c068810 0x7fe33c159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.945+0000 7fe343066700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe33c0b6d10 0x7fe33c0ade70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.945+0000 7fe343066700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe33c146d10 0x7fe33c0ac760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.945+0000 7fe343066700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c149760 con 0x7fe33c0b6d10 2023-10-08T16:09:16.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.945+0000 7fe343066700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c0b0140 con 0x7fe33c068810 2023-10-08T16:09:16.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.945+0000 7fe343066700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c15a240 con 0x7fe33c146d10 2023-10-08T16:09:16.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.945+0000 7fe341863700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe33c0b6d10 0x7fe33c0ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.945+0000 7fe341863700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe33c0b6d10 0x7fe33c0ade70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48430/0 (socket says 172.21.15.133:48430) 2023-10-08T16:09:16.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.945+0000 7fe341863700 1 -- 172.21.15.133:0/4005527934 learned_addr learned my addr 172.21.15.133:0/4005527934 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:16.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.945+0000 7fe342064700 1 --2- 172.21.15.133:0/4005527934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe33c068810 0x7fe33c159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.945+0000 7fe342865700 1 --2- 172.21.15.133:0/4005527934 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe33c146d10 0x7fe33c0ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.945+0000 7fe341863700 1 -- 172.21.15.133:0/4005527934 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe33c146d10 msgr2=0x7fe33c0ac760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.945+0000 7fe341863700 1 --2- 172.21.15.133:0/4005527934 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe33c146d10 0x7fe33c0ac760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.945+0000 7fe341863700 1 -- 172.21.15.133:0/4005527934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe33c068810 msgr2=0x7fe33c159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.945+0000 7fe341863700 1 --2- 172.21.15.133:0/4005527934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe33c068810 0x7fe33c159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.945+0000 7fe341863700 1 -- 172.21.15.133:0/4005527934 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32c009420 con 0x7fe33c0b6d10 2023-10-08T16:09:16.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.945+0000 7fe341863700 1 --2- 172.21.15.133:0/4005527934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe33c0b6d10 0x7fe33c0ade70 secure :-1 s=READY pgs=4363 cs=0 l=1 rev1=1 crypto rx=0x7fe32c009ed0 tx=0x7fe32c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:16.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.945+0000 7fe3327fc700 1 -- 172.21.15.133:0/4005527934 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32c011900 con 0x7fe33c0b6d10 2023-10-08T16:09:16.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.945+0000 7fe343066700 1 -- 172.21.15.133:0/4005527934 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe33c14abe0 con 0x7fe33c0b6d10 2023-10-08T16:09:16.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.945+0000 7fe3327fc700 1 -- 172.21.15.133:0/4005527934 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32c011aa0 con 0x7fe33c0b6d10 2023-10-08T16:09:16.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.945+0000 7fe343066700 1 -- 172.21.15.133:0/4005527934 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe33c0af190 con 0x7fe33c0b6d10 2023-10-08T16:09:16.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.945+0000 7fe3327fc700 1 -- 172.21.15.133:0/4005527934 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32c025600 con 0x7fe33c0b6d10 2023-10-08T16:09:16.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.949+0000 7fe343066700 1 -- 172.21.15.133:0/4005527934 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe33c15a3b0 con 0x7fe33c0b6d10 2023-10-08T16:09:16.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.949+0000 7fe3327fc700 1 -- 172.21.15.133:0/4005527934 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe32c0259f0 con 0x7fe33c0b6d10 2023-10-08T16:09:16.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.949+0000 7fe3327fc700 1 --2- 172.21.15.133:0/4005527934 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe320060580 0x7fe320062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.949+0000 7fe342064700 1 --2- 172.21.15.133:0/4005527934 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe320060580 0x7fe320062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.949+0000 7fe3327fc700 1 -- 172.21.15.133:0/4005527934 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fe32c07de40 con 0x7fe33c0b6d10 2023-10-08T16:09:16.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.949+0000 7fe342064700 1 --2- 172.21.15.133:0/4005527934 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe320060580 0x7fe320062a30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe338009da0 tx=0x7fe338009120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:16.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:16.957+0000 7fe3327fc700 1 -- 172.21.15.133:0/4005527934 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe33c15a3b0 con 0x7fe33c0b6d10 2023-10-08T16:09:17.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.117+0000 7fe343066700 1 -- 172.21.15.133:0/4005527934 --> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fe33c15a3b0 con 0x7fe320060580 2023-10-08T16:09:17.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.117+0000 7fe3327fc700 1 -- 172.21.15.133:0/4005527934 <== mgr.4104 v2:172.21.15.133:6832/33362 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe33c15a3b0 con 0x7fe320060580 2023-10-08T16:09:17.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.121+0000 7fe343066700 1 -- 172.21.15.133:0/4005527934 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe320060580 msgr2=0x7fe320062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.121+0000 7fe343066700 1 --2- 172.21.15.133:0/4005527934 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe320060580 0x7fe320062a30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe338009da0 tx=0x7fe338009120 comp rx=0 tx=0).stop 2023-10-08T16:09:17.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.121+0000 7fe343066700 1 -- 172.21.15.133:0/4005527934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe33c0b6d10 msgr2=0x7fe33c0ade70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.121+0000 7fe343066700 1 --2- 172.21.15.133:0/4005527934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe33c0b6d10 0x7fe33c0ade70 secure :-1 s=READY pgs=4363 cs=0 l=1 rev1=1 crypto rx=0x7fe32c009ed0 tx=0x7fe32c017000 comp rx=0 tx=0).stop 2023-10-08T16:09:17.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.121+0000 7fe343066700 1 -- 172.21.15.133:0/4005527934 shutdown_connections 2023-10-08T16:09:17.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.121+0000 7fe343066700 1 --2- 172.21.15.133:0/4005527934 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe320060580 0x7fe320062a30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.121+0000 7fe343066700 1 --2- 172.21.15.133:0/4005527934 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe33c146d10 0x7fe33c0ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.121+0000 7fe343066700 1 --2- 172.21.15.133:0/4005527934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe33c0b6d10 0x7fe33c0ade70 unknown :-1 s=CLOSED pgs=4363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.121+0000 7fe343066700 1 --2- 172.21.15.133:0/4005527934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe33c068810 0x7fe33c159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.121+0000 7fe343066700 1 -- 172.21.15.133:0/4005527934 >> 172.21.15.133:0/4005527934 conn(0x7fe33c062ba0 msgr2=0x7fe33c1437d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:17.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.121+0000 7fe343066700 1 -- 172.21.15.133:0/4005527934 shutdown_connections 2023-10-08T16:09:17.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.121+0000 7fe343066700 1 -- 172.21.15.133:0/4005527934 wait complete. 2023-10-08T16:09:17.125 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 0 to deep-scrub 2023-10-08T16:09:17.135 INFO:tasks.ceph:Scrubbing osd.1 2023-10-08T16:09:17.135 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-08T16:09:17.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.249+0000 7f3405702700 1 Processor -- start 2023-10-08T16:09:17.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.249+0000 7f3405702700 1 -- start start 2023-10-08T16:09:17.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.253+0000 7f3405702700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f340006be10 0x7f340014dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.253+0000 7f3405702700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f340006d0f0 con 0x7f34000b1a30 2023-10-08T16:09:17.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.253+0000 7f3405702700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3400142640 con 0x7f340006b1d0 2023-10-08T16:09:17.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.253+0000 7f3405702700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34001423a0 con 0x7f340006be10 2023-10-08T16:09:17.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.253+0000 7f3404f01700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f340006be10 0x7f340014dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.253+0000 7f3404f01700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f340006be10 0x7f340014dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48438/0 (socket says 172.21.15.133:48438) 2023-10-08T16:09:17.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.253+0000 7f3404f01700 1 -- 172.21.15.133:0/3303893346 learned_addr learned my addr 172.21.15.133:0/3303893346 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:17.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.253+0000 7f3404f01700 1 -- 172.21.15.133:0/3303893346 >> v1:172.21.15.190:6789/0 conn(0x7f340006b1d0 legacy=0x7f3400142ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:17.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.253+0000 7f3404f01700 1 -- 172.21.15.133:0/3303893346 >> v1:172.21.15.133:6789/0 conn(0x7f34000b1a30 legacy=0x7f34000680a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.253+0000 7f3404f01700 1 -- 172.21.15.133:0/3303893346 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34000b2f40 con 0x7f340006be10 2023-10-08T16:09:17.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.253+0000 7f3404f01700 1 --2- 172.21.15.133:0/3303893346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f340006be10 0x7f340014dd50 secure :-1 s=READY pgs=4365 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009f20 tx=0x7f33f8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995444ed71a3ddf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:17.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.253+0000 7f33feffd700 1 -- 172.21.15.133:0/3303893346 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f800e070 con 0x7f340006be10 2023-10-08T16:09:17.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.253+0000 7f33feffd700 1 -- 172.21.15.133:0/3303893346 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f800ba40 con 0x7f340006be10 2023-10-08T16:09:17.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.253+0000 7f33feffd700 1 -- 172.21.15.133:0/3303893346 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f80092e0 con 0x7f340006be10 2023-10-08T16:09:17.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.253+0000 7f3405702700 1 -- 172.21.15.133:0/3303893346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f340006be10 msgr2=0x7f340014dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.253+0000 7f3405702700 1 --2- 172.21.15.133:0/3303893346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f340006be10 0x7f340014dd50 secure :-1 s=READY pgs=4365 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009f20 tx=0x7f33f8009840 comp rx=0 tx=0).stop 2023-10-08T16:09:17.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.253+0000 7f3405702700 1 -- 172.21.15.133:0/3303893346 shutdown_connections 2023-10-08T16:09:17.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.253+0000 7f3405702700 1 --2- 172.21.15.133:0/3303893346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f340006be10 0x7f340014dd50 unknown :-1 s=CLOSED pgs=4365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.253+0000 7f3405702700 1 -- 172.21.15.133:0/3303893346 >> 172.21.15.133:0/3303893346 conn(0x7f3400063670 msgr2=0x7f34000b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:17.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.253+0000 7f3405702700 1 -- 172.21.15.133:0/3303893346 shutdown_connections 2023-10-08T16:09:17.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.253+0000 7f3405702700 1 -- 172.21.15.133:0/3303893346 wait complete. 2023-10-08T16:09:17.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.253+0000 7f3405702700 1 Processor -- start 2023-10-08T16:09:17.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.257+0000 7f3405702700 1 -- start start 2023-10-08T16:09:17.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.257+0000 7f3405702700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f340006b1d0 0x7f340013d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.257+0000 7f3405702700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f340006be10 0x7f3400152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.257+0000 7f3405702700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34000b1a30 0x7f3400155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.257+0000 7f3405702700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340013fea0 con 0x7f340006be10 2023-10-08T16:09:17.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.257+0000 7f3405702700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3400152370 con 0x7f340006b1d0 2023-10-08T16:09:17.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.257+0000 7f3405702700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34000a9ab0 con 0x7f34000b1a30 2023-10-08T16:09:17.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.257+0000 7f33ff7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f340006be10 0x7f3400152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.257+0000 7f33fffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f340006b1d0 0x7f340013d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.257+0000 7f33ff7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f340006be10 0x7f3400152800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48440/0 (socket says 172.21.15.133:48440) 2023-10-08T16:09:17.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.257+0000 7f33ff7fe700 1 -- 172.21.15.133:0/117180540 learned_addr learned my addr 172.21.15.133:0/117180540 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:17.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.257+0000 7f3404f01700 1 --2- 172.21.15.133:0/117180540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34000b1a30 0x7f3400155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.257+0000 7f33ff7fe700 1 -- 172.21.15.133:0/117180540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34000b1a30 msgr2=0x7f3400155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.257+0000 7f33ff7fe700 1 --2- 172.21.15.133:0/117180540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34000b1a30 0x7f3400155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.257+0000 7f33ff7fe700 1 -- 172.21.15.133:0/117180540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f340006b1d0 msgr2=0x7f340013d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.257+0000 7f33ff7fe700 1 --2- 172.21.15.133:0/117180540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f340006b1d0 0x7f340013d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.257+0000 7f33ff7fe700 1 -- 172.21.15.133:0/117180540 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f8009ae0 con 0x7f340006be10 2023-10-08T16:09:17.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.257+0000 7f33ff7fe700 1 --2- 172.21.15.133:0/117180540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f340006be10 0x7f3400152800 secure :-1 s=READY pgs=4366 cs=0 l=1 rev1=1 crypto rx=0x7f33f000c4e0 tx=0x7f33f0007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:17.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.257+0000 7f33e7fff700 1 -- 172.21.15.133:0/117180540 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f000ce90 con 0x7f340006be10 2023-10-08T16:09:17.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.257+0000 7f33e7fff700 1 -- 172.21.15.133:0/117180540 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f0011590 con 0x7f340006be10 2023-10-08T16:09:17.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.257+0000 7f3405702700 1 -- 172.21.15.133:0/117180540 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f340013ef20 con 0x7f340006be10 2023-10-08T16:09:17.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.257+0000 7f33e7fff700 1 -- 172.21.15.133:0/117180540 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f0011950 con 0x7f340006be10 2023-10-08T16:09:17.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.257+0000 7f3405702700 1 -- 172.21.15.133:0/117180540 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f340013f2b0 con 0x7f340006be10 2023-10-08T16:09:17.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.261+0000 7f3405702700 1 -- 172.21.15.133:0/117180540 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f340004be40 con 0x7f340006be10 2023-10-08T16:09:17.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.261+0000 7f33e7fff700 1 -- 172.21.15.133:0/117180540 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f33f0011d00 con 0x7f340006be10 2023-10-08T16:09:17.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.261+0000 7f33e7fff700 1 --2- 172.21.15.133:0/117180540 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f33ec060580 0x7f33ec062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.261+0000 7f33e7fff700 1 -- 172.21.15.133:0/117180540 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f33f007bbe0 con 0x7f340006be10 2023-10-08T16:09:17.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.261+0000 7f33fffff700 1 --2- 172.21.15.133:0/117180540 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f33ec060580 0x7f33ec062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.261+0000 7f33e7fff700 1 --2- 172.21.15.133:0/117180540 >> [v2:172.21.15.133:6800/33490,v1:172.21.15.133:6801/33490] conn(0x7f33ec068780 0x7f33ec06ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.261+0000 7f33e7fff700 1 -- 172.21.15.133:0/117180540 --> [v2:172.21.15.133:6800/33490,v1:172.21.15.133:6801/33490] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f33ec06b2e0 con 0x7f33ec068780 2023-10-08T16:09:17.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.261+0000 7f33e7fff700 1 -- 172.21.15.133:0/117180540 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33f0080220 con 0x7f340006be10 2023-10-08T16:09:17.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.261+0000 7f3404f01700 1 --2- 172.21.15.133:0/117180540 >> [v2:172.21.15.133:6800/33490,v1:172.21.15.133:6801/33490] conn(0x7f33ec068780 0x7f33ec06ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.261+0000 7f33fffff700 1 --2- 172.21.15.133:0/117180540 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f33ec060580 0x7f33ec062a30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f33f4003a70 tx=0x7f33f4007ef0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:17.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.261+0000 7f3404f01700 1 --2- 172.21.15.133:0/117180540 >> [v2:172.21.15.133:6800/33490,v1:172.21.15.133:6801/33490] conn(0x7f33ec068780 0x7f33ec06ac10 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:17.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.265+0000 7f33e7fff700 1 -- 172.21.15.133:0/117180540 <== osd.1 v2:172.21.15.133:6800/33490 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f33ec06b2e0 con 0x7f33ec068780 2023-10-08T16:09:17.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.281+0000 7f3405702700 1 -- 172.21.15.133:0/117180540 --> [v2:172.21.15.133:6800/33490,v1:172.21.15.133:6801/33490] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3400068c40 con 0x7f33ec068780 2023-10-08T16:09:17.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.281+0000 7f33e7fff700 1 -- 172.21.15.133:0/117180540 <== osd.1 v2:172.21.15.133:6800/33490 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3400068c40 con 0x7f33ec068780 2023-10-08T16:09:17.285 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-10-08T16:09:17.285 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T16:09:17.285 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-10-08T16:09:17.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.281+0000 7f3405702700 1 -- 172.21.15.133:0/117180540 >> [v2:172.21.15.133:6800/33490,v1:172.21.15.133:6801/33490] conn(0x7f33ec068780 msgr2=0x7f33ec06ac10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.281+0000 7f3405702700 1 --2- 172.21.15.133:0/117180540 >> [v2:172.21.15.133:6800/33490,v1:172.21.15.133:6801/33490] conn(0x7f33ec068780 0x7f33ec06ac10 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.281+0000 7f3405702700 1 -- 172.21.15.133:0/117180540 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f33ec060580 msgr2=0x7f33ec062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.281+0000 7f3405702700 1 --2- 172.21.15.133:0/117180540 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f33ec060580 0x7f33ec062a30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f33f4003a70 tx=0x7f33f4007ef0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.281+0000 7f3405702700 1 -- 172.21.15.133:0/117180540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f340006be10 msgr2=0x7f3400152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.281+0000 7f3405702700 1 --2- 172.21.15.133:0/117180540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f340006be10 0x7f3400152800 secure :-1 s=READY pgs=4366 cs=0 l=1 rev1=1 crypto rx=0x7f33f000c4e0 tx=0x7f33f0007f00 comp rx=0 tx=0).stop 2023-10-08T16:09:17.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.281+0000 7f3404f01700 1 -- 172.21.15.133:0/117180540 reap_dead start 2023-10-08T16:09:17.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.281+0000 7f3405702700 1 -- 172.21.15.133:0/117180540 shutdown_connections 2023-10-08T16:09:17.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.281+0000 7f3405702700 1 -- 172.21.15.133:0/117180540 >> 172.21.15.133:0/117180540 conn(0x7f3400063670 msgr2=0x7f3400141190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:17.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.281+0000 7f3405702700 1 -- 172.21.15.133:0/117180540 shutdown_connections 2023-10-08T16:09:17.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.281+0000 7f3405702700 1 -- 172.21.15.133:0/117180540 wait complete. 2023-10-08T16:09:17.303 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-08T16:09:17.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.409+0000 7f9a198cd700 1 Processor -- start 2023-10-08T16:09:17.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.409+0000 7f9a198cd700 1 -- start start 2023-10-08T16:09:17.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.409+0000 7f9a198cd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9a14142d90 0x7f9a1413bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.409+0000 7f9a198cd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a140b43c0 0x7f9a1413c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.409+0000 7f9a198cd700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a140b4fd0 con 0x7f9a140634e0 2023-10-08T16:09:17.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.409+0000 7f9a198cd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1413c9f0 con 0x7f9a14142d90 2023-10-08T16:09:17.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.409+0000 7f9a198cd700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a140b18e0 con 0x7f9a140b43c0 2023-10-08T16:09:17.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.409+0000 7f9a13fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9a14142d90 0x7f9a1413bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.409+0000 7f9a13fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9a14142d90 0x7f9a1413bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48442/0 (socket says 172.21.15.133:48442) 2023-10-08T16:09:17.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.409+0000 7f9a13fff700 1 -- 172.21.15.133:0/582386232 learned_addr learned my addr 172.21.15.133:0/582386232 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:17.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.409+0000 7f9a190cc700 1 --2- 172.21.15.133:0/582386232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a140b43c0 0x7f9a1413c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.409+0000 7f9a13fff700 1 -- 172.21.15.133:0/582386232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a140b43c0 msgr2=0x7f9a1413c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:17.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.409+0000 7f9a13fff700 1 --2- 172.21.15.133:0/582386232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a140b43c0 0x7f9a1413c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.409+0000 7f9a13fff700 1 -- 172.21.15.133:0/582386232 >> v1:172.21.15.190:6789/0 conn(0x7f9a140634e0 legacy=0x7f9a14142680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.409+0000 7f9a13fff700 1 -- 172.21.15.133:0/582386232 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a140b4980 con 0x7f9a14142d90 2023-10-08T16:09:17.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.409+0000 7f9a13fff700 1 --2- 172.21.15.133:0/582386232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a14142d90 0x7f9a1413bf70 secure :-1 s=READY pgs=4367 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0099b0 tx=0x7f99fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c837e2927932a67 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:17.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.409+0000 7f9a137fe700 1 -- 172.21.15.133:0/582386232 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc00b860 con 0x7f9a14142d90 2023-10-08T16:09:17.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.409+0000 7f9a137fe700 1 -- 172.21.15.133:0/582386232 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc00b9c0 con 0x7f9a14142d90 2023-10-08T16:09:17.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.409+0000 7f9a137fe700 1 -- 172.21.15.133:0/582386232 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc00bd80 con 0x7f9a14142d90 2023-10-08T16:09:17.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.413+0000 7f9a198cd700 1 -- 172.21.15.133:0/582386232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a14142d90 msgr2=0x7f9a1413bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.413+0000 7f9a198cd700 1 --2- 172.21.15.133:0/582386232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a14142d90 0x7f9a1413bf70 secure :-1 s=READY pgs=4367 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0099b0 tx=0x7f99fc009250 comp rx=0 tx=0).stop 2023-10-08T16:09:17.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.413+0000 7f9a198cd700 1 -- 172.21.15.133:0/582386232 shutdown_connections 2023-10-08T16:09:17.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.413+0000 7f9a198cd700 1 --2- 172.21.15.133:0/582386232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a140b43c0 0x7f9a1413c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.413+0000 7f9a198cd700 1 --2- 172.21.15.133:0/582386232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a14142d90 0x7f9a1413bf70 unknown :-1 s=CLOSED pgs=4367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.413+0000 7f9a198cd700 1 -- 172.21.15.133:0/582386232 >> 172.21.15.133:0/582386232 conn(0x7f9a14067ca0 msgr2=0x7f9a14062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:17.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.413+0000 7f9a198cd700 1 -- 172.21.15.133:0/582386232 shutdown_connections 2023-10-08T16:09:17.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.413+0000 7f9a198cd700 1 -- 172.21.15.133:0/582386232 wait complete. 2023-10-08T16:09:17.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.413+0000 7f9a198cd700 1 Processor -- start 2023-10-08T16:09:17.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.413+0000 7f9a198cd700 1 -- start start 2023-10-08T16:09:17.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.417+0000 7f9a198cd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a140634e0 0x7f9a14155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.417+0000 7f9a198cd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a140b43c0 0x7f9a14145690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.417+0000 7f9a198cd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a14142d90 0x7f9a14145bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.417+0000 7f9a198cd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a14144c00 con 0x7f9a140b43c0 2023-10-08T16:09:17.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.417+0000 7f9a198cd700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a140a6840 con 0x7f9a140634e0 2023-10-08T16:09:17.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.417+0000 7f9a198cd700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a141451b0 con 0x7f9a14142d90 2023-10-08T16:09:17.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.417+0000 7f9a13fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a140b43c0 0x7f9a14145690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.417+0000 7f9a13fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a140b43c0 0x7f9a14145690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48452/0 (socket says 172.21.15.133:48452) 2023-10-08T16:09:17.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.417+0000 7f9a13fff700 1 -- 172.21.15.133:0/711291578 learned_addr learned my addr 172.21.15.133:0/711291578 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:17.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.417+0000 7f9a188cb700 1 --2- 172.21.15.133:0/711291578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a140634e0 0x7f9a14155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.417+0000 7f9a190cc700 1 --2- 172.21.15.133:0/711291578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a14142d90 0x7f9a14145bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.417+0000 7f9a13fff700 1 -- 172.21.15.133:0/711291578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a14142d90 msgr2=0x7f9a14145bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.417+0000 7f9a13fff700 1 --2- 172.21.15.133:0/711291578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a14142d90 0x7f9a14145bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.417+0000 7f9a13fff700 1 -- 172.21.15.133:0/711291578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a140634e0 msgr2=0x7f9a14155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.417+0000 7f9a13fff700 1 --2- 172.21.15.133:0/711291578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a140634e0 0x7f9a14155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.417+0000 7f9a13fff700 1 -- 172.21.15.133:0/711291578 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc0094f0 con 0x7f9a140b43c0 2023-10-08T16:09:17.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.417+0000 7f9a190cc700 1 --2- 172.21.15.133:0/711291578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a14142d90 0x7f9a14145bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:17.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.417+0000 7f9a188cb700 1 --2- 172.21.15.133:0/711291578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a140634e0 0x7f9a14155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:17.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.417+0000 7f9a13fff700 1 --2- 172.21.15.133:0/711291578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a140b43c0 0x7f9a14145690 secure :-1 s=READY pgs=4368 cs=0 l=1 rev1=1 crypto rx=0x7f99fc006fd0 tx=0x7f99fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:17.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.417+0000 7f9a10ff9700 1 -- 172.21.15.133:0/711291578 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc020070 con 0x7f9a140b43c0 2023-10-08T16:09:17.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.417+0000 7f9a10ff9700 1 -- 172.21.15.133:0/711291578 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc011cc0 con 0x7f9a140b43c0 2023-10-08T16:09:17.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.417+0000 7f9a10ff9700 1 -- 172.21.15.133:0/711291578 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc01a670 con 0x7f9a140b43c0 2023-10-08T16:09:17.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.417+0000 7f9a198cd700 1 -- 172.21.15.133:0/711291578 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a1413f6f0 con 0x7f9a140b43c0 2023-10-08T16:09:17.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.417+0000 7f9a198cd700 1 -- 172.21.15.133:0/711291578 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a14155f60 con 0x7f9a140b43c0 2023-10-08T16:09:17.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.417+0000 7f9a198cd700 1 -- 172.21.15.133:0/711291578 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a14145370 con 0x7f9a140b43c0 2023-10-08T16:09:17.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.421+0000 7f9a10ff9700 1 -- 172.21.15.133:0/711291578 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f99fc01aa20 con 0x7f9a140b43c0 2023-10-08T16:09:17.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.421+0000 7f9a10ff9700 1 --2- 172.21.15.133:0/711291578 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f99f4060550 0x7f99f4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.421+0000 7f9a10ff9700 1 -- 172.21.15.133:0/711291578 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f99fc07d3a0 con 0x7f9a140b43c0 2023-10-08T16:09:17.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.421+0000 7f9a188cb700 1 --2- 172.21.15.133:0/711291578 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f99f4060550 0x7f99f4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.421+0000 7f9a188cb700 1 --2- 172.21.15.133:0/711291578 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f99f4060550 0x7f99f4062a00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9a04007fd0 tx=0x7f9a04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:17.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.425+0000 7f9a10ff9700 1 -- 172.21.15.133:0/711291578 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f99fc04d980 con 0x7f9a140b43c0 2023-10-08T16:09:17.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.589+0000 7f9a198cd700 1 -- 172.21.15.133:0/711291578 --> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a1404be40 con 0x7f99f4060550 2023-10-08T16:09:17.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.589+0000 7f9a10ff9700 1 -- 172.21.15.133:0/711291578 <== mgr.4104 v2:172.21.15.133:6832/33362 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9a1404be40 con 0x7f99f4060550 2023-10-08T16:09:17.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.593+0000 7f9a198cd700 1 -- 172.21.15.133:0/711291578 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f99f4060550 msgr2=0x7f99f4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.593+0000 7f9a198cd700 1 --2- 172.21.15.133:0/711291578 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f99f4060550 0x7f99f4062a00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9a04007fd0 tx=0x7f9a04009040 comp rx=0 tx=0).stop 2023-10-08T16:09:17.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.593+0000 7f9a198cd700 1 -- 172.21.15.133:0/711291578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a140b43c0 msgr2=0x7f9a14145690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.593+0000 7f9a198cd700 1 --2- 172.21.15.133:0/711291578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a140b43c0 0x7f9a14145690 secure :-1 s=READY pgs=4368 cs=0 l=1 rev1=1 crypto rx=0x7f99fc006fd0 tx=0x7f99fc017000 comp rx=0 tx=0).stop 2023-10-08T16:09:17.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.593+0000 7f9a198cd700 1 -- 172.21.15.133:0/711291578 shutdown_connections 2023-10-08T16:09:17.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.593+0000 7f9a198cd700 1 --2- 172.21.15.133:0/711291578 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f99f4060550 0x7f99f4062a00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.593+0000 7f9a198cd700 1 --2- 172.21.15.133:0/711291578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a14142d90 0x7f9a14145bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.593+0000 7f9a198cd700 1 --2- 172.21.15.133:0/711291578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a140b43c0 0x7f9a14145690 unknown :-1 s=CLOSED pgs=4368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.593+0000 7f9a198cd700 1 --2- 172.21.15.133:0/711291578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a140634e0 0x7f9a14155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.593+0000 7f9a198cd700 1 -- 172.21.15.133:0/711291578 >> 172.21.15.133:0/711291578 conn(0x7f9a14067ca0 msgr2=0x7f9a1413a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:17.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.593+0000 7f9a198cd700 1 -- 172.21.15.133:0/711291578 shutdown_connections 2023-10-08T16:09:17.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.593+0000 7f9a198cd700 1 -- 172.21.15.133:0/711291578 wait complete. 2023-10-08T16:09:17.598 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 1 to deep-scrub 2023-10-08T16:09:17.608 INFO:tasks.ceph:Scrubbing osd.2 2023-10-08T16:09:17.609 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-08T16:09:17.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.717+0000 7fb26759e700 1 Processor -- start 2023-10-08T16:09:17.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.717+0000 7fb26759e700 1 -- start start 2023-10-08T16:09:17.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.717+0000 7fb26759e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb268145a00 0x7fb268145e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.717+0000 7fb26759e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb26813c130 0x7fb26813c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.717+0000 7fb26759e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2680b4fa0 con 0x7fb2680634e0 2023-10-08T16:09:17.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.717+0000 7fb26759e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2680b1d10 con 0x7fb268145a00 2023-10-08T16:09:17.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.717+0000 7fb26759e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb268146370 con 0x7fb26813c130 2023-10-08T16:09:17.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.717+0000 7fb265d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb268145a00 0x7fb268145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.717+0000 7fb26659c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb2680634e0 0x7fb2680b0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56342/0 (socket says 172.21.15.133:56342) 2023-10-08T16:09:17.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.717+0000 7fb26659c700 1 -- 172.21.15.133:0/4048982366 learned_addr learned my addr 172.21.15.133:0/4048982366 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:09:17.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.717+0000 7fb266d9d700 1 --2- 172.21.15.133:0/4048982366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb26813c130 0x7fb26813c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.721+0000 7fb265d9b700 1 -- 172.21.15.133:0/4048982366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb26813c130 msgr2=0x7fb26813c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:17.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.721+0000 7fb265d9b700 1 --2- 172.21.15.133:0/4048982366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb26813c130 0x7fb26813c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.721+0000 7fb265d9b700 1 -- 172.21.15.133:0/4048982366 >> v1:172.21.15.133:6789/0 conn(0x7fb2680634e0 legacy=0x7fb2680b0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.721+0000 7fb26559a700 1 -- 172.21.15.133:0/4048982366 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2055141141 0 0) 0x7fb2680b4fa0 con 0x7fb2680634e0 2023-10-08T16:09:17.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.721+0000 7fb265d9b700 1 -- 172.21.15.133:0/4048982366 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2680b4950 con 0x7fb268145a00 2023-10-08T16:09:17.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.721+0000 7fb265d9b700 1 --2- 172.21.15.133:0/4048982366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb268145a00 0x7fb268145e30 secure :-1 s=READY pgs=4370 cs=0 l=1 rev1=1 crypto rx=0x7fb2580098e0 tx=0x7fb2580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a0e9cc242ab498 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:17.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.721+0000 7fb26559a700 1 -- 172.21.15.133:0/4048982366 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25800b640 con 0x7fb268145a00 2023-10-08T16:09:17.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.721+0000 7fb26559a700 1 -- 172.21.15.133:0/4048982366 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25800b7a0 con 0x7fb268145a00 2023-10-08T16:09:17.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.721+0000 7fb26559a700 1 -- 172.21.15.133:0/4048982366 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25800bb40 con 0x7fb268145a00 2023-10-08T16:09:17.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.721+0000 7fb26759e700 1 -- 172.21.15.133:0/4048982366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb268145a00 msgr2=0x7fb268145e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.721+0000 7fb26759e700 1 --2- 172.21.15.133:0/4048982366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb268145a00 0x7fb268145e30 secure :-1 s=READY pgs=4370 cs=0 l=1 rev1=1 crypto rx=0x7fb2580098e0 tx=0x7fb2580091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.721+0000 7fb26759e700 1 -- 172.21.15.133:0/4048982366 shutdown_connections 2023-10-08T16:09:17.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.721+0000 7fb26759e700 1 --2- 172.21.15.133:0/4048982366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb26813c130 0x7fb26813c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.721+0000 7fb26759e700 1 --2- 172.21.15.133:0/4048982366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb268145a00 0x7fb268145e30 unknown :-1 s=CLOSED pgs=4370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.721+0000 7fb26759e700 1 -- 172.21.15.133:0/4048982366 >> 172.21.15.133:0/4048982366 conn(0x7fb268066f90 msgr2=0x7fb268062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:17.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.721+0000 7fb26759e700 1 -- 172.21.15.133:0/4048982366 shutdown_connections 2023-10-08T16:09:17.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.721+0000 7fb26759e700 1 -- 172.21.15.133:0/4048982366 wait complete. 2023-10-08T16:09:17.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.725+0000 7fb26759e700 1 Processor -- start 2023-10-08T16:09:17.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.725+0000 7fb26759e700 1 -- start start 2023-10-08T16:09:17.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.725+0000 7fb26759e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2680634e0 0x7fb26813d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.725+0000 7fb26759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb26813c130 0x7fb268151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.725+0000 7fb26759e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb268145a00 0x7fb268152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.725+0000 7fb26759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26813fdb0 con 0x7fb26813c130 2023-10-08T16:09:17.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.725+0000 7fb26759e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26813e1b0 con 0x7fb2680634e0 2023-10-08T16:09:17.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.725+0000 7fb26759e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2680a56d0 con 0x7fb268145a00 2023-10-08T16:09:17.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.725+0000 7fb265d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb26813c130 0x7fb268151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.725+0000 7fb265d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb26813c130 0x7fb268151f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48472/0 (socket says 172.21.15.133:48472) 2023-10-08T16:09:17.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.725+0000 7fb265d9b700 1 -- 172.21.15.133:0/2531014294 learned_addr learned my addr 172.21.15.133:0/2531014294 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:17.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.725+0000 7fb266d9d700 1 --2- 172.21.15.133:0/2531014294 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb268145a00 0x7fb268152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.725+0000 7fb26659c700 1 --2- 172.21.15.133:0/2531014294 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2680634e0 0x7fb26813d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.725+0000 7fb265d9b700 1 -- 172.21.15.133:0/2531014294 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb268145a00 msgr2=0x7fb268152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.725+0000 7fb265d9b700 1 --2- 172.21.15.133:0/2531014294 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb268145a00 0x7fb268152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.725+0000 7fb265d9b700 1 -- 172.21.15.133:0/2531014294 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2680634e0 msgr2=0x7fb26813d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.725+0000 7fb265d9b700 1 --2- 172.21.15.133:0/2531014294 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2680634e0 0x7fb26813d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.725+0000 7fb265d9b700 1 -- 172.21.15.133:0/2531014294 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb258009420 con 0x7fb26813c130 2023-10-08T16:09:17.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.725+0000 7fb265d9b700 1 --2- 172.21.15.133:0/2531014294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb26813c130 0x7fb268151f50 secure :-1 s=READY pgs=4371 cs=0 l=1 rev1=1 crypto rx=0x7fb2580093f0 tx=0x7fb258017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:17.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.725+0000 7fb2567fc700 1 -- 172.21.15.133:0/2531014294 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25800bb20 con 0x7fb26813c130 2023-10-08T16:09:17.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.725+0000 7fb2567fc700 1 -- 172.21.15.133:0/2531014294 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb258000c90 con 0x7fb26813c130 2023-10-08T16:09:17.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.725+0000 7fb26759e700 1 -- 172.21.15.133:0/2531014294 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb268142e10 con 0x7fb26813c130 2023-10-08T16:09:17.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.725+0000 7fb2567fc700 1 -- 172.21.15.133:0/2531014294 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258011670 con 0x7fb26813c130 2023-10-08T16:09:17.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.725+0000 7fb26759e700 1 -- 172.21.15.133:0/2531014294 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26813e910 con 0x7fb26813c130 2023-10-08T16:09:17.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.725+0000 7fb26759e700 1 -- 172.21.15.133:0/2531014294 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb26804be40 con 0x7fb26813c130 2023-10-08T16:09:17.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.729+0000 7fb2567fc700 1 -- 172.21.15.133:0/2531014294 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb258011a20 con 0x7fb26813c130 2023-10-08T16:09:17.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.729+0000 7fb2567fc700 1 --2- 172.21.15.133:0/2531014294 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb248060550 0x7fb248062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.729+0000 7fb2567fc700 1 -- 172.21.15.133:0/2531014294 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fb25807e3b0 con 0x7fb26813c130 2023-10-08T16:09:17.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.729+0000 7fb26659c700 1 --2- 172.21.15.133:0/2531014294 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb248060550 0x7fb248062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.729+0000 7fb2567fc700 1 --2- 172.21.15.133:0/2531014294 >> [v2:172.21.15.133:6824/33492,v1:172.21.15.133:6825/33492] conn(0x7fb248068940 0x7fb24806add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.729+0000 7fb2567fc700 1 -- 172.21.15.133:0/2531014294 --> [v2:172.21.15.133:6824/33492,v1:172.21.15.133:6825/33492] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb24806b4a0 con 0x7fb248068940 2023-10-08T16:09:17.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.729+0000 7fb2567fc700 1 -- 172.21.15.133:0/2531014294 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb25807e780 con 0x7fb26813c130 2023-10-08T16:09:17.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.729+0000 7fb266d9d700 1 --2- 172.21.15.133:0/2531014294 >> [v2:172.21.15.133:6824/33492,v1:172.21.15.133:6825/33492] conn(0x7fb248068940 0x7fb24806add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.729+0000 7fb26659c700 1 --2- 172.21.15.133:0/2531014294 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb248060550 0x7fb248062a00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb2680b6ec0 tx=0x7fb25c007f50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:17.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.729+0000 7fb266d9d700 1 --2- 172.21.15.133:0/2531014294 >> [v2:172.21.15.133:6824/33492,v1:172.21.15.133:6825/33492] conn(0x7fb248068940 0x7fb24806add0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:17.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.729+0000 7fb2567fc700 1 -- 172.21.15.133:0/2531014294 <== osd.2 v2:172.21.15.133:6824/33492 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb24806b4a0 con 0x7fb248068940 2023-10-08T16:09:17.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.745+0000 7fb26759e700 1 -- 172.21.15.133:0/2531014294 --> [v2:172.21.15.133:6824/33492,v1:172.21.15.133:6825/33492] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb26813e3c0 con 0x7fb248068940 2023-10-08T16:09:17.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.745+0000 7fb2567fc700 1 -- 172.21.15.133:0/2531014294 <== osd.2 v2:172.21.15.133:6824/33492 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb26813e3c0 con 0x7fb248068940 2023-10-08T16:09:17.749 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-10-08T16:09:17.749 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T16:09:17.749 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-10-08T16:09:17.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.745+0000 7fb26759e700 1 -- 172.21.15.133:0/2531014294 >> [v2:172.21.15.133:6824/33492,v1:172.21.15.133:6825/33492] conn(0x7fb248068940 msgr2=0x7fb24806add0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.745+0000 7fb26759e700 1 --2- 172.21.15.133:0/2531014294 >> [v2:172.21.15.133:6824/33492,v1:172.21.15.133:6825/33492] conn(0x7fb248068940 0x7fb24806add0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.745+0000 7fb26759e700 1 -- 172.21.15.133:0/2531014294 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb248060550 msgr2=0x7fb248062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.745+0000 7fb26759e700 1 --2- 172.21.15.133:0/2531014294 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb248060550 0x7fb248062a00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb2680b6ec0 tx=0x7fb25c007f50 comp rx=0 tx=0).stop 2023-10-08T16:09:17.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.745+0000 7fb26759e700 1 -- 172.21.15.133:0/2531014294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb26813c130 msgr2=0x7fb268151f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.745+0000 7fb26759e700 1 --2- 172.21.15.133:0/2531014294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb26813c130 0x7fb268151f50 secure :-1 s=READY pgs=4371 cs=0 l=1 rev1=1 crypto rx=0x7fb2580093f0 tx=0x7fb258017000 comp rx=0 tx=0).stop 2023-10-08T16:09:17.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.745+0000 7fb266d9d700 1 -- 172.21.15.133:0/2531014294 reap_dead start 2023-10-08T16:09:17.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.745+0000 7fb26759e700 1 -- 172.21.15.133:0/2531014294 shutdown_connections 2023-10-08T16:09:17.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.745+0000 7fb26759e700 1 -- 172.21.15.133:0/2531014294 >> 172.21.15.133:0/2531014294 conn(0x7fb268066f90 msgr2=0x7fb268062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:17.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.745+0000 7fb26759e700 1 -- 172.21.15.133:0/2531014294 shutdown_connections 2023-10-08T16:09:17.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.745+0000 7fb26759e700 1 -- 172.21.15.133:0/2531014294 wait complete. 2023-10-08T16:09:17.760 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-08T16:09:17.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af359e700 1 Processor -- start 2023-10-08T16:09:17.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af359e700 1 -- start start 2023-10-08T16:09:17.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4af40ae620 0x7f4af4142880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af359e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4af4142dc0 0x7f4af41431d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af359e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af40aaf50 con 0x7f4af40b1dc0 2023-10-08T16:09:17.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af359e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af4146240 con 0x7f4af40ae620 2023-10-08T16:09:17.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af359e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af4143710 con 0x7f4af4142dc0 2023-10-08T16:09:17.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af1d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4af40ae620 0x7f4af4142880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af1d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4af40ae620 0x7f4af4142880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48474/0 (socket says 172.21.15.133:48474) 2023-10-08T16:09:17.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af259c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4af40b1dc0 0x7f4af4145b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56346/0 (socket says 172.21.15.133:56346) 2023-10-08T16:09:17.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af1d9b700 1 -- 172.21.15.133:0/1616753341 learned_addr learned my addr 172.21.15.133:0/1616753341 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:17.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af2d9d700 1 --2- 172.21.15.133:0/1616753341 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4af4142dc0 0x7f4af41431d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af1d9b700 1 -- 172.21.15.133:0/1616753341 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4af4142dc0 msgr2=0x7f4af41431d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:17.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af1d9b700 1 --2- 172.21.15.133:0/1616753341 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4af4142dc0 0x7f4af41431d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af1d9b700 1 -- 172.21.15.133:0/1616753341 >> v1:172.21.15.133:6789/0 conn(0x7f4af40b1dc0 legacy=0x7f4af4145b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af1d9b700 1 -- 172.21.15.133:0/1616753341 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af40aec00 con 0x7f4af40ae620 2023-10-08T16:09:17.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af2d9d700 1 --2- 172.21.15.133:0/1616753341 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4af4142dc0 0x7f4af41431d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:17.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af1d9b700 1 --2- 172.21.15.133:0/1616753341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af40ae620 0x7f4af4142880 secure :-1 s=READY pgs=4373 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009f50 tx=0x7f4aec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c1f1ba6ec26ce8c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:17.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af159a700 1 -- 172.21.15.133:0/1616753341 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec00e070 con 0x7f4af40ae620 2023-10-08T16:09:17.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af159a700 1 -- 172.21.15.133:0/1616753341 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aec00ba70 con 0x7f4af40ae620 2023-10-08T16:09:17.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af159a700 1 -- 172.21.15.133:0/1616753341 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0092e0 con 0x7f4af40ae620 2023-10-08T16:09:17.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af359e700 1 -- 172.21.15.133:0/1616753341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af40ae620 msgr2=0x7f4af4142880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af359e700 1 --2- 172.21.15.133:0/1616753341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af40ae620 0x7f4af4142880 secure :-1 s=READY pgs=4373 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009f50 tx=0x7f4aec009840 comp rx=0 tx=0).stop 2023-10-08T16:09:17.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af359e700 1 -- 172.21.15.133:0/1616753341 shutdown_connections 2023-10-08T16:09:17.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af359e700 1 --2- 172.21.15.133:0/1616753341 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4af4142dc0 0x7f4af41431d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af359e700 1 --2- 172.21.15.133:0/1616753341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af40ae620 0x7f4af4142880 unknown :-1 s=CLOSED pgs=4373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af359e700 1 -- 172.21.15.133:0/1616753341 >> 172.21.15.133:0/1616753341 conn(0x7f4af4063670 msgr2=0x7f4af40b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:17.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af359e700 1 -- 172.21.15.133:0/1616753341 shutdown_connections 2023-10-08T16:09:17.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.869+0000 7f4af359e700 1 -- 172.21.15.133:0/1616753341 wait complete. 2023-10-08T16:09:17.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.873+0000 7f4af359e700 1 Processor -- start 2023-10-08T16:09:17.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.873+0000 7f4af359e700 1 -- start start 2023-10-08T16:09:17.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.873+0000 7f4af359e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4af40ae620 0x7f4af41552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.873+0000 7f4af359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af40b1dc0 0x7f4af41447b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.873+0000 7f4af359e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4af4142dc0 0x7f4af40b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.873+0000 7f4af359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af40b2ae0 con 0x7f4af40b1dc0 2023-10-08T16:09:17.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.873+0000 7f4af359e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af40b27b0 con 0x7f4af40ae620 2023-10-08T16:09:17.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.873+0000 7f4af359e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af40b5290 con 0x7f4af4142dc0 2023-10-08T16:09:17.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.873+0000 7f4af1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af40b1dc0 0x7f4af41447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.873+0000 7f4af1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af40b1dc0 0x7f4af41447b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48488/0 (socket says 172.21.15.133:48488) 2023-10-08T16:09:17.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.873+0000 7f4af1d9b700 1 -- 172.21.15.133:0/1342157485 learned_addr learned my addr 172.21.15.133:0/1342157485 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:17.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.873+0000 7f4af259c700 1 --2- 172.21.15.133:0/1342157485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4af40ae620 0x7f4af41552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.873+0000 7f4af2d9d700 1 --2- 172.21.15.133:0/1342157485 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4af4142dc0 0x7f4af40b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.873+0000 7f4af1d9b700 1 -- 172.21.15.133:0/1342157485 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4af4142dc0 msgr2=0x7f4af40b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.873+0000 7f4af1d9b700 1 --2- 172.21.15.133:0/1342157485 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4af4142dc0 0x7f4af40b2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.873+0000 7f4af1d9b700 1 -- 172.21.15.133:0/1342157485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4af40ae620 msgr2=0x7f4af41552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.873+0000 7f4af1d9b700 1 --2- 172.21.15.133:0/1342157485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4af40ae620 0x7f4af41552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.873+0000 7f4af1d9b700 1 -- 172.21.15.133:0/1342157485 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aec009ae0 con 0x7f4af40b1dc0 2023-10-08T16:09:17.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.873+0000 7f4af259c700 1 --2- 172.21.15.133:0/1342157485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4af40ae620 0x7f4af41552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:17.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.873+0000 7f4af2d9d700 1 --2- 172.21.15.133:0/1342157485 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4af4142dc0 0x7f4af40b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:17.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.873+0000 7f4af1d9b700 1 --2- 172.21.15.133:0/1342157485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af40b1dc0 0x7f4af41447b0 secure :-1 s=READY pgs=4374 cs=0 l=1 rev1=1 crypto rx=0x7f4aec00b770 tx=0x7f4aec018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:17.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.877+0000 7f4ae27fc700 1 -- 172.21.15.133:0/1342157485 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec007190 con 0x7f4af40b1dc0 2023-10-08T16:09:17.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.877+0000 7f4ae27fc700 1 -- 172.21.15.133:0/1342157485 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aec007920 con 0x7f4af40b1dc0 2023-10-08T16:09:17.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.877+0000 7f4ae27fc700 1 -- 172.21.15.133:0/1342157485 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec007ce0 con 0x7f4af40b1dc0 2023-10-08T16:09:17.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.877+0000 7f4af359e700 1 -- 172.21.15.133:0/1342157485 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af40b4350 con 0x7f4af40b1dc0 2023-10-08T16:09:17.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.877+0000 7f4af359e700 1 -- 172.21.15.133:0/1342157485 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af406d330 con 0x7f4af40b1dc0 2023-10-08T16:09:17.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.877+0000 7f4af359e700 1 -- 172.21.15.133:0/1342157485 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af40b2c90 con 0x7f4af40b1dc0 2023-10-08T16:09:17.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.877+0000 7f4ae27fc700 1 -- 172.21.15.133:0/1342157485 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4aec026670 con 0x7f4af40b1dc0 2023-10-08T16:09:17.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.877+0000 7f4ae27fc700 1 --2- 172.21.15.133:0/1342157485 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f4ad4060580 0x7f4ad4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.877+0000 7f4ae27fc700 1 -- 172.21.15.133:0/1342157485 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f4aec07e550 con 0x7f4af40b1dc0 2023-10-08T16:09:17.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.877+0000 7f4af259c700 1 --2- 172.21.15.133:0/1342157485 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f4ad4060580 0x7f4ad4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.881+0000 7f4af259c700 1 --2- 172.21.15.133:0/1342157485 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f4ad4060580 0x7f4ad4062a30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8007fd0 tx=0x7f4ae8007d90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:17.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:17.885+0000 7f4ae27fc700 1 -- 172.21.15.133:0/1342157485 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4af40b2c90 con 0x7f4af40b1dc0 2023-10-08T16:09:18.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.045+0000 7f4af359e700 1 -- 172.21.15.133:0/1342157485 --> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f4af40b4170 con 0x7f4ad4060580 2023-10-08T16:09:18.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.049+0000 7f4ae27fc700 1 -- 172.21.15.133:0/1342157485 <== mgr.4104 v2:172.21.15.133:6832/33362 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4af40b4170 con 0x7f4ad4060580 2023-10-08T16:09:18.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.049+0000 7f4af359e700 1 -- 172.21.15.133:0/1342157485 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f4ad4060580 msgr2=0x7f4ad4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.049+0000 7f4af359e700 1 --2- 172.21.15.133:0/1342157485 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f4ad4060580 0x7f4ad4062a30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8007fd0 tx=0x7f4ae8007d90 comp rx=0 tx=0).stop 2023-10-08T16:09:18.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.049+0000 7f4af359e700 1 -- 172.21.15.133:0/1342157485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af40b1dc0 msgr2=0x7f4af41447b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.049+0000 7f4af359e700 1 --2- 172.21.15.133:0/1342157485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af40b1dc0 0x7f4af41447b0 secure :-1 s=READY pgs=4374 cs=0 l=1 rev1=1 crypto rx=0x7f4aec00b770 tx=0x7f4aec018000 comp rx=0 tx=0).stop 2023-10-08T16:09:18.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.049+0000 7f4af359e700 1 -- 172.21.15.133:0/1342157485 shutdown_connections 2023-10-08T16:09:18.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.049+0000 7f4af359e700 1 --2- 172.21.15.133:0/1342157485 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f4ad4060580 0x7f4ad4062a30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.049+0000 7f4af359e700 1 --2- 172.21.15.133:0/1342157485 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4af4142dc0 0x7f4af40b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.049+0000 7f4af359e700 1 --2- 172.21.15.133:0/1342157485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af40b1dc0 0x7f4af41447b0 unknown :-1 s=CLOSED pgs=4374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.049+0000 7f4af359e700 1 --2- 172.21.15.133:0/1342157485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4af40ae620 0x7f4af41552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.049+0000 7f4af359e700 1 -- 172.21.15.133:0/1342157485 >> 172.21.15.133:0/1342157485 conn(0x7f4af4063670 msgr2=0x7f4af4142430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:18.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.049+0000 7f4af359e700 1 -- 172.21.15.133:0/1342157485 shutdown_connections 2023-10-08T16:09:18.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.049+0000 7f4af359e700 1 -- 172.21.15.133:0/1342157485 wait complete. 2023-10-08T16:09:18.055 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 2 to deep-scrub 2023-10-08T16:09:18.070 INFO:tasks.ceph:Scrubbing osd.3 2023-10-08T16:09:18.070 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-08T16:09:18.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.181+0000 7f969149b700 1 Processor -- start 2023-10-08T16:09:18.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.181+0000 7f969149b700 1 -- start start 2023-10-08T16:09:18.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.181+0000 7f969149b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f968c0b19e0 0x7f968c13d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.181+0000 7f969149b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f968c143230 con 0x7f968c13d5b0 2023-10-08T16:09:18.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.181+0000 7f969149b700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f968c06b060 con 0x7f968c1426c0 2023-10-08T16:09:18.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.181+0000 7f969149b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968c13d9a0 con 0x7f968c0b19e0 2023-10-08T16:09:18.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.181+0000 7f968bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f968c0b19e0 0x7f968c13d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.181+0000 7f968bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f968c0b19e0 0x7f968c13d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48500/0 (socket says 172.21.15.133:48500) 2023-10-08T16:09:18.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.181+0000 7f968bfff700 1 -- 172.21.15.133:0/2645037205 learned_addr learned my addr 172.21.15.133:0/2645037205 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:18.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.181+0000 7f9690c9a700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f968c13d5b0 0x7f968c139160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56356/0 (socket says 172.21.15.133:56356) 2023-10-08T16:09:18.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.181+0000 7f968bfff700 1 -- 172.21.15.133:0/2645037205 >> v1:172.21.15.190:6789/0 conn(0x7f968c1426c0 legacy=0x7f968c138a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.181+0000 7f968bfff700 1 -- 172.21.15.133:0/2645037205 >> v1:172.21.15.133:6789/0 conn(0x7f968c13d5b0 legacy=0x7f968c139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.181+0000 7f968affd700 1 -- 172.21.15.133:0/2645037205 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671143972 0 0) 0x7f968c06b060 con 0x7f968c1426c0 2023-10-08T16:09:18.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.181+0000 7f968bfff700 1 -- 172.21.15.133:0/2645037205 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968c139870 con 0x7f968c0b19e0 2023-10-08T16:09:18.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.181+0000 7f968bfff700 1 --2- 172.21.15.133:0/2645037205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f968c0b19e0 0x7f968c13d070 secure :-1 s=READY pgs=4376 cs=0 l=1 rev1=1 crypto rx=0x7f96740099b0 tx=0x7f9674009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf34d79a8fd476c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:18.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.181+0000 7f968affd700 1 -- 172.21.15.133:0/2645037205 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967400b760 con 0x7f968c0b19e0 2023-10-08T16:09:18.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.181+0000 7f968affd700 1 -- 172.21.15.133:0/2645037205 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967400b8c0 con 0x7f968c0b19e0 2023-10-08T16:09:18.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.181+0000 7f968affd700 1 -- 172.21.15.133:0/2645037205 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967400bc80 con 0x7f968c0b19e0 2023-10-08T16:09:18.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.185+0000 7f969149b700 1 -- 172.21.15.133:0/2645037205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f968c0b19e0 msgr2=0x7f968c13d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.185+0000 7f969149b700 1 --2- 172.21.15.133:0/2645037205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f968c0b19e0 0x7f968c13d070 secure :-1 s=READY pgs=4376 cs=0 l=1 rev1=1 crypto rx=0x7f96740099b0 tx=0x7f9674009250 comp rx=0 tx=0).stop 2023-10-08T16:09:18.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.185+0000 7f969149b700 1 -- 172.21.15.133:0/2645037205 shutdown_connections 2023-10-08T16:09:18.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.185+0000 7f969149b700 1 --2- 172.21.15.133:0/2645037205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f968c0b19e0 0x7f968c13d070 unknown :-1 s=CLOSED pgs=4376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.185+0000 7f969149b700 1 -- 172.21.15.133:0/2645037205 >> 172.21.15.133:0/2645037205 conn(0x7f968c062ba0 msgr2=0x7f968c062fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:18.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.185+0000 7f969149b700 1 -- 172.21.15.133:0/2645037205 shutdown_connections 2023-10-08T16:09:18.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.185+0000 7f969149b700 1 -- 172.21.15.133:0/2645037205 wait complete. 2023-10-08T16:09:18.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.185+0000 7f969149b700 1 Processor -- start 2023-10-08T16:09:18.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.185+0000 7f969149b700 1 -- start start 2023-10-08T16:09:18.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.189+0000 7f969149b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f968c0b19e0 0x7f968c139a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.189+0000 7f969149b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f968c13d5b0 0x7f968c148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.189+0000 7f969149b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f968c1426c0 0x7f968c155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.189+0000 7f969149b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c0ac910 con 0x7f968c0b19e0 2023-10-08T16:09:18.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.189+0000 7f969149b700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c13acc0 con 0x7f968c1426c0 2023-10-08T16:09:18.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.189+0000 7f969149b700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968c13aa50 con 0x7f968c13d5b0 2023-10-08T16:09:18.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.189+0000 7f968bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f968c0b19e0 0x7f968c139a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.189+0000 7f968bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f968c0b19e0 0x7f968c139a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48514/0 (socket says 172.21.15.133:48514) 2023-10-08T16:09:18.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.189+0000 7f968bfff700 1 -- 172.21.15.133:0/88322178 learned_addr learned my addr 172.21.15.133:0/88322178 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:18.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.189+0000 7f9690c9a700 1 --2- 172.21.15.133:0/88322178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f968c1426c0 0x7f968c155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.189+0000 7f968b7fe700 1 --2- 172.21.15.133:0/88322178 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f968c13d5b0 0x7f968c148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.189+0000 7f968bfff700 1 -- 172.21.15.133:0/88322178 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f968c13d5b0 msgr2=0x7f968c148280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.189+0000 7f968bfff700 1 --2- 172.21.15.133:0/88322178 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f968c13d5b0 0x7f968c148280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.189+0000 7f968bfff700 1 -- 172.21.15.133:0/88322178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f968c1426c0 msgr2=0x7f968c155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.189+0000 7f968bfff700 1 --2- 172.21.15.133:0/88322178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f968c1426c0 0x7f968c155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.189+0000 7f968bfff700 1 -- 172.21.15.133:0/88322178 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96740094f0 con 0x7f968c0b19e0 2023-10-08T16:09:18.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.189+0000 7f968bfff700 1 --2- 172.21.15.133:0/88322178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f968c0b19e0 0x7f968c139a60 secure :-1 s=READY pgs=4377 cs=0 l=1 rev1=1 crypto rx=0x7f967400b3c0 tx=0x7f9674016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:18.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.189+0000 7f9683fff700 1 -- 172.21.15.133:0/88322178 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9674011aa0 con 0x7f968c0b19e0 2023-10-08T16:09:18.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.189+0000 7f9683fff700 1 -- 172.21.15.133:0/88322178 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9674011c00 con 0x7f968c0b19e0 2023-10-08T16:09:18.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.189+0000 7f969149b700 1 -- 172.21.15.133:0/88322178 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f968c0ad170 con 0x7f968c0b19e0 2023-10-08T16:09:18.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.189+0000 7f9683fff700 1 -- 172.21.15.133:0/88322178 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967401c460 con 0x7f968c0b19e0 2023-10-08T16:09:18.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.189+0000 7f969149b700 1 -- 172.21.15.133:0/88322178 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968c0ac5a0 con 0x7f968c0b19e0 2023-10-08T16:09:18.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.193+0000 7f969149b700 1 -- 172.21.15.133:0/88322178 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f968c04be40 con 0x7f968c0b19e0 2023-10-08T16:09:18.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.193+0000 7f9683fff700 1 -- 172.21.15.133:0/88322178 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f967401c850 con 0x7f968c0b19e0 2023-10-08T16:09:18.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.193+0000 7f9683fff700 1 --2- 172.21.15.133:0/88322178 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f966c060550 0x7f966c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.193+0000 7f968b7fe700 1 --2- 172.21.15.133:0/88322178 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f966c060550 0x7f966c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.193+0000 7f9683fff700 1 -- 172.21.15.133:0/88322178 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f967407eaa0 con 0x7f968c0b19e0 2023-10-08T16:09:18.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.193+0000 7f9683fff700 1 --2- 172.21.15.133:0/88322178 >> [v2:172.21.15.133:6808/33491,v1:172.21.15.133:6810/33491] conn(0x7f966c068940 0x7f966c06add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.193+0000 7f9683fff700 1 -- 172.21.15.133:0/88322178 --> [v2:172.21.15.133:6808/33491,v1:172.21.15.133:6810/33491] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f966c06b4a0 con 0x7f966c068940 2023-10-08T16:09:18.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.193+0000 7f9683fff700 1 -- 172.21.15.133:0/88322178 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9674083240 con 0x7f968c0b19e0 2023-10-08T16:09:18.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.193+0000 7f9690c9a700 1 --2- 172.21.15.133:0/88322178 >> [v2:172.21.15.133:6808/33491,v1:172.21.15.133:6810/33491] conn(0x7f966c068940 0x7f966c06add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.193+0000 7f968b7fe700 1 --2- 172.21.15.133:0/88322178 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f966c060550 0x7f966c062a00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f968c13b0e0 tx=0x7f967c0015f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:18.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.193+0000 7f9690c9a700 1 --2- 172.21.15.133:0/88322178 >> [v2:172.21.15.133:6808/33491,v1:172.21.15.133:6810/33491] conn(0x7f966c068940 0x7f966c06add0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:18.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.197+0000 7f9683fff700 1 -- 172.21.15.133:0/88322178 <== osd.3 v2:172.21.15.133:6808/33491 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f966c06b4a0 con 0x7f966c068940 2023-10-08T16:09:18.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.209+0000 7f969149b700 1 -- 172.21.15.133:0/88322178 --> [v2:172.21.15.133:6808/33491,v1:172.21.15.133:6810/33491] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f968c142be0 con 0x7f966c068940 2023-10-08T16:09:18.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.213+0000 7f9683fff700 1 -- 172.21.15.133:0/88322178 <== osd.3 v2:172.21.15.133:6808/33491 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f968c142be0 con 0x7f966c068940 2023-10-08T16:09:18.214 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-10-08T16:09:18.214 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T16:09:18.214 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-10-08T16:09:18.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.213+0000 7f969149b700 1 -- 172.21.15.133:0/88322178 >> [v2:172.21.15.133:6808/33491,v1:172.21.15.133:6810/33491] conn(0x7f966c068940 msgr2=0x7f966c06add0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.213+0000 7f969149b700 1 --2- 172.21.15.133:0/88322178 >> [v2:172.21.15.133:6808/33491,v1:172.21.15.133:6810/33491] conn(0x7f966c068940 0x7f966c06add0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.213+0000 7f969149b700 1 -- 172.21.15.133:0/88322178 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f966c060550 msgr2=0x7f966c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.213+0000 7f969149b700 1 --2- 172.21.15.133:0/88322178 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f966c060550 0x7f966c062a00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f968c13b0e0 tx=0x7f967c0015f0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.213+0000 7f969149b700 1 -- 172.21.15.133:0/88322178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f968c0b19e0 msgr2=0x7f968c139a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.213+0000 7f969149b700 1 --2- 172.21.15.133:0/88322178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f968c0b19e0 0x7f968c139a60 secure :-1 s=READY pgs=4377 cs=0 l=1 rev1=1 crypto rx=0x7f967400b3c0 tx=0x7f9674016000 comp rx=0 tx=0).stop 2023-10-08T16:09:18.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.213+0000 7f9690c9a700 1 -- 172.21.15.133:0/88322178 reap_dead start 2023-10-08T16:09:18.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.213+0000 7f969149b700 1 -- 172.21.15.133:0/88322178 shutdown_connections 2023-10-08T16:09:18.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.213+0000 7f969149b700 1 -- 172.21.15.133:0/88322178 >> 172.21.15.133:0/88322178 conn(0x7f968c062ba0 msgr2=0x7f968c0b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:18.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.213+0000 7f969149b700 1 -- 172.21.15.133:0/88322178 shutdown_connections 2023-10-08T16:09:18.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.213+0000 7f969149b700 1 -- 172.21.15.133:0/88322178 wait complete. 2023-10-08T16:09:18.227 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-08T16:09:18.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28eccf8700 1 Processor -- start 2023-10-08T16:09:18.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28eccf8700 1 -- start start 2023-10-08T16:09:18.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28eccf8700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f28e806e9a0 0x7f28e8140280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28eccf8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e806b610 con 0x7f28e80ab960 2023-10-08T16:09:18.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28eccf8700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e80afc70 con 0x7f28e80b1dc0 2023-10-08T16:09:18.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28eccf8700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e80b0060 con 0x7f28e806e9a0 2023-10-08T16:09:18.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e6ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f28e80ab960 0x7f28e8148bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56366/0 (socket says 172.21.15.133:56366) 2023-10-08T16:09:18.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e6ffd700 1 -- 172.21.15.133:0/1431239815 learned_addr learned my addr 172.21.15.133:0/1431239815 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:09:18.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e7fff700 1 --2- 172.21.15.133:0/1431239815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f28e806e9a0 0x7f28e8140280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e67fc700 1 -- 172.21.15.133:0/1431239815 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898566240 0 0) 0x7f28e806b610 con 0x7f28e80ab960 2023-10-08T16:09:18.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e67fc700 1 -- 172.21.15.133:0/1431239815 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28d0003570 con 0x7f28e80ab960 2023-10-08T16:09:18.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e67fc700 1 -- 172.21.15.133:0/1431239815 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3838747944 0 0) 0x7f28e80afc70 con 0x7f28e80b1dc0 2023-10-08T16:09:18.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e67fc700 1 -- 172.21.15.133:0/1431239815 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28e806b610 con 0x7f28e80b1dc0 2023-10-08T16:09:18.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e67fc700 1 -- 172.21.15.133:0/1431239815 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3604297523 0 0) 0x7f28d0003570 con 0x7f28e80ab960 2023-10-08T16:09:18.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e67fc700 1 -- 172.21.15.133:0/1431239815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f28e806e9a0 msgr2=0x7f28e8140280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:18.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e67fc700 1 --2- 172.21.15.133:0/1431239815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f28e806e9a0 0x7f28e8140280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e67fc700 1 -- 172.21.15.133:0/1431239815 >> v1:172.21.15.190:6789/0 conn(0x7f28e80b1dc0 legacy=0x7f28e806e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e67fc700 1 -- 172.21.15.133:0/1431239815 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e80b0340 con 0x7f28e80ab960 2023-10-08T16:09:18.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e67fc700 1 -- 172.21.15.133:0/1431239815 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2883817959 0 0) 0x7f28d8001490 con 0x7f28e80ab960 2023-10-08T16:09:18.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e67fc700 1 -- 172.21.15.133:0/1431239815 >> v1:172.21.15.133:6789/0 conn(0x7f28e80ab960 legacy=0x7f28e8148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e67fc700 1 --2- 172.21.15.133:0/1431239815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f28d0003c20 0x7f28d0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e67fc700 1 --2- 172.21.15.133:0/1431239815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f28e806e9a0 0x7f28d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e67fc700 1 --2- 172.21.15.133:0/1431239815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28d0004d50 0x7f28d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e67fc700 1 -- 172.21.15.133:0/1431239815 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e80b0060 con 0x7f28d0004d50 2023-10-08T16:09:18.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e67fc700 1 -- 172.21.15.133:0/1431239815 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d000bc20 con 0x7f28d0003c20 2023-10-08T16:09:18.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e67fc700 1 -- 172.21.15.133:0/1431239815 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d000bde0 con 0x7f28e806e9a0 2023-10-08T16:09:18.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e7fff700 1 --2- 172.21.15.133:0/1431239815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28d0004d50 0x7f28d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e6ffd700 1 --2- 172.21.15.133:0/1431239815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f28e806e9a0 0x7f28d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e77fe700 1 --2- 172.21.15.133:0/1431239815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f28d0003c20 0x7f28d0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e7fff700 1 -- 172.21.15.133:0/1431239815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f28e806e9a0 msgr2=0x7f28d0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:18.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e7fff700 1 --2- 172.21.15.133:0/1431239815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f28e806e9a0 0x7f28d0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e7fff700 1 -- 172.21.15.133:0/1431239815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f28d0003c20 msgr2=0x7f28d0004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:18.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e7fff700 1 --2- 172.21.15.133:0/1431239815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f28d0003c20 0x7f28d0004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e7fff700 1 -- 172.21.15.133:0/1431239815 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d0003570 con 0x7f28d0004d50 2023-10-08T16:09:18.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e77fe700 1 --2- 172.21.15.133:0/1431239815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f28d0003c20 0x7f28d0004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:18.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e7fff700 1 --2- 172.21.15.133:0/1431239815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28d0004d50 0x7f28d00051c0 secure :-1 s=READY pgs=4379 cs=0 l=1 rev1=1 crypto rx=0x7f28e000e210 tx=0x7f28e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2146e2f6e4df2ae server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:18.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e67fc700 1 -- 172.21.15.133:0/1431239815 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e000eac0 con 0x7f28d0004d50 2023-10-08T16:09:18.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e67fc700 1 -- 172.21.15.133:0/1431239815 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e000f040 con 0x7f28d0004d50 2023-10-08T16:09:18.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e67fc700 1 -- 172.21.15.133:0/1431239815 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e000ee70 con 0x7f28d0004d50 2023-10-08T16:09:18.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28eccf8700 1 -- 172.21.15.133:0/1431239815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28d0004d50 msgr2=0x7f28d00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28eccf8700 1 --2- 172.21.15.133:0/1431239815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28d0004d50 0x7f28d00051c0 secure :-1 s=READY pgs=4379 cs=0 l=1 rev1=1 crypto rx=0x7f28e000e210 tx=0x7f28e000b040 comp rx=0 tx=0).stop 2023-10-08T16:09:18.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.345+0000 7f28e7fff700 1 -- 172.21.15.133:0/1431239815 reap_dead start 2023-10-08T16:09:18.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.349+0000 7f28eccf8700 1 -- 172.21.15.133:0/1431239815 shutdown_connections 2023-10-08T16:09:18.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.349+0000 7f28eccf8700 1 -- 172.21.15.133:0/1431239815 >> 172.21.15.133:0/1431239815 conn(0x7f28e8063670 msgr2=0x7f28e80b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:18.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.349+0000 7f28eccf8700 1 -- 172.21.15.133:0/1431239815 shutdown_connections 2023-10-08T16:09:18.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.349+0000 7f28eccf8700 1 -- 172.21.15.133:0/1431239815 wait complete. 2023-10-08T16:09:18.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.349+0000 7f28eccf8700 1 Processor -- start 2023-10-08T16:09:18.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.349+0000 7f28eccf8700 1 -- start start 2023-10-08T16:09:18.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.349+0000 7f28eccf8700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f28e813d280 0x7f28e80ad310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.349+0000 7f28eccf8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28e81552a0 0x7f28e81556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.349+0000 7f28eccf8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f28e80ac0b0 0x7f28e80ac520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.349+0000 7f28eccf8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e8154e10 con 0x7f28e81552a0 2023-10-08T16:09:18.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.349+0000 7f28eccf8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e8155c10 con 0x7f28e80ac0b0 2023-10-08T16:09:18.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.349+0000 7f28eccf8700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e8145cf0 con 0x7f28e813d280 2023-10-08T16:09:18.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.349+0000 7f28e6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28e81552a0 0x7f28e81556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.349+0000 7f28e6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28e81552a0 0x7f28e81556d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48544/0 (socket says 172.21.15.133:48544) 2023-10-08T16:09:18.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.349+0000 7f28e6ffd700 1 -- 172.21.15.133:0/2710548490 learned_addr learned my addr 172.21.15.133:0/2710548490 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:18.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.349+0000 7f28e77fe700 1 --2- 172.21.15.133:0/2710548490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f28e813d280 0x7f28e80ad310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.349+0000 7f28e7fff700 1 --2- 172.21.15.133:0/2710548490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f28e80ac0b0 0x7f28e80ac520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.349+0000 7f28e6ffd700 1 -- 172.21.15.133:0/2710548490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f28e813d280 msgr2=0x7f28e80ad310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.349+0000 7f28e6ffd700 1 --2- 172.21.15.133:0/2710548490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f28e813d280 0x7f28e80ad310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.349+0000 7f28e6ffd700 1 -- 172.21.15.133:0/2710548490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f28e80ac0b0 msgr2=0x7f28e80ac520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.349+0000 7f28e6ffd700 1 --2- 172.21.15.133:0/2710548490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f28e80ac0b0 0x7f28e80ac520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.349+0000 7f28e6ffd700 1 -- 172.21.15.133:0/2710548490 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e80adc30 con 0x7f28e81552a0 2023-10-08T16:09:18.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.349+0000 7f28e7fff700 1 --2- 172.21.15.133:0/2710548490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f28e80ac0b0 0x7f28e80ac520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:18.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.353+0000 7f28e6ffd700 1 --2- 172.21.15.133:0/2710548490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28e81552a0 0x7f28e81556d0 secure :-1 s=READY pgs=4380 cs=0 l=1 rev1=1 crypto rx=0x7f28d800eb00 tx=0x7f28d8000f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:18.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.353+0000 7f28cf7fe700 1 -- 172.21.15.133:0/2710548490 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d800a760 con 0x7f28e81552a0 2023-10-08T16:09:18.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.353+0000 7f28cf7fe700 1 -- 172.21.15.133:0/2710548490 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d8010040 con 0x7f28e81552a0 2023-10-08T16:09:18.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.353+0000 7f28eccf8700 1 -- 172.21.15.133:0/2710548490 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e80adf10 con 0x7f28e81552a0 2023-10-08T16:09:18.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.353+0000 7f28cf7fe700 1 -- 172.21.15.133:0/2710548490 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d800ab30 con 0x7f28e81552a0 2023-10-08T16:09:18.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.353+0000 7f28eccf8700 1 -- 172.21.15.133:0/2710548490 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e80ad850 con 0x7f28e81552a0 2023-10-08T16:09:18.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.353+0000 7f28eccf8700 1 -- 172.21.15.133:0/2710548490 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e8154fc0 con 0x7f28e81552a0 2023-10-08T16:09:18.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.353+0000 7f28cf7fe700 1 -- 172.21.15.133:0/2710548490 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f28d801d3b0 con 0x7f28e81552a0 2023-10-08T16:09:18.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.353+0000 7f28cf7fe700 1 --2- 172.21.15.133:0/2710548490 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f28d4060580 0x7f28d4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.353+0000 7f28cf7fe700 1 -- 172.21.15.133:0/2710548490 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f28d807be50 con 0x7f28e81552a0 2023-10-08T16:09:18.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.353+0000 7f28e77fe700 1 --2- 172.21.15.133:0/2710548490 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f28d4060580 0x7f28d4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.357+0000 7f28e77fe700 1 --2- 172.21.15.133:0/2710548490 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f28d4060580 0x7f28d4062a30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0010e0 tx=0x7f28dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:18.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.365+0000 7f28cf7fe700 1 -- 172.21.15.133:0/2710548490 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f28e8154fc0 con 0x7f28e81552a0 2023-10-08T16:09:18.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.525+0000 7f28eccf8700 1 -- 172.21.15.133:0/2710548490 --> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f28e8154fc0 con 0x7f28d4060580 2023-10-08T16:09:18.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.525+0000 7f28cf7fe700 1 -- 172.21.15.133:0/2710548490 <== mgr.4104 v2:172.21.15.133:6832/33362 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f28e8154fc0 con 0x7f28d4060580 2023-10-08T16:09:18.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.529+0000 7f28eccf8700 1 -- 172.21.15.133:0/2710548490 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f28d4060580 msgr2=0x7f28d4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.529+0000 7f28eccf8700 1 --2- 172.21.15.133:0/2710548490 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f28d4060580 0x7f28d4062a30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0010e0 tx=0x7f28dc009040 comp rx=0 tx=0).stop 2023-10-08T16:09:18.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.529+0000 7f28eccf8700 1 -- 172.21.15.133:0/2710548490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28e81552a0 msgr2=0x7f28e81556d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.529+0000 7f28eccf8700 1 --2- 172.21.15.133:0/2710548490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28e81552a0 0x7f28e81556d0 secure :-1 s=READY pgs=4380 cs=0 l=1 rev1=1 crypto rx=0x7f28d800eb00 tx=0x7f28d8000f60 comp rx=0 tx=0).stop 2023-10-08T16:09:18.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.529+0000 7f28eccf8700 1 -- 172.21.15.133:0/2710548490 shutdown_connections 2023-10-08T16:09:18.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.529+0000 7f28eccf8700 1 --2- 172.21.15.133:0/2710548490 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f28d4060580 0x7f28d4062a30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.529+0000 7f28eccf8700 1 --2- 172.21.15.133:0/2710548490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f28e80ac0b0 0x7f28e80ac520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.529+0000 7f28eccf8700 1 --2- 172.21.15.133:0/2710548490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28e81552a0 0x7f28e81556d0 unknown :-1 s=CLOSED pgs=4380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.529+0000 7f28eccf8700 1 --2- 172.21.15.133:0/2710548490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f28e813d280 0x7f28e80ad310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.529+0000 7f28eccf8700 1 -- 172.21.15.133:0/2710548490 >> 172.21.15.133:0/2710548490 conn(0x7f28e8063670 msgr2=0x7f28e80b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:18.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.529+0000 7f28eccf8700 1 -- 172.21.15.133:0/2710548490 shutdown_connections 2023-10-08T16:09:18.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.529+0000 7f28eccf8700 1 -- 172.21.15.133:0/2710548490 wait complete. 2023-10-08T16:09:18.533 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 3 to deep-scrub 2023-10-08T16:09:18.548 INFO:tasks.ceph:Scrubbing osd.4 2023-10-08T16:09:18.548 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-08T16:09:18.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.657+0000 7fe68e900700 1 Processor -- start 2023-10-08T16:09:18.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.657+0000 7fe68e900700 1 -- start start 2023-10-08T16:09:18.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.661+0000 7fe68e900700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe688146140 0x7fe68806e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.661+0000 7fe68e900700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6880b0650 con 0x7fe68806e880 2023-10-08T16:09:18.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.661+0000 7fe68e900700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe688146b30 con 0x7fe6880b6620 2023-10-08T16:09:18.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.661+0000 7fe68e900700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6881428a0 con 0x7fe688146140 2023-10-08T16:09:18.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.661+0000 7fe67ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe688146140 0x7fe68806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.661+0000 7fe67ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe688146140 0x7fe68806e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48548/0 (socket says 172.21.15.133:48548) 2023-10-08T16:09:18.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.661+0000 7fe67ffff700 1 -- 172.21.15.133:0/1425847936 learned_addr learned my addr 172.21.15.133:0/1425847936 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:18.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.661+0000 7fe67ffff700 1 -- 172.21.15.133:0/1425847936 >> v1:172.21.15.190:6789/0 conn(0x7fe6880b6620 legacy=0x7fe688142d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.661+0000 7fe67ffff700 1 -- 172.21.15.133:0/1425847936 >> v1:172.21.15.133:6789/0 conn(0x7fe68806e880 legacy=0x7fe68814d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.661+0000 7fe67ffff700 1 -- 172.21.15.133:0/1425847936 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe688067e70 con 0x7fe688146140 2023-10-08T16:09:18.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.661+0000 7fe67ffff700 1 --2- 172.21.15.133:0/1425847936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe688146140 0x7fe68806e340 secure :-1 s=READY pgs=4382 cs=0 l=1 rev1=1 crypto rx=0x7fe6700099b0 tx=0x7fe670009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a56aa80564f2271 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:18.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.661+0000 7fe6877fe700 1 -- 172.21.15.133:0/1425847936 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67000b860 con 0x7fe688146140 2023-10-08T16:09:18.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.661+0000 7fe6877fe700 1 -- 172.21.15.133:0/1425847936 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67000b9c0 con 0x7fe688146140 2023-10-08T16:09:18.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.661+0000 7fe6877fe700 1 -- 172.21.15.133:0/1425847936 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67000bd60 con 0x7fe688146140 2023-10-08T16:09:18.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.661+0000 7fe68e900700 1 -- 172.21.15.133:0/1425847936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe688146140 msgr2=0x7fe68806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.661+0000 7fe68e900700 1 --2- 172.21.15.133:0/1425847936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe688146140 0x7fe68806e340 secure :-1 s=READY pgs=4382 cs=0 l=1 rev1=1 crypto rx=0x7fe6700099b0 tx=0x7fe670009250 comp rx=0 tx=0).stop 2023-10-08T16:09:18.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.661+0000 7fe68e900700 1 -- 172.21.15.133:0/1425847936 shutdown_connections 2023-10-08T16:09:18.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.661+0000 7fe68e900700 1 --2- 172.21.15.133:0/1425847936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe688146140 0x7fe68806e340 unknown :-1 s=CLOSED pgs=4382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.661+0000 7fe68e900700 1 -- 172.21.15.133:0/1425847936 >> 172.21.15.133:0/1425847936 conn(0x7fe68806a860 msgr2=0x7fe6880b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:18.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.661+0000 7fe68e900700 1 -- 172.21.15.133:0/1425847936 shutdown_connections 2023-10-08T16:09:18.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.661+0000 7fe68e900700 1 -- 172.21.15.133:0/1425847936 wait complete. 2023-10-08T16:09:18.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.661+0000 7fe68e900700 1 Processor -- start 2023-10-08T16:09:18.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.661+0000 7fe68e900700 1 -- start start 2023-10-08T16:09:18.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.665+0000 7fe68e900700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe68806e880 0x7fe68813de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.665+0000 7fe68e900700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6880b6620 0x7fe688151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.665+0000 7fe68e900700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe688146140 0x7fe6880ae920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.665+0000 7fe68e900700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6880af700 con 0x7fe68806e880 2023-10-08T16:09:18.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.665+0000 7fe68e900700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68813d0c0 con 0x7fe688146140 2023-10-08T16:09:18.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.665+0000 7fe68e900700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68813fcc0 con 0x7fe6880b6620 2023-10-08T16:09:18.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.665+0000 7fe687fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe68806e880 0x7fe68813de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.665+0000 7fe687fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe68806e880 0x7fe68813de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48564/0 (socket says 172.21.15.133:48564) 2023-10-08T16:09:18.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.665+0000 7fe687fff700 1 -- 172.21.15.133:0/3325960799 learned_addr learned my addr 172.21.15.133:0/3325960799 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:18.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.665+0000 7fe67ffff700 1 --2- 172.21.15.133:0/3325960799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6880b6620 0x7fe688151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.665+0000 7fe68ce9d700 1 --2- 172.21.15.133:0/3325960799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe688146140 0x7fe6880ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.665+0000 7fe687fff700 1 -- 172.21.15.133:0/3325960799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6880b6620 msgr2=0x7fe688151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.665+0000 7fe687fff700 1 --2- 172.21.15.133:0/3325960799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6880b6620 0x7fe688151b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.665+0000 7fe687fff700 1 -- 172.21.15.133:0/3325960799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe688146140 msgr2=0x7fe6880ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.665+0000 7fe687fff700 1 --2- 172.21.15.133:0/3325960799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe688146140 0x7fe6880ae920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.665+0000 7fe687fff700 1 -- 172.21.15.133:0/3325960799 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6700094f0 con 0x7fe68806e880 2023-10-08T16:09:18.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.665+0000 7fe687fff700 1 --2- 172.21.15.133:0/3325960799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe68806e880 0x7fe68813de10 secure :-1 s=READY pgs=4383 cs=0 l=1 rev1=1 crypto rx=0x7fe67800c5c0 tx=0x7fe67800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:18.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.665+0000 7fe684ff9700 1 -- 172.21.15.133:0/3325960799 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe678011590 con 0x7fe68806e880 2023-10-08T16:09:18.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.665+0000 7fe684ff9700 1 -- 172.21.15.133:0/3325960799 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe678011710 con 0x7fe68806e880 2023-10-08T16:09:18.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.665+0000 7fe68e900700 1 -- 172.21.15.133:0/3325960799 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe68813d550 con 0x7fe68806e880 2023-10-08T16:09:18.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.665+0000 7fe684ff9700 1 -- 172.21.15.133:0/3325960799 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe678011ad0 con 0x7fe68806e880 2023-10-08T16:09:18.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.665+0000 7fe68e900700 1 -- 172.21.15.133:0/3325960799 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe68813e350 con 0x7fe68806e880 2023-10-08T16:09:18.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.669+0000 7fe68e900700 1 -- 172.21.15.133:0/3325960799 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe688064810 con 0x7fe68806e880 2023-10-08T16:09:18.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.669+0000 7fe684ff9700 1 -- 172.21.15.133:0/3325960799 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe67801b3b0 con 0x7fe68806e880 2023-10-08T16:09:18.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.669+0000 7fe684ff9700 1 --2- 172.21.15.133:0/3325960799 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe668060580 0x7fe668062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.669+0000 7fe684ff9700 1 -- 172.21.15.133:0/3325960799 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fe67807bc80 con 0x7fe68806e880 2023-10-08T16:09:18.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.669+0000 7fe67ffff700 1 --2- 172.21.15.133:0/3325960799 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe668060580 0x7fe668062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.669+0000 7fe684ff9700 1 --2- 172.21.15.133:0/3325960799 >> [v2:172.21.15.190:6808/33678,v1:172.21.15.190:6810/33678] conn(0x7fe668068970 0x7fe66806ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.669+0000 7fe684ff9700 1 -- 172.21.15.133:0/3325960799 --> [v2:172.21.15.190:6808/33678,v1:172.21.15.190:6810/33678] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe66806b4d0 con 0x7fe668068970 2023-10-08T16:09:18.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.669+0000 7fe684ff9700 1 -- 172.21.15.133:0/3325960799 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe67807e2c0 con 0x7fe68806e880 2023-10-08T16:09:18.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.669+0000 7fe67ffff700 1 --2- 172.21.15.133:0/3325960799 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe668060580 0x7fe668062a30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe6700099b0 tx=0x7fe670017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:18.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.669+0000 7fe68ce9d700 1 --2- 172.21.15.133:0/3325960799 >> [v2:172.21.15.190:6808/33678,v1:172.21.15.190:6810/33678] conn(0x7fe668068970 0x7fe66806ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.669+0000 7fe68ce9d700 1 --2- 172.21.15.133:0/3325960799 >> [v2:172.21.15.190:6808/33678,v1:172.21.15.190:6810/33678] conn(0x7fe668068970 0x7fe66806ae00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:18.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.673+0000 7fe684ff9700 1 -- 172.21.15.133:0/3325960799 <== osd.4 v2:172.21.15.190:6808/33678 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe66806b4d0 con 0x7fe668068970 2023-10-08T16:09:18.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.689+0000 7fe68e900700 1 -- 172.21.15.133:0/3325960799 --> [v2:172.21.15.190:6808/33678,v1:172.21.15.190:6810/33678] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe68813d760 con 0x7fe668068970 2023-10-08T16:09:18.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.689+0000 7fe684ff9700 1 -- 172.21.15.133:0/3325960799 <== osd.4 v2:172.21.15.190:6808/33678 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe68813d760 con 0x7fe668068970 2023-10-08T16:09:18.693 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-10-08T16:09:18.693 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T16:09:18.693 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-10-08T16:09:18.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.693+0000 7fe68e900700 1 -- 172.21.15.133:0/3325960799 >> [v2:172.21.15.190:6808/33678,v1:172.21.15.190:6810/33678] conn(0x7fe668068970 msgr2=0x7fe66806ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.693+0000 7fe68e900700 1 --2- 172.21.15.133:0/3325960799 >> [v2:172.21.15.190:6808/33678,v1:172.21.15.190:6810/33678] conn(0x7fe668068970 0x7fe66806ae00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.693+0000 7fe68e900700 1 -- 172.21.15.133:0/3325960799 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe668060580 msgr2=0x7fe668062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.693+0000 7fe68e900700 1 --2- 172.21.15.133:0/3325960799 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fe668060580 0x7fe668062a30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe6700099b0 tx=0x7fe670017000 comp rx=0 tx=0).stop 2023-10-08T16:09:18.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.693+0000 7fe68e900700 1 -- 172.21.15.133:0/3325960799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe68806e880 msgr2=0x7fe68813de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.693+0000 7fe68e900700 1 --2- 172.21.15.133:0/3325960799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe68806e880 0x7fe68813de10 secure :-1 s=READY pgs=4383 cs=0 l=1 rev1=1 crypto rx=0x7fe67800c5c0 tx=0x7fe67800c8d0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.693+0000 7fe68ce9d700 1 -- 172.21.15.133:0/3325960799 reap_dead start 2023-10-08T16:09:18.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.693+0000 7fe68e900700 1 -- 172.21.15.133:0/3325960799 shutdown_connections 2023-10-08T16:09:18.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.693+0000 7fe68e900700 1 -- 172.21.15.133:0/3325960799 >> 172.21.15.133:0/3325960799 conn(0x7fe68806a860 msgr2=0x7fe6880b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:18.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.693+0000 7fe68e900700 1 -- 172.21.15.133:0/3325960799 shutdown_connections 2023-10-08T16:09:18.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.693+0000 7fe68e900700 1 -- 172.21.15.133:0/3325960799 wait complete. 2023-10-08T16:09:18.706 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-08T16:09:18.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff91c9ac700 1 Processor -- start 2023-10-08T16:09:18.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff91c9ac700 1 -- start start 2023-10-08T16:09:18.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff91c9ac700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff9180abf80 0x7ff9180ae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff91c9ac700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff9180ac350 0x7ff91814a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff91c9ac700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9180add70 con 0x7ff91814a790 2023-10-08T16:09:18.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff91c9ac700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9180acc20 con 0x7ff9180ac350 2023-10-08T16:09:18.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff91c9ac700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9180693e0 con 0x7ff9180abf80 2023-10-08T16:09:18.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff915d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff9180ac350 0x7ff91814a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff915d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff9180ac350 0x7ff91814a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48572/0 (socket says 172.21.15.133:48572) 2023-10-08T16:09:18.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff915d9b700 1 -- 172.21.15.133:0/1017522199 learned_addr learned my addr 172.21.15.133:0/1017522199 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:18.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff916d9d700 1 --1- 172.21.15.133:0/1017522199 >> v1:172.21.15.133:6789/0 conn(0x7ff91814a790 0x7ff918067ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56378/0 (socket says 172.21.15.133:56378) 2023-10-08T16:09:18.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff91659c700 1 --2- 172.21.15.133:0/1017522199 >> v2:172.21.15.190:3300/0 conn(0x7ff9180abf80 0x7ff9180ae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff915d9b700 1 -- 172.21.15.133:0/1017522199 >> v2:172.21.15.190:3300/0 conn(0x7ff9180abf80 msgr2=0x7ff9180ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:18.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff91559a700 1 -- 172.21.15.133:0/1017522199 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2210113468 0 0) 0x7ff9180add70 con 0x7ff91814a790 2023-10-08T16:09:18.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff915d9b700 1 --2- 172.21.15.133:0/1017522199 >> v2:172.21.15.190:3300/0 conn(0x7ff9180abf80 0x7ff9180ae1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff915d9b700 1 -- 172.21.15.133:0/1017522199 >> v1:172.21.15.133:6789/0 conn(0x7ff91814a790 legacy=0x7ff918067ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff915d9b700 1 -- 172.21.15.133:0/1017522199 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9180ad320 con 0x7ff9180ac350 2023-10-08T16:09:18.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff915d9b700 1 --2- 172.21.15.133:0/1017522199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9180ac350 0x7ff91814a250 secure :-1 s=READY pgs=4385 cs=0 l=1 rev1=1 crypto rx=0x7ff9180b5ba0 tx=0x7ff910009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4472fbe82025d5df server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:18.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff91559a700 1 -- 172.21.15.133:0/1017522199 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91000e070 con 0x7ff9180ac350 2023-10-08T16:09:18.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff91559a700 1 -- 172.21.15.133:0/1017522199 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91000ba20 con 0x7ff9180ac350 2023-10-08T16:09:18.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff91559a700 1 -- 172.21.15.133:0/1017522199 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9100092e0 con 0x7ff9180ac350 2023-10-08T16:09:18.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff91c9ac700 1 -- 172.21.15.133:0/1017522199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9180ac350 msgr2=0x7ff91814a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff91c9ac700 1 --2- 172.21.15.133:0/1017522199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9180ac350 0x7ff91814a250 secure :-1 s=READY pgs=4385 cs=0 l=1 rev1=1 crypto rx=0x7ff9180b5ba0 tx=0x7ff910009840 comp rx=0 tx=0).stop 2023-10-08T16:09:18.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff91c9ac700 1 -- 172.21.15.133:0/1017522199 shutdown_connections 2023-10-08T16:09:18.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff91c9ac700 1 --2- 172.21.15.133:0/1017522199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9180ac350 0x7ff91814a250 unknown :-1 s=CLOSED pgs=4385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff91c9ac700 1 --2- 172.21.15.133:0/1017522199 >> v2:172.21.15.190:3300/0 conn(0x7ff9180abf80 0x7ff9180ae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.813+0000 7ff91c9ac700 1 -- 172.21.15.133:0/1017522199 >> 172.21.15.133:0/1017522199 conn(0x7ff9180b4ba0 msgr2=0x7ff9180b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:18.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff91c9ac700 1 -- 172.21.15.133:0/1017522199 shutdown_connections 2023-10-08T16:09:18.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff91c9ac700 1 -- 172.21.15.133:0/1017522199 wait complete. 2023-10-08T16:09:18.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff91c9ac700 1 Processor -- start 2023-10-08T16:09:18.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff91c9ac700 1 -- start start 2023-10-08T16:09:18.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff91c9ac700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9180abf80 0x7ff91815a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff91c9ac700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9180ac350 0x7ff9181476c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff91c9ac700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff91814a790 0x7ff9180a9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff91c9ac700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91815a1a0 con 0x7ff91814a790 2023-10-08T16:09:18.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff91c9ac700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9180aac10 con 0x7ff9180abf80 2023-10-08T16:09:18.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff91c9ac700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff918159b50 con 0x7ff9180ac350 2023-10-08T16:09:18.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff916d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff91814a790 0x7ff9180a9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff916d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff91814a790 0x7ff9180a9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48586/0 (socket says 172.21.15.133:48586) 2023-10-08T16:09:18.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff916d9d700 1 -- 172.21.15.133:0/1035864051 learned_addr learned my addr 172.21.15.133:0/1035864051 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:18.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff91659c700 1 --2- 172.21.15.133:0/1035864051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9180abf80 0x7ff91815a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff915d9b700 1 --2- 172.21.15.133:0/1035864051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9180ac350 0x7ff9181476c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff916d9d700 1 -- 172.21.15.133:0/1035864051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9180ac350 msgr2=0x7ff9181476c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff916d9d700 1 --2- 172.21.15.133:0/1035864051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9180ac350 0x7ff9181476c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff916d9d700 1 -- 172.21.15.133:0/1035864051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9180abf80 msgr2=0x7ff91815a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff916d9d700 1 --2- 172.21.15.133:0/1035864051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9180abf80 0x7ff91815a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff916d9d700 1 -- 172.21.15.133:0/1035864051 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff910009ae0 con 0x7ff91814a790 2023-10-08T16:09:18.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff915d9b700 1 --2- 172.21.15.133:0/1035864051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9180ac350 0x7ff9181476c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:18.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff916d9d700 1 --2- 172.21.15.133:0/1035864051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff91814a790 0x7ff9180a9930 secure :-1 s=READY pgs=4386 cs=0 l=1 rev1=1 crypto rx=0x7ff90800c5e0 tx=0x7ff908007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:18.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff90e7fc700 1 -- 172.21.15.133:0/1035864051 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff908005a70 con 0x7ff91814a790 2023-10-08T16:09:18.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff90e7fc700 1 -- 172.21.15.133:0/1035864051 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff908005bd0 con 0x7ff91814a790 2023-10-08T16:09:18.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff91c9ac700 1 -- 172.21.15.133:0/1035864051 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff918159e30 con 0x7ff91814a790 2023-10-08T16:09:18.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff90e7fc700 1 -- 172.21.15.133:0/1035864051 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9080070d0 con 0x7ff91814a790 2023-10-08T16:09:18.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.817+0000 7ff91c9ac700 1 -- 172.21.15.133:0/1035864051 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9180ab520 con 0x7ff91814a790 2023-10-08T16:09:18.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.821+0000 7ff91c9ac700 1 -- 172.21.15.133:0/1035864051 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff918064810 con 0x7ff91814a790 2023-10-08T16:09:18.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.821+0000 7ff90e7fc700 1 -- 172.21.15.133:0/1035864051 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff908007440 con 0x7ff91814a790 2023-10-08T16:09:18.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.821+0000 7ff90e7fc700 1 --2- 172.21.15.133:0/1035864051 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff8fc060550 0x7ff8fc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.821+0000 7ff91659c700 1 --2- 172.21.15.133:0/1035864051 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff8fc060550 0x7ff8fc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.821+0000 7ff90e7fc700 1 -- 172.21.15.133:0/1035864051 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7ff90807be40 con 0x7ff91814a790 2023-10-08T16:09:18.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.821+0000 7ff91659c700 1 --2- 172.21.15.133:0/1035864051 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff8fc060550 0x7ff8fc062a00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff900009ca0 tx=0x7ff900008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:18.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.829+0000 7ff90e7fc700 1 -- 172.21.15.133:0/1035864051 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff90804c3a0 con 0x7ff91814a790 2023-10-08T16:09:18.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.989+0000 7ff91c9ac700 1 -- 172.21.15.133:0/1035864051 --> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7ff918068e20 con 0x7ff8fc060550 2023-10-08T16:09:18.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.989+0000 7ff90e7fc700 1 -- 172.21.15.133:0/1035864051 <== mgr.4104 v2:172.21.15.133:6832/33362 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff918068e20 con 0x7ff8fc060550 2023-10-08T16:09:18.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.993+0000 7ff91c9ac700 1 -- 172.21.15.133:0/1035864051 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff8fc060550 msgr2=0x7ff8fc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.993+0000 7ff91c9ac700 1 --2- 172.21.15.133:0/1035864051 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff8fc060550 0x7ff8fc062a00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff900009ca0 tx=0x7ff900008040 comp rx=0 tx=0).stop 2023-10-08T16:09:18.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.993+0000 7ff91c9ac700 1 -- 172.21.15.133:0/1035864051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff91814a790 msgr2=0x7ff9180a9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.993+0000 7ff91c9ac700 1 --2- 172.21.15.133:0/1035864051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff91814a790 0x7ff9180a9930 secure :-1 s=READY pgs=4386 cs=0 l=1 rev1=1 crypto rx=0x7ff90800c5e0 tx=0x7ff908007d60 comp rx=0 tx=0).stop 2023-10-08T16:09:18.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.993+0000 7ff91c9ac700 1 -- 172.21.15.133:0/1035864051 shutdown_connections 2023-10-08T16:09:18.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.993+0000 7ff91c9ac700 1 --2- 172.21.15.133:0/1035864051 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff8fc060550 0x7ff8fc062a00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.993+0000 7ff91c9ac700 1 --2- 172.21.15.133:0/1035864051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff91814a790 0x7ff9180a9930 unknown :-1 s=CLOSED pgs=4386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.993+0000 7ff91c9ac700 1 --2- 172.21.15.133:0/1035864051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9180ac350 0x7ff9181476c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.993+0000 7ff91c9ac700 1 --2- 172.21.15.133:0/1035864051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9180abf80 0x7ff91815a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.993+0000 7ff91c9ac700 1 -- 172.21.15.133:0/1035864051 >> 172.21.15.133:0/1035864051 conn(0x7ff9180b4ba0 msgr2=0x7ff9180ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:18.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.993+0000 7ff91c9ac700 1 -- 172.21.15.133:0/1035864051 shutdown_connections 2023-10-08T16:09:18.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:18.993+0000 7ff91c9ac700 1 -- 172.21.15.133:0/1035864051 wait complete. 2023-10-08T16:09:18.998 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 4 to deep-scrub 2023-10-08T16:09:19.008 INFO:tasks.ceph:Scrubbing osd.5 2023-10-08T16:09:19.008 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-08T16:09:19.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.121+0000 7f86491fe700 1 Processor -- start 2023-10-08T16:09:19.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.121+0000 7f86491fe700 1 -- start start 2023-10-08T16:09:19.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.121+0000 7f86491fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f86440b2340 0x7f8644067460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.121+0000 7f86491fe700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86440b1eb0 con 0x7f86440679a0 2023-10-08T16:09:19.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.121+0000 7f86491fe700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86440b1860 con 0x7f86440b76e0 2023-10-08T16:09:19.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.121+0000 7f86491fe700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f864413ce00 con 0x7f86440b2340 2023-10-08T16:09:19.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.121+0000 7f864259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f86440b2340 0x7f8644067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.125+0000 7f864359e700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f86440679a0 0x7f864409c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56384/0 (socket says 172.21.15.133:56384) 2023-10-08T16:09:19.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.125+0000 7f864359e700 1 -- 172.21.15.133:0/989177201 learned_addr learned my addr 172.21.15.133:0/989177201 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:09:19.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.125+0000 7f8641d9b700 1 -- 172.21.15.133:0/989177201 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 378439074 0 0) 0x7f86440b1eb0 con 0x7f86440679a0 2023-10-08T16:09:19.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.125+0000 7f8641d9b700 1 -- 172.21.15.133:0/989177201 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f862c003570 con 0x7f86440679a0 2023-10-08T16:09:19.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.125+0000 7f864259c700 1 -- 172.21.15.133:0/989177201 >> v1:172.21.15.190:6789/0 conn(0x7f86440b76e0 legacy=0x7f86441425e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.125+0000 7f864259c700 1 -- 172.21.15.133:0/989177201 >> v1:172.21.15.133:6789/0 conn(0x7f86440679a0 legacy=0x7f864409c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.125+0000 7f864259c700 1 -- 172.21.15.133:0/989177201 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86440b1b40 con 0x7f86440b2340 2023-10-08T16:09:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.125+0000 7f864259c700 1 --2- 172.21.15.133:0/989177201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86440b2340 0x7f8644067460 secure :-1 s=READY pgs=4388 cs=0 l=1 rev1=1 crypto rx=0x7f86380098e0 tx=0x7f86380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8a6fcfc13ddd35 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.125+0000 7f8641d9b700 1 -- 172.21.15.133:0/989177201 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863800b640 con 0x7f86440b2340 2023-10-08T16:09:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.125+0000 7f8641d9b700 1 -- 172.21.15.133:0/989177201 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863800b7a0 con 0x7f86440b2340 2023-10-08T16:09:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.125+0000 7f8641d9b700 1 -- 172.21.15.133:0/989177201 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863800bb40 con 0x7f86440b2340 2023-10-08T16:09:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.125+0000 7f86491fe700 1 -- 172.21.15.133:0/989177201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86440b2340 msgr2=0x7f8644067460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.125+0000 7f86491fe700 1 --2- 172.21.15.133:0/989177201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86440b2340 0x7f8644067460 secure :-1 s=READY pgs=4388 cs=0 l=1 rev1=1 crypto rx=0x7f86380098e0 tx=0x7f86380091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.125+0000 7f86491fe700 1 -- 172.21.15.133:0/989177201 shutdown_connections 2023-10-08T16:09:19.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.125+0000 7f86491fe700 1 --2- 172.21.15.133:0/989177201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86440b2340 0x7f8644067460 unknown :-1 s=CLOSED pgs=4388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.125+0000 7f86491fe700 1 -- 172.21.15.133:0/989177201 >> 172.21.15.133:0/989177201 conn(0x7f86440b4300 msgr2=0x7f86440b6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:19.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.125+0000 7f86491fe700 1 -- 172.21.15.133:0/989177201 shutdown_connections 2023-10-08T16:09:19.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.125+0000 7f86491fe700 1 -- 172.21.15.133:0/989177201 wait complete. 2023-10-08T16:09:19.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.125+0000 7f86491fe700 1 Processor -- start 2023-10-08T16:09:19.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.125+0000 7f86491fe700 1 -- start start 2023-10-08T16:09:19.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.129+0000 7f86491fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86440679a0 0x7f864406a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.129+0000 7f86491fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86440b2340 0x7f864413faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.129+0000 7f86491fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86440b76e0 0x7f8644155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.129+0000 7f86491fe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864413f740 con 0x7f86440679a0 2023-10-08T16:09:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.129+0000 7f86491fe700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86441554c0 con 0x7f86440b76e0 2023-10-08T16:09:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.129+0000 7f86491fe700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8644155a80 con 0x7f86440b2340 2023-10-08T16:09:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.129+0000 7f8642d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86440679a0 0x7f864406a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.129+0000 7f8642d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86440679a0 0x7f864406a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48606/0 (socket says 172.21.15.133:48606) 2023-10-08T16:09:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.129+0000 7f8642d9d700 1 -- 172.21.15.133:0/720494330 learned_addr learned my addr 172.21.15.133:0/720494330 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:19.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.129+0000 7f864359e700 1 --2- 172.21.15.133:0/720494330 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86440b76e0 0x7f8644155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.129+0000 7f864259c700 1 --2- 172.21.15.133:0/720494330 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86440b2340 0x7f864413faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.129+0000 7f8642d9d700 1 -- 172.21.15.133:0/720494330 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86440b2340 msgr2=0x7f864413faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.129+0000 7f8642d9d700 1 --2- 172.21.15.133:0/720494330 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86440b2340 0x7f864413faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.129+0000 7f8642d9d700 1 -- 172.21.15.133:0/720494330 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86440b76e0 msgr2=0x7f8644155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.129+0000 7f8642d9d700 1 --2- 172.21.15.133:0/720494330 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86440b76e0 0x7f8644155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.129+0000 7f8642d9d700 1 -- 172.21.15.133:0/720494330 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8638009420 con 0x7f86440679a0 2023-10-08T16:09:19.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.129+0000 7f8642d9d700 1 --2- 172.21.15.133:0/720494330 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86440679a0 0x7f864406a100 secure :-1 s=READY pgs=4389 cs=0 l=1 rev1=1 crypto rx=0x7f863400c4e0 tx=0x7f863400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:19.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.129+0000 7f862affd700 1 -- 172.21.15.133:0/720494330 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8634011590 con 0x7f86440679a0 2023-10-08T16:09:19.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.129+0000 7f862affd700 1 -- 172.21.15.133:0/720494330 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8634011710 con 0x7f86440679a0 2023-10-08T16:09:19.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.129+0000 7f86491fe700 1 -- 172.21.15.133:0/720494330 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8644155710 con 0x7f86440679a0 2023-10-08T16:09:19.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.129+0000 7f862affd700 1 -- 172.21.15.133:0/720494330 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8634011ad0 con 0x7f86440679a0 2023-10-08T16:09:19.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.129+0000 7f86491fe700 1 -- 172.21.15.133:0/720494330 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f864406bcd0 con 0x7f86440679a0 2023-10-08T16:09:19.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.129+0000 7f86491fe700 1 -- 172.21.15.133:0/720494330 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8644064810 con 0x7f86440679a0 2023-10-08T16:09:19.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.133+0000 7f862affd700 1 -- 172.21.15.133:0/720494330 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f863401b3b0 con 0x7f86440679a0 2023-10-08T16:09:19.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.133+0000 7f862affd700 1 --2- 172.21.15.133:0/720494330 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f8630060580 0x7f8630062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.133+0000 7f862affd700 1 -- 172.21.15.133:0/720494330 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f863407c460 con 0x7f86440679a0 2023-10-08T16:09:19.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.133+0000 7f864259c700 1 --2- 172.21.15.133:0/720494330 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f8630060580 0x7f8630062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.133+0000 7f862affd700 1 --2- 172.21.15.133:0/720494330 >> [v2:172.21.15.190:6809/33676,v1:172.21.15.190:6811/33676] conn(0x7f86300688f0 0x7f863006ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.133+0000 7f862affd700 1 -- 172.21.15.133:0/720494330 --> [v2:172.21.15.190:6809/33676,v1:172.21.15.190:6811/33676] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f863006b450 con 0x7f86300688f0 2023-10-08T16:09:19.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.133+0000 7f862affd700 1 -- 172.21.15.133:0/720494330 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f863407c750 con 0x7f86440679a0 2023-10-08T16:09:19.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.133+0000 7f864259c700 1 --2- 172.21.15.133:0/720494330 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f8630060580 0x7f8630062a30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f86380093f0 tx=0x7f8638017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:19.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.133+0000 7f864359e700 1 --2- 172.21.15.133:0/720494330 >> [v2:172.21.15.190:6809/33676,v1:172.21.15.190:6811/33676] conn(0x7f86300688f0 0x7f863006ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.133+0000 7f864359e700 1 --2- 172.21.15.133:0/720494330 >> [v2:172.21.15.190:6809/33676,v1:172.21.15.190:6811/33676] conn(0x7f86300688f0 0x7f863006ad80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:19.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.137+0000 7f862affd700 1 -- 172.21.15.133:0/720494330 <== osd.5 v2:172.21.15.190:6809/33676 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f863006b450 con 0x7f86300688f0 2023-10-08T16:09:19.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.153+0000 7f86491fe700 1 -- 172.21.15.133:0/720494330 --> [v2:172.21.15.190:6809/33676,v1:172.21.15.190:6811/33676] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f86440ad400 con 0x7f86300688f0 2023-10-08T16:09:19.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.153+0000 7f862affd700 1 -- 172.21.15.133:0/720494330 <== osd.5 v2:172.21.15.190:6809/33676 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f86440ad400 con 0x7f86300688f0 2023-10-08T16:09:19.155 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-10-08T16:09:19.155 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T16:09:19.155 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-10-08T16:09:19.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.153+0000 7f86491fe700 1 -- 172.21.15.133:0/720494330 >> [v2:172.21.15.190:6809/33676,v1:172.21.15.190:6811/33676] conn(0x7f86300688f0 msgr2=0x7f863006ad80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.153+0000 7f86491fe700 1 --2- 172.21.15.133:0/720494330 >> [v2:172.21.15.190:6809/33676,v1:172.21.15.190:6811/33676] conn(0x7f86300688f0 0x7f863006ad80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.153+0000 7f86491fe700 1 -- 172.21.15.133:0/720494330 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f8630060580 msgr2=0x7f8630062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.153+0000 7f86491fe700 1 --2- 172.21.15.133:0/720494330 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f8630060580 0x7f8630062a30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f86380093f0 tx=0x7f8638017000 comp rx=0 tx=0).stop 2023-10-08T16:09:19.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.153+0000 7f86491fe700 1 -- 172.21.15.133:0/720494330 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86440679a0 msgr2=0x7f864406a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.153+0000 7f86491fe700 1 --2- 172.21.15.133:0/720494330 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86440679a0 0x7f864406a100 secure :-1 s=READY pgs=4389 cs=0 l=1 rev1=1 crypto rx=0x7f863400c4e0 tx=0x7f863400c7f0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.153+0000 7f864359e700 1 -- 172.21.15.133:0/720494330 reap_dead start 2023-10-08T16:09:19.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.153+0000 7f86491fe700 1 -- 172.21.15.133:0/720494330 shutdown_connections 2023-10-08T16:09:19.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.153+0000 7f86491fe700 1 -- 172.21.15.133:0/720494330 >> 172.21.15.133:0/720494330 conn(0x7f86440b4300 msgr2=0x7f864406d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:19.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.153+0000 7f86491fe700 1 -- 172.21.15.133:0/720494330 shutdown_connections 2023-10-08T16:09:19.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.153+0000 7f86491fe700 1 -- 172.21.15.133:0/720494330 wait complete. 2023-10-08T16:09:19.166 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-08T16:09:19.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8cffff700 1 Processor -- start 2023-10-08T16:09:19.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8cffff700 1 -- start start 2023-10-08T16:09:19.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8cffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa8d00b1dc0 0x7fa8d00ae180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8cffff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8d00b0030 0x7fa8d0067c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8cffff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d00b0ec0 con 0x7fa8d00681b0 2023-10-08T16:09:19.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8cffff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d00ae6c0 con 0x7fa8d00b1dc0 2023-10-08T16:09:19.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8cffff700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d00ad4f0 con 0x7fa8d00b0030 2023-10-08T16:09:19.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8ceffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa8d00b1dc0 0x7fa8d00ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8ceffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa8d00b1dc0 0x7fa8d00ae180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48612/0 (socket says 172.21.15.133:48612) 2023-10-08T16:09:19.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8cf7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa8d00681b0 0x7fa8d014a080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56394/0 (socket says 172.21.15.133:56394) 2023-10-08T16:09:19.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8ceffd700 1 -- 172.21.15.133:0/1629026058 learned_addr learned my addr 172.21.15.133:0/1629026058 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:19.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8ce7fc700 1 --2- 172.21.15.133:0/1629026058 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8d00b0030 0x7fa8d0067c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8ceffd700 1 -- 172.21.15.133:0/1629026058 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8d00b0030 msgr2=0x7fa8d0067c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:19.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8ceffd700 1 --2- 172.21.15.133:0/1629026058 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8d00b0030 0x7fa8d0067c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8ceffd700 1 -- 172.21.15.133:0/1629026058 >> v1:172.21.15.133:6789/0 conn(0x7fa8d00681b0 legacy=0x7fa8d014a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8ceffd700 1 -- 172.21.15.133:0/1629026058 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d00ac250 con 0x7fa8d00b1dc0 2023-10-08T16:09:19.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8ce7fc700 1 --2- 172.21.15.133:0/1629026058 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8d00b0030 0x7fa8d0067c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:19.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8ceffd700 1 --2- 172.21.15.133:0/1629026058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8d00b1dc0 0x7fa8d00ae180 secure :-1 s=READY pgs=4391 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00099b0 tx=0x7fa8c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693cca54071d2c79 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:19.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8cdffb700 1 -- 172.21.15.133:0/1629026058 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c000b860 con 0x7fa8d00b1dc0 2023-10-08T16:09:19.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8cdffb700 1 -- 172.21.15.133:0/1629026058 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c000b9c0 con 0x7fa8d00b1dc0 2023-10-08T16:09:19.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8cdffb700 1 -- 172.21.15.133:0/1629026058 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c000bd60 con 0x7fa8d00b1dc0 2023-10-08T16:09:19.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8cffff700 1 -- 172.21.15.133:0/1629026058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8d00b1dc0 msgr2=0x7fa8d00ae180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8cffff700 1 --2- 172.21.15.133:0/1629026058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8d00b1dc0 0x7fa8d00ae180 secure :-1 s=READY pgs=4391 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00099b0 tx=0x7fa8c0009250 comp rx=0 tx=0).stop 2023-10-08T16:09:19.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8cffff700 1 -- 172.21.15.133:0/1629026058 shutdown_connections 2023-10-08T16:09:19.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8cffff700 1 --2- 172.21.15.133:0/1629026058 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8d00b0030 0x7fa8d0067c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8cffff700 1 --2- 172.21.15.133:0/1629026058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8d00b1dc0 0x7fa8d00ae180 unknown :-1 s=CLOSED pgs=4391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8cffff700 1 -- 172.21.15.133:0/1629026058 >> 172.21.15.133:0/1629026058 conn(0x7fa8d0063670 msgr2=0x7fa8d00b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:19.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8cffff700 1 -- 172.21.15.133:0/1629026058 shutdown_connections 2023-10-08T16:09:19.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.269+0000 7fa8cffff700 1 -- 172.21.15.133:0/1629026058 wait complete. 2023-10-08T16:09:19.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.273+0000 7fa8cffff700 1 Processor -- start 2023-10-08T16:09:19.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.273+0000 7fa8cffff700 1 -- start start 2023-10-08T16:09:19.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.273+0000 7fa8cffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8d00681b0 0x7fa8d006b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.273+0000 7fa8cffff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8d00b0030 0x7fa8d00a6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.273+0000 7fa8cffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8d00b1dc0 0x7fa8d01595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.273+0000 7fa8cffff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d00a5e90 con 0x7fa8d00681b0 2023-10-08T16:09:19.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.273+0000 7fa8cffff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d00a8200 con 0x7fa8d00b1dc0 2023-10-08T16:09:19.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.273+0000 7fa8cffff700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d00a84e0 con 0x7fa8d00b0030 2023-10-08T16:09:19.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.273+0000 7fa8ceffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8d00681b0 0x7fa8d006b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.273+0000 7fa8ceffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8d00681b0 0x7fa8d006b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48616/0 (socket says 172.21.15.133:48616) 2023-10-08T16:09:19.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.273+0000 7fa8ceffd700 1 -- 172.21.15.133:0/327231250 learned_addr learned my addr 172.21.15.133:0/327231250 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:19.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.273+0000 7fa8cf7fe700 1 --2- 172.21.15.133:0/327231250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8d00b1dc0 0x7fa8d01595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.273+0000 7fa8ce7fc700 1 --2- 172.21.15.133:0/327231250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8d00b0030 0x7fa8d00a6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.273+0000 7fa8ceffd700 1 -- 172.21.15.133:0/327231250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8d00b0030 msgr2=0x7fa8d00a6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.273+0000 7fa8ceffd700 1 --2- 172.21.15.133:0/327231250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8d00b0030 0x7fa8d00a6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.273+0000 7fa8ceffd700 1 -- 172.21.15.133:0/327231250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8d00b1dc0 msgr2=0x7fa8d01595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.273+0000 7fa8ceffd700 1 --2- 172.21.15.133:0/327231250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8d00b1dc0 0x7fa8d01595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.273+0000 7fa8ceffd700 1 -- 172.21.15.133:0/327231250 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c00094f0 con 0x7fa8d00681b0 2023-10-08T16:09:19.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.273+0000 7fa8ceffd700 1 --2- 172.21.15.133:0/327231250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8d00681b0 0x7fa8d006b320 secure :-1 s=READY pgs=4392 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009290 tx=0x7fa8c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:19.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.277+0000 7fa8c6ffd700 1 -- 172.21.15.133:0/327231250 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c001a450 con 0x7fa8d00681b0 2023-10-08T16:09:19.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.277+0000 7fa8c6ffd700 1 -- 172.21.15.133:0/327231250 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c001a5b0 con 0x7fa8d00681b0 2023-10-08T16:09:19.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.277+0000 7fa8cffff700 1 -- 172.21.15.133:0/327231250 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d00aa7f0 con 0x7fa8d00681b0 2023-10-08T16:09:19.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.277+0000 7fa8c6ffd700 1 -- 172.21.15.133:0/327231250 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c001a970 con 0x7fa8d00681b0 2023-10-08T16:09:19.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.277+0000 7fa8cffff700 1 -- 172.21.15.133:0/327231250 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d00a71b0 con 0x7fa8d00681b0 2023-10-08T16:09:19.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.277+0000 7fa8cffff700 1 -- 172.21.15.133:0/327231250 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d00a73d0 con 0x7fa8d00681b0 2023-10-08T16:09:19.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.277+0000 7fa8c6ffd700 1 -- 172.21.15.133:0/327231250 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa8c001ad20 con 0x7fa8d00681b0 2023-10-08T16:09:19.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.277+0000 7fa8c6ffd700 1 --2- 172.21.15.133:0/327231250 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fa8b0060550 0x7fa8b0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.277+0000 7fa8c6ffd700 1 -- 172.21.15.133:0/327231250 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fa8c007de10 con 0x7fa8d00681b0 2023-10-08T16:09:19.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.277+0000 7fa8ce7fc700 1 --2- 172.21.15.133:0/327231250 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fa8b0060550 0x7fa8b0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.281+0000 7fa8ce7fc700 1 --2- 172.21.15.133:0/327231250 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fa8b0060550 0x7fa8b0062a00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa8d006ea10 tx=0x7fa8c80098f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:19.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.289+0000 7fa8c6ffd700 1 -- 172.21.15.133:0/327231250 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa8c0081030 con 0x7fa8d00681b0 2023-10-08T16:09:19.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.453+0000 7fa8cffff700 1 -- 172.21.15.133:0/327231250 --> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8d004be40 con 0x7fa8b0060550 2023-10-08T16:09:19.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.453+0000 7fa8c6ffd700 1 -- 172.21.15.133:0/327231250 <== mgr.4104 v2:172.21.15.133:6832/33362 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa8d004be40 con 0x7fa8b0060550 2023-10-08T16:09:19.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.457+0000 7fa8cffff700 1 -- 172.21.15.133:0/327231250 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fa8b0060550 msgr2=0x7fa8b0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.457+0000 7fa8cffff700 1 --2- 172.21.15.133:0/327231250 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fa8b0060550 0x7fa8b0062a00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa8d006ea10 tx=0x7fa8c80098f0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.457+0000 7fa8cffff700 1 -- 172.21.15.133:0/327231250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8d00681b0 msgr2=0x7fa8d006b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.457+0000 7fa8cffff700 1 --2- 172.21.15.133:0/327231250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8d00681b0 0x7fa8d006b320 secure :-1 s=READY pgs=4392 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009290 tx=0x7fa8c0017000 comp rx=0 tx=0).stop 2023-10-08T16:09:19.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.457+0000 7fa8cffff700 1 -- 172.21.15.133:0/327231250 shutdown_connections 2023-10-08T16:09:19.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.457+0000 7fa8cffff700 1 --2- 172.21.15.133:0/327231250 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fa8b0060550 0x7fa8b0062a00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.457+0000 7fa8cffff700 1 --2- 172.21.15.133:0/327231250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8d00b1dc0 0x7fa8d01595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.457+0000 7fa8cffff700 1 --2- 172.21.15.133:0/327231250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8d00b0030 0x7fa8d00a6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.457+0000 7fa8cffff700 1 --2- 172.21.15.133:0/327231250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8d00681b0 0x7fa8d006b320 unknown :-1 s=CLOSED pgs=4392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.457+0000 7fa8cffff700 1 -- 172.21.15.133:0/327231250 >> 172.21.15.133:0/327231250 conn(0x7fa8d0063670 msgr2=0x7fa8d00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:19.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.457+0000 7fa8cffff700 1 -- 172.21.15.133:0/327231250 shutdown_connections 2023-10-08T16:09:19.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.457+0000 7fa8cffff700 1 -- 172.21.15.133:0/327231250 wait complete. 2023-10-08T16:09:19.460 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 5 to deep-scrub 2023-10-08T16:09:19.473 INFO:tasks.ceph:Scrubbing osd.6 2023-10-08T16:09:19.473 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-08T16:09:19.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.581+0000 7fbfc4f3c700 1 Processor -- start 2023-10-08T16:09:19.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.581+0000 7fbfc4f3c700 1 -- start start 2023-10-08T16:09:19.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.581+0000 7fbfc4f3c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbfc0145a00 0x7fbfc0145e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.581+0000 7fbfc4f3c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbfc013c130 0x7fbfc013c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.581+0000 7fbfc4f3c700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc00b4fa0 con 0x7fbfc00634e0 2023-10-08T16:09:19.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.581+0000 7fbfc4f3c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc00b1d10 con 0x7fbfc0145a00 2023-10-08T16:09:19.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.581+0000 7fbfc4f3c700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc0146370 con 0x7fbfc013c130 2023-10-08T16:09:19.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.581+0000 7fbfbeffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbfc0145a00 0x7fbfc0145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.581+0000 7fbfbeffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbfc0145a00 0x7fbfc0145e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58410/0 (socket says 172.21.15.133:58410) 2023-10-08T16:09:19.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.581+0000 7fbfbeffd700 1 -- 172.21.15.133:0/2633288262 learned_addr learned my addr 172.21.15.133:0/2633288262 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:19.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.581+0000 7fbfbffff700 1 --2- 172.21.15.133:0/2633288262 >> v2:172.21.15.190:3300/0 conn(0x7fbfc013c130 0x7fbfc013c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.581+0000 7fbfbeffd700 1 -- 172.21.15.133:0/2633288262 >> v2:172.21.15.190:3300/0 conn(0x7fbfc013c130 msgr2=0x7fbfc013c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:19.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.581+0000 7fbfbeffd700 1 --2- 172.21.15.133:0/2633288262 >> v2:172.21.15.190:3300/0 conn(0x7fbfc013c130 0x7fbfc013c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.581+0000 7fbfbeffd700 1 -- 172.21.15.133:0/2633288262 >> v1:172.21.15.190:6789/0 conn(0x7fbfc00634e0 legacy=0x7fbfc00b0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:19.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.581+0000 7fbfbeffd700 1 -- 172.21.15.133:0/2633288262 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc00b4950 con 0x7fbfc0145a00 2023-10-08T16:09:19.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.581+0000 7fbfbeffd700 1 --2- 172.21.15.133:0/2633288262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc0145a00 0x7fbfc0145e30 secure :-1 s=READY pgs=4393 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00afe10 tx=0x7fbfb0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3e7f1d2f1fa656 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:19.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.585+0000 7fbfbe7fc700 1 -- 172.21.15.133:0/2633288262 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb000b820 con 0x7fbfc0145a00 2023-10-08T16:09:19.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.585+0000 7fbfbe7fc700 1 -- 172.21.15.133:0/2633288262 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb000b980 con 0x7fbfc0145a00 2023-10-08T16:09:19.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.585+0000 7fbfbe7fc700 1 -- 172.21.15.133:0/2633288262 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb000bd20 con 0x7fbfc0145a00 2023-10-08T16:09:19.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.585+0000 7fbfc4f3c700 1 -- 172.21.15.133:0/2633288262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc0145a00 msgr2=0x7fbfc0145e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.585+0000 7fbfc4f3c700 1 --2- 172.21.15.133:0/2633288262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc0145a00 0x7fbfc0145e30 secure :-1 s=READY pgs=4393 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00afe10 tx=0x7fbfb0009250 comp rx=0 tx=0).stop 2023-10-08T16:09:19.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.585+0000 7fbfc4f3c700 1 -- 172.21.15.133:0/2633288262 shutdown_connections 2023-10-08T16:09:19.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.585+0000 7fbfc4f3c700 1 --2- 172.21.15.133:0/2633288262 >> v2:172.21.15.190:3300/0 conn(0x7fbfc013c130 0x7fbfc013c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.585+0000 7fbfc4f3c700 1 --2- 172.21.15.133:0/2633288262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc0145a00 0x7fbfc0145e30 unknown :-1 s=CLOSED pgs=4393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.585+0000 7fbfc4f3c700 1 -- 172.21.15.133:0/2633288262 >> 172.21.15.133:0/2633288262 conn(0x7fbfc0066f90 msgr2=0x7fbfc0062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:19.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.585+0000 7fbfc4f3c700 1 -- 172.21.15.133:0/2633288262 shutdown_connections 2023-10-08T16:09:19.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.585+0000 7fbfc4f3c700 1 -- 172.21.15.133:0/2633288262 wait complete. 2023-10-08T16:09:19.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.585+0000 7fbfc4f3c700 1 Processor -- start 2023-10-08T16:09:19.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.585+0000 7fbfc4f3c700 1 -- start start 2023-10-08T16:09:19.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.589+0000 7fbfc4f3c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc00634e0 0x7fbfc0155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.589+0000 7fbfc4f3c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfc013c130 0x7fbfc0147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.589+0000 7fbfc4f3c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfc0145a00 0x7fbfc0141680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.589+0000 7fbfc4f3c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc0141d90 con 0x7fbfc00634e0 2023-10-08T16:09:19.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.589+0000 7fbfc4f3c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc0138d40 con 0x7fbfc013c130 2023-10-08T16:09:19.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.589+0000 7fbfc4f3c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc0142650 con 0x7fbfc0145a00 2023-10-08T16:09:19.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.589+0000 7fbfbf7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc00634e0 0x7fbfc0155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.589+0000 7fbfbf7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc00634e0 0x7fbfc0155170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58424/0 (socket says 172.21.15.133:58424) 2023-10-08T16:09:19.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.589+0000 7fbfbf7fe700 1 -- 172.21.15.133:0/2950842488 learned_addr learned my addr 172.21.15.133:0/2950842488 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:19.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.589+0000 7fbfbeffd700 1 --2- 172.21.15.133:0/2950842488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfc013c130 0x7fbfc0147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.589+0000 7fbfbffff700 1 --2- 172.21.15.133:0/2950842488 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfc0145a00 0x7fbfc0141680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.589+0000 7fbfbf7fe700 1 -- 172.21.15.133:0/2950842488 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfc0145a00 msgr2=0x7fbfc0141680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.589+0000 7fbfbf7fe700 1 --2- 172.21.15.133:0/2950842488 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfc0145a00 0x7fbfc0141680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.589+0000 7fbfbf7fe700 1 -- 172.21.15.133:0/2950842488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfc013c130 msgr2=0x7fbfc0147fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.589+0000 7fbfbf7fe700 1 --2- 172.21.15.133:0/2950842488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfc013c130 0x7fbfc0147fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.589+0000 7fbfbf7fe700 1 -- 172.21.15.133:0/2950842488 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb00094f0 con 0x7fbfc00634e0 2023-10-08T16:09:19.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.589+0000 7fbfbeffd700 1 --2- 172.21.15.133:0/2950842488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfc013c130 0x7fbfc0147fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:19.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.589+0000 7fbfbffff700 1 --2- 172.21.15.133:0/2950842488 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfc0145a00 0x7fbfc0141680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:19.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.589+0000 7fbfbf7fe700 1 --2- 172.21.15.133:0/2950842488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc00634e0 0x7fbfc0155170 secure :-1 s=READY pgs=4394 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400c600 tx=0x7fbfb4007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:19.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.589+0000 7fbfa77fe700 1 -- 172.21.15.133:0/2950842488 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4011590 con 0x7fbfc00634e0 2023-10-08T16:09:19.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.589+0000 7fbfa77fe700 1 -- 172.21.15.133:0/2950842488 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb40116f0 con 0x7fbfc00634e0 2023-10-08T16:09:19.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.589+0000 7fbfa77fe700 1 -- 172.21.15.133:0/2950842488 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4011ab0 con 0x7fbfc00634e0 2023-10-08T16:09:19.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.589+0000 7fbfc4f3c700 1 -- 172.21.15.133:0/2950842488 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc013d730 con 0x7fbfc00634e0 2023-10-08T16:09:19.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.589+0000 7fbfc4f3c700 1 -- 172.21.15.133:0/2950842488 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc0140510 con 0x7fbfc00634e0 2023-10-08T16:09:19.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.589+0000 7fbfc4f3c700 1 -- 172.21.15.133:0/2950842488 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbfc0141bc0 con 0x7fbfc00634e0 2023-10-08T16:09:19.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.593+0000 7fbfa77fe700 1 -- 172.21.15.133:0/2950842488 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbfb401c460 con 0x7fbfc00634e0 2023-10-08T16:09:19.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.593+0000 7fbfa77fe700 1 --2- 172.21.15.133:0/2950842488 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fbfac060550 0x7fbfac062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.593+0000 7fbfa77fe700 1 -- 172.21.15.133:0/2950842488 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fbfb407c5a0 con 0x7fbfc00634e0 2023-10-08T16:09:19.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.593+0000 7fbfbeffd700 1 --2- 172.21.15.133:0/2950842488 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fbfac060550 0x7fbfac062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.593+0000 7fbfa77fe700 1 --2- 172.21.15.133:0/2950842488 >> [v2:172.21.15.190:6800/33677,v1:172.21.15.190:6801/33677] conn(0x7fbfac068940 0x7fbfac06add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.593+0000 7fbfa77fe700 1 -- 172.21.15.133:0/2950842488 --> [v2:172.21.15.190:6800/33677,v1:172.21.15.190:6801/33677] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbfac06b4a0 con 0x7fbfac068940 2023-10-08T16:09:19.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.593+0000 7fbfa77fe700 1 -- 172.21.15.133:0/2950842488 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbfb407ebe0 con 0x7fbfc00634e0 2023-10-08T16:09:19.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.593+0000 7fbfbeffd700 1 --2- 172.21.15.133:0/2950842488 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fbfac060550 0x7fbfac062a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00afe10 tx=0x7fbfb0016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:19.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.593+0000 7fbfbffff700 1 --2- 172.21.15.133:0/2950842488 >> [v2:172.21.15.190:6800/33677,v1:172.21.15.190:6801/33677] conn(0x7fbfac068940 0x7fbfac06add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.593+0000 7fbfbffff700 1 --2- 172.21.15.133:0/2950842488 >> [v2:172.21.15.190:6800/33677,v1:172.21.15.190:6801/33677] conn(0x7fbfac068940 0x7fbfac06add0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:19.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.597+0000 7fbfa77fe700 1 -- 172.21.15.133:0/2950842488 <== osd.6 v2:172.21.15.190:6800/33677 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fbfac06b4a0 con 0x7fbfac068940 2023-10-08T16:09:19.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.613+0000 7fbfc4f3c700 1 -- 172.21.15.133:0/2950842488 --> [v2:172.21.15.190:6800/33677,v1:172.21.15.190:6801/33677] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbfc0142140 con 0x7fbfac068940 2023-10-08T16:09:19.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.613+0000 7fbfa77fe700 1 -- 172.21.15.133:0/2950842488 <== osd.6 v2:172.21.15.190:6800/33677 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbfc0142140 con 0x7fbfac068940 2023-10-08T16:09:19.616 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-10-08T16:09:19.617 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T16:09:19.617 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-10-08T16:09:19.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.613+0000 7fbfc4f3c700 1 -- 172.21.15.133:0/2950842488 >> [v2:172.21.15.190:6800/33677,v1:172.21.15.190:6801/33677] conn(0x7fbfac068940 msgr2=0x7fbfac06add0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.613+0000 7fbfc4f3c700 1 --2- 172.21.15.133:0/2950842488 >> [v2:172.21.15.190:6800/33677,v1:172.21.15.190:6801/33677] conn(0x7fbfac068940 0x7fbfac06add0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.613+0000 7fbfc4f3c700 1 -- 172.21.15.133:0/2950842488 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fbfac060550 msgr2=0x7fbfac062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.613+0000 7fbfc4f3c700 1 --2- 172.21.15.133:0/2950842488 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fbfac060550 0x7fbfac062a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00afe10 tx=0x7fbfb0016000 comp rx=0 tx=0).stop 2023-10-08T16:09:19.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.613+0000 7fbfc4f3c700 1 -- 172.21.15.133:0/2950842488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc00634e0 msgr2=0x7fbfc0155170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.613+0000 7fbfc4f3c700 1 --2- 172.21.15.133:0/2950842488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc00634e0 0x7fbfc0155170 secure :-1 s=READY pgs=4394 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400c600 tx=0x7fbfb4007f60 comp rx=0 tx=0).stop 2023-10-08T16:09:19.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.613+0000 7fbfbffff700 1 -- 172.21.15.133:0/2950842488 reap_dead start 2023-10-08T16:09:19.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.613+0000 7fbfc4f3c700 1 -- 172.21.15.133:0/2950842488 shutdown_connections 2023-10-08T16:09:19.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.613+0000 7fbfc4f3c700 1 -- 172.21.15.133:0/2950842488 >> 172.21.15.133:0/2950842488 conn(0x7fbfc0066f90 msgr2=0x7fbfc00b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:19.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.613+0000 7fbfc4f3c700 1 -- 172.21.15.133:0/2950842488 shutdown_connections 2023-10-08T16:09:19.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.613+0000 7fbfc4f3c700 1 -- 172.21.15.133:0/2950842488 wait complete. 2023-10-08T16:09:19.629 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-08T16:09:19.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.741+0000 7f500d071700 1 Processor -- start 2023-10-08T16:09:19.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.741+0000 7f500d071700 1 -- start start 2023-10-08T16:09:19.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.741+0000 7f500d071700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f50080b59f0 0x7f50080b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.741+0000 7f500d071700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50081423c0 0x7f50081428d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.741+0000 7f500d071700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50080b2150 con 0x7f5008142e10 2023-10-08T16:09:19.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.741+0000 7f500d071700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50080b1070 con 0x7f50080b59f0 2023-10-08T16:09:19.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.741+0000 7f500d071700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50080b26f0 con 0x7f50081423c0 2023-10-08T16:09:19.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.741+0000 7f500c870700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5008142e10 0x7f50081459c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42552/0 (socket says 172.21.15.133:42552) 2023-10-08T16:09:19.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.741+0000 7f500c870700 1 -- 172.21.15.133:0/3608887179 learned_addr learned my addr 172.21.15.133:0/3608887179 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:09:19.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.741+0000 7f50077fe700 1 --2- 172.21.15.133:0/3608887179 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50081423c0 0x7f50081428d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.741+0000 7f5007fff700 1 --2- 172.21.15.133:0/3608887179 >> v2:172.21.15.190:3300/0 conn(0x7f50080b59f0 0x7f50080b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.741+0000 7f5006ffd700 1 -- 172.21.15.133:0/3608887179 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4210114967 0 0) 0x7f50080b2150 con 0x7f5008142e10 2023-10-08T16:09:19.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.741+0000 7f5006ffd700 1 -- 172.21.15.133:0/3608887179 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ff0003570 con 0x7f5008142e10 2023-10-08T16:09:19.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.741+0000 7f5007fff700 1 -- 172.21.15.133:0/3608887179 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50081423c0 msgr2=0x7f50081428d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:19.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.741+0000 7f5007fff700 1 --2- 172.21.15.133:0/3608887179 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50081423c0 0x7f50081428d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.741+0000 7f5007fff700 1 -- 172.21.15.133:0/3608887179 >> v1:172.21.15.133:6789/0 conn(0x7f5008142e10 legacy=0x7f50081459c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.741+0000 7f5007fff700 1 -- 172.21.15.133:0/3608887179 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50080b1cc0 con 0x7f50080b59f0 2023-10-08T16:09:19.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.745+0000 7f5007fff700 1 --2- 172.21.15.133:0/3608887179 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50080b59f0 0x7f50080b2b80 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7f50080b1e50 tx=0x7f4ff8009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=156390f821f72747 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:19.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.745+0000 7f5006ffd700 1 -- 172.21.15.133:0/3608887179 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8015070 con 0x7f50080b59f0 2023-10-08T16:09:19.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.745+0000 7f5006ffd700 1 -- 172.21.15.133:0/3608887179 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff8005c10 con 0x7f50080b59f0 2023-10-08T16:09:19.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.745+0000 7f5006ffd700 1 -- 172.21.15.133:0/3608887179 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8006030 con 0x7f50080b59f0 2023-10-08T16:09:19.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.745+0000 7f500d071700 1 -- 172.21.15.133:0/3608887179 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50080b59f0 msgr2=0x7f50080b2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.745+0000 7f500d071700 1 --2- 172.21.15.133:0/3608887179 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50080b59f0 0x7f50080b2b80 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7f50080b1e50 tx=0x7f4ff8009120 comp rx=0 tx=0).stop 2023-10-08T16:09:19.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.745+0000 7f500d071700 1 -- 172.21.15.133:0/3608887179 shutdown_connections 2023-10-08T16:09:19.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.745+0000 7f500d071700 1 --2- 172.21.15.133:0/3608887179 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50081423c0 0x7f50081428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.745+0000 7f500d071700 1 --2- 172.21.15.133:0/3608887179 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50080b59f0 0x7f50080b2b80 unknown :-1 s=CLOSED pgs=2253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.745+0000 7f500d071700 1 -- 172.21.15.133:0/3608887179 >> 172.21.15.133:0/3608887179 conn(0x7f5008062ba0 msgr2=0x7f5008062fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:19.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.745+0000 7f500d071700 1 -- 172.21.15.133:0/3608887179 shutdown_connections 2023-10-08T16:09:19.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.745+0000 7f500d071700 1 -- 172.21.15.133:0/3608887179 wait complete. 2023-10-08T16:09:19.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.745+0000 7f500d071700 1 Processor -- start 2023-10-08T16:09:19.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.745+0000 7f500d071700 1 -- start start 2023-10-08T16:09:19.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.745+0000 7f500d071700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50080b59f0 0x7f5008155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.745+0000 7f500d071700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50081423c0 0x7f5008145f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.745+0000 7f500d071700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5008142e10 0x7f50080aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.749+0000 7f500d071700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50080a82f0 con 0x7f50081423c0 2023-10-08T16:09:19.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.749+0000 7f500d071700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50080a90a0 con 0x7f50080b59f0 2023-10-08T16:09:19.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.749+0000 7f500d071700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5008145420 con 0x7f5008142e10 2023-10-08T16:09:19.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.749+0000 7f50077fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50081423c0 0x7f5008145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.749+0000 7f5007fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50080b59f0 0x7f5008155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.749+0000 7f50077fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50081423c0 0x7f5008145f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58430/0 (socket says 172.21.15.133:58430) 2023-10-08T16:09:19.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.749+0000 7f50077fe700 1 -- 172.21.15.133:0/3503401106 learned_addr learned my addr 172.21.15.133:0/3503401106 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:19.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.749+0000 7f500c870700 1 --2- 172.21.15.133:0/3503401106 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5008142e10 0x7f50080aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.749+0000 7f50077fe700 1 -- 172.21.15.133:0/3503401106 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5008142e10 msgr2=0x7f50080aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.749+0000 7f50077fe700 1 --2- 172.21.15.133:0/3503401106 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5008142e10 0x7f50080aea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.749+0000 7f50077fe700 1 -- 172.21.15.133:0/3503401106 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50080b59f0 msgr2=0x7f5008155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.749+0000 7f50077fe700 1 --2- 172.21.15.133:0/3503401106 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50080b59f0 0x7f5008155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.749+0000 7f50077fe700 1 -- 172.21.15.133:0/3503401106 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff80093c0 con 0x7f50081423c0 2023-10-08T16:09:19.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.749+0000 7f50077fe700 1 --2- 172.21.15.133:0/3503401106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50081423c0 0x7f5008145f00 secure :-1 s=READY pgs=4396 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00ec50 tx=0x7f4ffc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:19.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.749+0000 7f4feffff700 1 -- 172.21.15.133:0/3503401106 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc009690 con 0x7f50081423c0 2023-10-08T16:09:19.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.749+0000 7f4feffff700 1 -- 172.21.15.133:0/3503401106 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ffc00c850 con 0x7f50081423c0 2023-10-08T16:09:19.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.749+0000 7f500d071700 1 -- 172.21.15.133:0/3503401106 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5008145760 con 0x7f50081423c0 2023-10-08T16:09:19.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.749+0000 7f4feffff700 1 -- 172.21.15.133:0/3503401106 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc00cc10 con 0x7f50081423c0 2023-10-08T16:09:19.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.749+0000 7f500d071700 1 -- 172.21.15.133:0/3503401106 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50080a5770 con 0x7f50081423c0 2023-10-08T16:09:19.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.749+0000 7f500d071700 1 -- 172.21.15.133:0/3503401106 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5008145b80 con 0x7f50081423c0 2023-10-08T16:09:19.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.753+0000 7f4feffff700 1 -- 172.21.15.133:0/3503401106 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4ffc013470 con 0x7f50081423c0 2023-10-08T16:09:19.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.753+0000 7f4feffff700 1 --2- 172.21.15.133:0/3503401106 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f4ff4060550 0x7f4ff4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.753+0000 7f4feffff700 1 -- 172.21.15.133:0/3503401106 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f4ffc07c9f0 con 0x7f50081423c0 2023-10-08T16:09:19.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.753+0000 7f5007fff700 1 --2- 172.21.15.133:0/3503401106 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f4ff4060550 0x7f4ff4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.753+0000 7f5007fff700 1 --2- 172.21.15.133:0/3503401106 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f4ff4060550 0x7f4ff4062a00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009160 tx=0x7f4ff8015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:19.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.765+0000 7f4feffff700 1 -- 172.21.15.133:0/3503401106 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4ffc04cf50 con 0x7f50081423c0 2023-10-08T16:09:19.832 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:09:19.834 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:09:19.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.925+0000 7f500d071700 1 -- 172.21.15.133:0/3503401106 --> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f50081455e0 con 0x7f4ff4060550 2023-10-08T16:09:19.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.925+0000 7f4feffff700 1 -- 172.21.15.133:0/3503401106 <== mgr.4104 v2:172.21.15.133:6832/33362 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4ff8005f20 con 0x7f4ff4060550 2023-10-08T16:09:19.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.929+0000 7f500d071700 1 -- 172.21.15.133:0/3503401106 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f4ff4060550 msgr2=0x7f4ff4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.929+0000 7f500d071700 1 --2- 172.21.15.133:0/3503401106 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f4ff4060550 0x7f4ff4062a00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009160 tx=0x7f4ff8015000 comp rx=0 tx=0).stop 2023-10-08T16:09:19.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.929+0000 7f500d071700 1 -- 172.21.15.133:0/3503401106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50081423c0 msgr2=0x7f5008145f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.929+0000 7f500d071700 1 --2- 172.21.15.133:0/3503401106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50081423c0 0x7f5008145f00 secure :-1 s=READY pgs=4396 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00ec50 tx=0x7f4ffc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.929+0000 7f500d071700 1 -- 172.21.15.133:0/3503401106 shutdown_connections 2023-10-08T16:09:19.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.929+0000 7f500d071700 1 --2- 172.21.15.133:0/3503401106 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f4ff4060550 0x7f4ff4062a00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.929+0000 7f500d071700 1 --2- 172.21.15.133:0/3503401106 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5008142e10 0x7f50080aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.929+0000 7f500d071700 1 --2- 172.21.15.133:0/3503401106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50081423c0 0x7f5008145f00 unknown :-1 s=CLOSED pgs=4396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.929+0000 7f500d071700 1 --2- 172.21.15.133:0/3503401106 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50080b59f0 0x7f5008155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.929+0000 7f500d071700 1 -- 172.21.15.133:0/3503401106 >> 172.21.15.133:0/3503401106 conn(0x7f5008062ba0 msgr2=0x7f5008140330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:19.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.929+0000 7f500d071700 1 -- 172.21.15.133:0/3503401106 shutdown_connections 2023-10-08T16:09:19.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:19.929+0000 7f500d071700 1 -- 172.21.15.133:0/3503401106 wait complete. 2023-10-08T16:09:19.933 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 6 to deep-scrub 2023-10-08T16:09:19.943 INFO:tasks.ceph:Scrubbing osd.7 2023-10-08T16:09:19.943 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-08T16:09:20.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.049+0000 7fc9fb59e700 1 Processor -- start 2023-10-08T16:09:20.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.049+0000 7fc9fb59e700 1 -- start start 2023-10-08T16:09:20.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.049+0000 7fc9fb59e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9fc0b1890 0x7fc9fc0ac470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.049+0000 7fc9fb59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9fc0ae060 con 0x7fc9fc0b07d0 2023-10-08T16:09:20.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.049+0000 7fc9fb59e700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9fc0ae8e0 con 0x7fc9fc0b0350 2023-10-08T16:09:20.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.049+0000 7fc9fb59e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc0acf80 con 0x7fc9fc0b1890 2023-10-08T16:09:20.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.049+0000 7fc9fad9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc9fc0b07d0 0x7fc9fc0afa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42568/0 (socket says 172.21.15.133:42568) 2023-10-08T16:09:20.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.049+0000 7fc9fad9d700 1 -- 172.21.15.133:0/1656793415 learned_addr learned my addr 172.21.15.133:0/1656793415 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:09:20.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9fa59c700 1 --2- 172.21.15.133:0/1656793415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9fc0b1890 0x7fc9fc0ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9f9d9b700 1 -- 172.21.15.133:0/1656793415 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364166655 0 0) 0x7fc9fc0ae060 con 0x7fc9fc0b07d0 2023-10-08T16:09:20.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9f9d9b700 1 -- 172.21.15.133:0/1656793415 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9e8003570 con 0x7fc9fc0b07d0 2023-10-08T16:09:20.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9f9d9b700 1 -- 172.21.15.133:0/1656793415 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3283047201 0 0) 0x7fc9e8003570 con 0x7fc9fc0b07d0 2023-10-08T16:09:20.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9f9d9b700 1 -- 172.21.15.133:0/1656793415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9fc0b1890 msgr2=0x7fc9fc0ac470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:20.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9f9d9b700 1 --2- 172.21.15.133:0/1656793415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9fc0b1890 0x7fc9fc0ac470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9f9d9b700 1 -- 172.21.15.133:0/1656793415 >> v1:172.21.15.190:6789/0 conn(0x7fc9fc0b0350 legacy=0x7fc9fc0af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9f9d9b700 1 -- 172.21.15.133:0/1656793415 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9fc0b0140 con 0x7fc9fc0b07d0 2023-10-08T16:09:20.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9f9d9b700 1 -- 172.21.15.133:0/1656793415 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2883817959 0 0) 0x7fc9f40017f0 con 0x7fc9fc0b07d0 2023-10-08T16:09:20.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9f9d9b700 1 -- 172.21.15.133:0/1656793415 >> v1:172.21.15.133:6789/0 conn(0x7fc9fc0b07d0 legacy=0x7fc9fc0afa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9f9d9b700 1 --2- 172.21.15.133:0/1656793415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9fc0b1890 0x7fc9e8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9f9d9b700 1 --2- 172.21.15.133:0/1656793415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9e8003fd0 0x7fc9e8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9f9d9b700 1 --2- 172.21.15.133:0/1656793415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9e8004d50 0x7fc9e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9f9d9b700 1 -- 172.21.15.133:0/1656793415 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc0acf80 con 0x7fc9e8003fd0 2023-10-08T16:09:20.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9f9d9b700 1 -- 172.21.15.133:0/1656793415 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e800bb40 con 0x7fc9e8004d50 2023-10-08T16:09:20.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9f9d9b700 1 -- 172.21.15.133:0/1656793415 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e800bd00 con 0x7fc9fc0b1890 2023-10-08T16:09:20.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9fa59c700 1 --2- 172.21.15.133:0/1656793415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9fc0b1890 0x7fc9e8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9f1d9b700 1 --2- 172.21.15.133:0/1656793415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9e8003fd0 0x7fc9e8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9fad9d700 1 --2- 172.21.15.133:0/1656793415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9e8004d50 0x7fc9e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9f1d9b700 1 -- 172.21.15.133:0/1656793415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9fc0b1890 msgr2=0x7fc9e8003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:20.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9f1d9b700 1 --2- 172.21.15.133:0/1656793415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9fc0b1890 0x7fc9e8003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9f1d9b700 1 -- 172.21.15.133:0/1656793415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9e8004d50 msgr2=0x7fc9e80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:20.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9f1d9b700 1 --2- 172.21.15.133:0/1656793415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9e8004d50 0x7fc9e80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9f1d9b700 1 -- 172.21.15.133:0/1656793415 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e8003570 con 0x7fc9e8003fd0 2023-10-08T16:09:20.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9fad9d700 1 --2- 172.21.15.133:0/1656793415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9e8004d50 0x7fc9e80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:20.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9f1d9b700 1 --2- 172.21.15.133:0/1656793415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9e8003fd0 0x7fc9e8004810 secure :-1 s=READY pgs=4398 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4001a60 tx=0x7fc9e4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80536481c48ba11b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:20.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9f9d9b700 1 -- 172.21.15.133:0/1656793415 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4001ea0 con 0x7fc9e8003fd0 2023-10-08T16:09:20.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9f9d9b700 1 -- 172.21.15.133:0/1656793415 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e400c590 con 0x7fc9e8003fd0 2023-10-08T16:09:20.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9f9d9b700 1 -- 172.21.15.133:0/1656793415 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e400c930 con 0x7fc9e8003fd0 2023-10-08T16:09:20.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9fb59e700 1 -- 172.21.15.133:0/1656793415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9e8003fd0 msgr2=0x7fc9e8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9fb59e700 1 --2- 172.21.15.133:0/1656793415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9e8003fd0 0x7fc9e8004810 secure :-1 s=READY pgs=4398 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4001a60 tx=0x7fc9e4007d30 comp rx=0 tx=0).stop 2023-10-08T16:09:20.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9fad9d700 1 -- 172.21.15.133:0/1656793415 reap_dead start 2023-10-08T16:09:20.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9fb59e700 1 -- 172.21.15.133:0/1656793415 shutdown_connections 2023-10-08T16:09:20.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9fb59e700 1 -- 172.21.15.133:0/1656793415 >> 172.21.15.133:0/1656793415 conn(0x7fc9fc062ba0 msgr2=0x7fc9fc062fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:20.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9fb59e700 1 -- 172.21.15.133:0/1656793415 shutdown_connections 2023-10-08T16:09:20.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.053+0000 7fc9fb59e700 1 -- 172.21.15.133:0/1656793415 wait complete. 2023-10-08T16:09:20.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.057+0000 7fc9fb59e700 1 Processor -- start 2023-10-08T16:09:20.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.057+0000 7fc9fb59e700 1 -- start start 2023-10-08T16:09:20.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.057+0000 7fc9fb59e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9e8003fd0 0x7fc9fc0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.057+0000 7fc9fb59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9fc13cc90 0x7fc9fc155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.057+0000 7fc9fb59e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9fc155890 0x7fc9fc1387c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.057+0000 7fc9fb59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc13dda0 con 0x7fc9fc13cc90 2023-10-08T16:09:20.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.057+0000 7fc9fb59e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc155d00 con 0x7fc9fc155890 2023-10-08T16:09:20.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.057+0000 7fc9fb59e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc13e010 con 0x7fc9e8003fd0 2023-10-08T16:09:20.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.057+0000 7fc9f1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9fc13cc90 0x7fc9fc155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.057+0000 7fc9f1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9fc13cc90 0x7fc9fc155350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58456/0 (socket says 172.21.15.133:58456) 2023-10-08T16:09:20.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.057+0000 7fc9f1d9b700 1 -- 172.21.15.133:0/2708564455 learned_addr learned my addr 172.21.15.133:0/2708564455 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:20.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.057+0000 7fc9fa59c700 1 --2- 172.21.15.133:0/2708564455 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9e8003fd0 0x7fc9fc0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.057+0000 7fc9fad9d700 1 --2- 172.21.15.133:0/2708564455 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9fc155890 0x7fc9fc1387c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.057+0000 7fc9f1d9b700 1 -- 172.21.15.133:0/2708564455 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9e8003fd0 msgr2=0x7fc9fc0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.057+0000 7fc9f1d9b700 1 --2- 172.21.15.133:0/2708564455 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9e8003fd0 0x7fc9fc0b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.057+0000 7fc9f1d9b700 1 -- 172.21.15.133:0/2708564455 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9fc155890 msgr2=0x7fc9fc1387c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.057+0000 7fc9f1d9b700 1 --2- 172.21.15.133:0/2708564455 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9fc155890 0x7fc9fc1387c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.057+0000 7fc9f1d9b700 1 -- 172.21.15.133:0/2708564455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9fc1450c0 con 0x7fc9fc13cc90 2023-10-08T16:09:20.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.057+0000 7fc9f1d9b700 1 --2- 172.21.15.133:0/2708564455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9fc13cc90 0x7fc9fc155350 secure :-1 s=READY pgs=4399 cs=0 l=1 rev1=1 crypto rx=0x7fc9e800bb10 tx=0x7fc9e4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:20.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.057+0000 7fc9f2ffd700 1 -- 172.21.15.133:0/2708564455 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4001ea0 con 0x7fc9fc13cc90 2023-10-08T16:09:20.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.057+0000 7fc9f2ffd700 1 -- 172.21.15.133:0/2708564455 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e400c700 con 0x7fc9fc13cc90 2023-10-08T16:09:20.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.057+0000 7fc9fb59e700 1 -- 172.21.15.133:0/2708564455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9fc1453a0 con 0x7fc9fc13cc90 2023-10-08T16:09:20.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.057+0000 7fc9f2ffd700 1 -- 172.21.15.133:0/2708564455 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e400cca0 con 0x7fc9fc13cc90 2023-10-08T16:09:20.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.057+0000 7fc9fb59e700 1 -- 172.21.15.133:0/2708564455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9fc0b4470 con 0x7fc9fc13cc90 2023-10-08T16:09:20.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.057+0000 7fc9fb59e700 1 -- 172.21.15.133:0/2708564455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc9fc04be40 con 0x7fc9fc13cc90 2023-10-08T16:09:20.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.061+0000 7fc9f2ffd700 1 -- 172.21.15.133:0/2708564455 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc9e4019030 con 0x7fc9fc13cc90 2023-10-08T16:09:20.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.061+0000 7fc9f2ffd700 1 --2- 172.21.15.133:0/2708564455 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fc9dc060550 0x7fc9dc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.061+0000 7fc9f2ffd700 1 -- 172.21.15.133:0/2708564455 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fc9e407dd50 con 0x7fc9fc13cc90 2023-10-08T16:09:20.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.061+0000 7fc9fa59c700 1 --2- 172.21.15.133:0/2708564455 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fc9dc060550 0x7fc9dc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.061+0000 7fc9f2ffd700 1 --2- 172.21.15.133:0/2708564455 >> [v2:172.21.15.190:6824/33686,v1:172.21.15.190:6825/33686] conn(0x7fc9dc0688b0 0x7fc9dc06ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.061+0000 7fc9f2ffd700 1 -- 172.21.15.133:0/2708564455 --> [v2:172.21.15.190:6824/33686,v1:172.21.15.190:6825/33686] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc9dc06b410 con 0x7fc9dc0688b0 2023-10-08T16:09:20.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.061+0000 7fc9f2ffd700 1 -- 172.21.15.133:0/2708564455 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9e407e120 con 0x7fc9fc13cc90 2023-10-08T16:09:20.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.061+0000 7fc9fad9d700 1 --2- 172.21.15.133:0/2708564455 >> [v2:172.21.15.190:6824/33686,v1:172.21.15.190:6825/33686] conn(0x7fc9dc0688b0 0x7fc9dc06ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.061+0000 7fc9fa59c700 1 --2- 172.21.15.133:0/2708564455 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fc9dc060550 0x7fc9dc062a00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec006f00 tx=0x7fc9ec0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:20.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.061+0000 7fc9fad9d700 1 --2- 172.21.15.133:0/2708564455 >> [v2:172.21.15.190:6824/33686,v1:172.21.15.190:6825/33686] conn(0x7fc9dc0688b0 0x7fc9dc06ad40 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:20.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.065+0000 7fc9f2ffd700 1 -- 172.21.15.133:0/2708564455 <== osd.7 v2:172.21.15.190:6824/33686 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc9dc06b410 con 0x7fc9dc0688b0 2023-10-08T16:09:20.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.081+0000 7fc9fb59e700 1 -- 172.21.15.133:0/2708564455 --> [v2:172.21.15.190:6824/33686,v1:172.21.15.190:6825/33686] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc9fc067580 con 0x7fc9dc0688b0 2023-10-08T16:09:20.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.081+0000 7fc9f2ffd700 1 -- 172.21.15.133:0/2708564455 <== osd.7 v2:172.21.15.190:6824/33686 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc9fc067580 con 0x7fc9dc0688b0 2023-10-08T16:09:20.083 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-10-08T16:09:20.083 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T16:09:20.084 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-10-08T16:09:20.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.081+0000 7fc9fb59e700 1 -- 172.21.15.133:0/2708564455 >> [v2:172.21.15.190:6824/33686,v1:172.21.15.190:6825/33686] conn(0x7fc9dc0688b0 msgr2=0x7fc9dc06ad40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.081+0000 7fc9fb59e700 1 --2- 172.21.15.133:0/2708564455 >> [v2:172.21.15.190:6824/33686,v1:172.21.15.190:6825/33686] conn(0x7fc9dc0688b0 0x7fc9dc06ad40 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.081+0000 7fc9fb59e700 1 -- 172.21.15.133:0/2708564455 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fc9dc060550 msgr2=0x7fc9dc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.081+0000 7fc9fb59e700 1 --2- 172.21.15.133:0/2708564455 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fc9dc060550 0x7fc9dc062a00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec006f00 tx=0x7fc9ec0091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.081+0000 7fc9fb59e700 1 -- 172.21.15.133:0/2708564455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9fc13cc90 msgr2=0x7fc9fc155350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.081+0000 7fc9fb59e700 1 --2- 172.21.15.133:0/2708564455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9fc13cc90 0x7fc9fc155350 secure :-1 s=READY pgs=4399 cs=0 l=1 rev1=1 crypto rx=0x7fc9e800bb10 tx=0x7fc9e4015000 comp rx=0 tx=0).stop 2023-10-08T16:09:20.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.081+0000 7fc9fad9d700 1 -- 172.21.15.133:0/2708564455 reap_dead start 2023-10-08T16:09:20.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.081+0000 7fc9fb59e700 1 -- 172.21.15.133:0/2708564455 shutdown_connections 2023-10-08T16:09:20.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.081+0000 7fc9fb59e700 1 -- 172.21.15.133:0/2708564455 >> 172.21.15.133:0/2708564455 conn(0x7fc9fc062ba0 msgr2=0x7fc9fc142460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:20.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.081+0000 7fc9fb59e700 1 -- 172.21.15.133:0/2708564455 shutdown_connections 2023-10-08T16:09:20.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.081+0000 7fc9fb59e700 1 -- 172.21.15.133:0/2708564455 wait complete. 2023-10-08T16:09:20.095 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-08T16:09:20.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.201+0000 7f3eab59e700 1 Processor -- start 2023-10-08T16:09:20.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.201+0000 7f3eab59e700 1 -- start start 2023-10-08T16:09:20.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.201+0000 7f3eab59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3eac0b59f0 0x7f3eac0b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.201+0000 7f3eab59e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3eac1423c0 0x7f3eac1428d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.201+0000 7f3eab59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eac0b2150 con 0x7f3eac142e10 2023-10-08T16:09:20.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.201+0000 7f3eab59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eac0b1070 con 0x7f3eac0b59f0 2023-10-08T16:09:20.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.201+0000 7f3eab59e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac0b26f0 con 0x7f3eac1423c0 2023-10-08T16:09:20.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.201+0000 7f3eaa59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3eac0b59f0 0x7f3eac0b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.201+0000 7f3eaa59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3eac0b59f0 0x7f3eac0b2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58470/0 (socket says 172.21.15.133:58470) 2023-10-08T16:09:20.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.201+0000 7f3eaad9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3eac142e10 0x7f3eac1459c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42578/0 (socket says 172.21.15.133:42578) 2023-10-08T16:09:20.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.201+0000 7f3eaa59c700 1 -- 172.21.15.133:0/959560741 learned_addr learned my addr 172.21.15.133:0/959560741 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:20.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.201+0000 7f3ea9d9b700 1 --2- 172.21.15.133:0/959560741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3eac1423c0 0x7f3eac1428d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.201+0000 7f3eaa59c700 1 -- 172.21.15.133:0/959560741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3eac1423c0 msgr2=0x7f3eac1428d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:20.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.201+0000 7f3eaa59c700 1 --2- 172.21.15.133:0/959560741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3eac1423c0 0x7f3eac1428d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.201+0000 7f3eaa59c700 1 -- 172.21.15.133:0/959560741 >> v1:172.21.15.133:6789/0 conn(0x7f3eac142e10 legacy=0x7f3eac1459c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.201+0000 7f3eaa59c700 1 -- 172.21.15.133:0/959560741 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac0b1cc0 con 0x7f3eac0b59f0 2023-10-08T16:09:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.201+0000 7f3ea959a700 1 -- 172.21.15.133:0/959560741 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051891080 0 0) 0x7f3eac0b2150 con 0x7f3eac142e10 2023-10-08T16:09:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.201+0000 7f3eaa59c700 1 --2- 172.21.15.133:0/959560741 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3eac0b59f0 0x7f3eac0b2b80 secure :-1 s=READY pgs=4401 cs=0 l=1 rev1=1 crypto rx=0x7f3eac0b1e50 tx=0x7f3e94009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71beb9ad7a273192 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:20.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.201+0000 7f3ea959a700 1 -- 172.21.15.133:0/959560741 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e94005c10 con 0x7f3eac0b59f0 2023-10-08T16:09:20.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.201+0000 7f3ea959a700 1 -- 172.21.15.133:0/959560741 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e94005d70 con 0x7f3eac0b59f0 2023-10-08T16:09:20.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.201+0000 7f3ea959a700 1 -- 172.21.15.133:0/959560741 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e94006280 con 0x7f3eac0b59f0 2023-10-08T16:09:20.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.205+0000 7f3eab59e700 1 -- 172.21.15.133:0/959560741 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3eac0b59f0 msgr2=0x7f3eac0b2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.205+0000 7f3eab59e700 1 --2- 172.21.15.133:0/959560741 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3eac0b59f0 0x7f3eac0b2b80 secure :-1 s=READY pgs=4401 cs=0 l=1 rev1=1 crypto rx=0x7f3eac0b1e50 tx=0x7f3e94009220 comp rx=0 tx=0).stop 2023-10-08T16:09:20.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.205+0000 7f3eab59e700 1 -- 172.21.15.133:0/959560741 shutdown_connections 2023-10-08T16:09:20.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.205+0000 7f3eab59e700 1 --2- 172.21.15.133:0/959560741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3eac1423c0 0x7f3eac1428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.205+0000 7f3eab59e700 1 --2- 172.21.15.133:0/959560741 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3eac0b59f0 0x7f3eac0b2b80 unknown :-1 s=CLOSED pgs=4401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.205+0000 7f3eab59e700 1 -- 172.21.15.133:0/959560741 >> 172.21.15.133:0/959560741 conn(0x7f3eac062ba0 msgr2=0x7f3eac062fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:20.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.205+0000 7f3eab59e700 1 -- 172.21.15.133:0/959560741 shutdown_connections 2023-10-08T16:09:20.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.205+0000 7f3eab59e700 1 -- 172.21.15.133:0/959560741 wait complete. 2023-10-08T16:09:20.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.205+0000 7f3eab59e700 1 Processor -- start 2023-10-08T16:09:20.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.205+0000 7f3eab59e700 1 -- start start 2023-10-08T16:09:20.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.209+0000 7f3eab59e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3eac0b59f0 0x7f3eac1560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.209+0000 7f3eab59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3eac1423c0 0x7f3eac1460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.209+0000 7f3eab59e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3eac142e10 0x7f3eac13ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.209+0000 7f3eab59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac0aeb90 con 0x7f3eac1423c0 2023-10-08T16:09:20.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.209+0000 7f3eab59e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac156600 con 0x7f3eac0b59f0 2023-10-08T16:09:20.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.209+0000 7f3eab59e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac0a63a0 con 0x7f3eac142e10 2023-10-08T16:09:20.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.209+0000 7f3ea9d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3eac1423c0 0x7f3eac1460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.209+0000 7f3ea9d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3eac1423c0 0x7f3eac1460d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58484/0 (socket says 172.21.15.133:58484) 2023-10-08T16:09:20.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.209+0000 7f3ea9d9b700 1 -- 172.21.15.133:0/696615263 learned_addr learned my addr 172.21.15.133:0/696615263 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:20.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.209+0000 7f3eaad9d700 1 --2- 172.21.15.133:0/696615263 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3eac142e10 0x7f3eac13ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.209+0000 7f3ea9d9b700 1 -- 172.21.15.133:0/696615263 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3eac142e10 msgr2=0x7f3eac13ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.209+0000 7f3eaa59c700 1 --2- 172.21.15.133:0/696615263 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3eac0b59f0 0x7f3eac1560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.209+0000 7f3ea9d9b700 1 --2- 172.21.15.133:0/696615263 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3eac142e10 0x7f3eac13ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.209+0000 7f3ea9d9b700 1 -- 172.21.15.133:0/696615263 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3eac0b59f0 msgr2=0x7f3eac1560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.209+0000 7f3ea9d9b700 1 --2- 172.21.15.133:0/696615263 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3eac0b59f0 0x7f3eac1560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.209+0000 7f3ea9d9b700 1 -- 172.21.15.133:0/696615263 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e94009480 con 0x7f3eac1423c0 2023-10-08T16:09:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.209+0000 7f3eaad9d700 1 --2- 172.21.15.133:0/696615263 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3eac142e10 0x7f3eac13ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.209+0000 7f3eaa59c700 1 --2- 172.21.15.133:0/696615263 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3eac0b59f0 0x7f3eac1560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.209+0000 7f3ea9d9b700 1 --2- 172.21.15.133:0/696615263 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3eac1423c0 0x7f3eac1460d0 secure :-1 s=READY pgs=4402 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009eb0 tx=0x7f3ea400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.209+0000 7f3ea27fc700 1 -- 172.21.15.133:0/696615263 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea400cbc0 con 0x7f3eac1423c0 2023-10-08T16:09:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.209+0000 7f3ea27fc700 1 -- 172.21.15.133:0/696615263 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea400f040 con 0x7f3eac1423c0 2023-10-08T16:09:20.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.209+0000 7f3eab59e700 1 -- 172.21.15.133:0/696615263 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eac0a6130 con 0x7f3eac1423c0 2023-10-08T16:09:20.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.209+0000 7f3ea27fc700 1 -- 172.21.15.133:0/696615263 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4014480 con 0x7f3eac1423c0 2023-10-08T16:09:20.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.209+0000 7f3eab59e700 1 -- 172.21.15.133:0/696615263 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eac155ba0 con 0x7f3eac1423c0 2023-10-08T16:09:20.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.209+0000 7f3eab59e700 1 -- 172.21.15.133:0/696615263 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eac155dc0 con 0x7f3eac1423c0 2023-10-08T16:09:20.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.213+0000 7f3ea27fc700 1 -- 172.21.15.133:0/696615263 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3ea40147f0 con 0x7f3eac1423c0 2023-10-08T16:09:20.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.213+0000 7f3ea27fc700 1 --2- 172.21.15.133:0/696615263 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f3e8c060580 0x7f3e8c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.213+0000 7f3eaa59c700 1 --2- 172.21.15.133:0/696615263 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f3e8c060580 0x7f3e8c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.213+0000 7f3ea27fc700 1 -- 172.21.15.133:0/696615263 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f3ea407d4b0 con 0x7f3eac1423c0 2023-10-08T16:09:20.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.213+0000 7f3eaa59c700 1 --2- 172.21.15.133:0/696615263 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f3e8c060580 0x7f3e8c062a30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3e94003080 tx=0x7f3e94015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:20.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.217+0000 7f3ea27fc700 1 -- 172.21.15.133:0/696615263 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3ea40514a0 con 0x7f3eac1423c0 2023-10-08T16:09:20.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.377+0000 7f3eab59e700 1 -- 172.21.15.133:0/696615263 --> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f3eac0a5610 con 0x7f3e8c060580 2023-10-08T16:09:20.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.377+0000 7f3ea27fc700 1 -- 172.21.15.133:0/696615263 <== mgr.4104 v2:172.21.15.133:6832/33362 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3eac0a5610 con 0x7f3e8c060580 2023-10-08T16:09:20.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.381+0000 7f3eab59e700 1 -- 172.21.15.133:0/696615263 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f3e8c060580 msgr2=0x7f3e8c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.381+0000 7f3eab59e700 1 --2- 172.21.15.133:0/696615263 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f3e8c060580 0x7f3e8c062a30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3e94003080 tx=0x7f3e94015000 comp rx=0 tx=0).stop 2023-10-08T16:09:20.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.381+0000 7f3eab59e700 1 -- 172.21.15.133:0/696615263 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3eac1423c0 msgr2=0x7f3eac1460d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.381+0000 7f3eab59e700 1 --2- 172.21.15.133:0/696615263 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3eac1423c0 0x7f3eac1460d0 secure :-1 s=READY pgs=4402 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009eb0 tx=0x7f3ea400b040 comp rx=0 tx=0).stop 2023-10-08T16:09:20.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.381+0000 7f3eab59e700 1 -- 172.21.15.133:0/696615263 shutdown_connections 2023-10-08T16:09:20.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.381+0000 7f3eab59e700 1 --2- 172.21.15.133:0/696615263 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f3e8c060580 0x7f3e8c062a30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.381+0000 7f3eab59e700 1 --2- 172.21.15.133:0/696615263 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3eac142e10 0x7f3eac13ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.381+0000 7f3eab59e700 1 --2- 172.21.15.133:0/696615263 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3eac1423c0 0x7f3eac1460d0 unknown :-1 s=CLOSED pgs=4402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.381+0000 7f3eab59e700 1 --2- 172.21.15.133:0/696615263 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3eac0b59f0 0x7f3eac1560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.381+0000 7f3eab59e700 1 -- 172.21.15.133:0/696615263 >> 172.21.15.133:0/696615263 conn(0x7f3eac062ba0 msgr2=0x7f3eac0631b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:20.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.381+0000 7f3eab59e700 1 -- 172.21.15.133:0/696615263 shutdown_connections 2023-10-08T16:09:20.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.381+0000 7f3eab59e700 1 -- 172.21.15.133:0/696615263 wait complete. 2023-10-08T16:09:20.385 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 7 to deep-scrub 2023-10-08T16:09:20.399 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:09:20.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.501+0000 7fed4d978700 1 Processor -- start 2023-10-08T16:09:20.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.501+0000 7fed4d978700 1 -- start start 2023-10-08T16:09:20.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.501+0000 7fed4d978700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed4806e9a0 0x7fed48140280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.501+0000 7fed4d978700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed4806b610 con 0x7fed480b1dc0 2023-10-08T16:09:20.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.501+0000 7fed4d978700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed480afc70 con 0x7fed480ab960 2023-10-08T16:09:20.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.501+0000 7fed4d978700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed480b0060 con 0x7fed4806e9a0 2023-10-08T16:09:20.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.501+0000 7fed4c976700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fed480b1dc0 0x7fed4806e290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42588/0 (socket says 172.21.15.133:42588) 2023-10-08T16:09:20.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.501+0000 7fed4c976700 1 -- 172.21.15.133:0/1956514333 learned_addr learned my addr 172.21.15.133:0/1956514333 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:09:20.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.501+0000 7fed4d177700 1 --2- 172.21.15.133:0/1956514333 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed4806e9a0 0x7fed48140280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.501+0000 7fed3f7fe700 1 -- 172.21.15.133:0/1956514333 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109429284 0 0) 0x7fed4806b610 con 0x7fed480b1dc0 2023-10-08T16:09:20.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed3f7fe700 1 -- 172.21.15.133:0/1956514333 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed30003570 con 0x7fed480b1dc0 2023-10-08T16:09:20.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed3f7fe700 1 -- 172.21.15.133:0/1956514333 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 260984193 0 0) 0x7fed30003570 con 0x7fed480b1dc0 2023-10-08T16:09:20.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed3f7fe700 1 -- 172.21.15.133:0/1956514333 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed4806e9a0 msgr2=0x7fed48140280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:20.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed3f7fe700 1 --2- 172.21.15.133:0/1956514333 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed4806e9a0 0x7fed48140280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed3f7fe700 1 -- 172.21.15.133:0/1956514333 >> v1:172.21.15.190:6789/0 conn(0x7fed480ab960 legacy=0x7fed48148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed3f7fe700 1 -- 172.21.15.133:0/1956514333 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed480b0340 con 0x7fed480b1dc0 2023-10-08T16:09:20.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed3f7fe700 1 -- 172.21.15.133:0/1956514333 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2883817959 0 0) 0x7fed44001490 con 0x7fed480b1dc0 2023-10-08T16:09:20.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed4d177700 1 --2- 172.21.15.133:0/1956514333 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed4806e9a0 0x7fed48140280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:20.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed3f7fe700 1 -- 172.21.15.133:0/1956514333 >> v1:172.21.15.133:6789/0 conn(0x7fed480b1dc0 legacy=0x7fed4806e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed3f7fe700 1 --2- 172.21.15.133:0/1956514333 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed30003a90 0x7fed30003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed3f7fe700 1 --2- 172.21.15.133:0/1956514333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed30004810 0x7fed30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed3f7fe700 1 --2- 172.21.15.133:0/1956514333 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed30005210 0x7fed3000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed3f7fe700 1 -- 172.21.15.133:0/1956514333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed480b0060 con 0x7fed30004810 2023-10-08T16:09:20.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed3f7fe700 1 -- 172.21.15.133:0/1956514333 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3000c190 con 0x7fed30005210 2023-10-08T16:09:20.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed3f7fe700 1 -- 172.21.15.133:0/1956514333 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3000c350 con 0x7fed30003a90 2023-10-08T16:09:20.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed4c976700 1 --2- 172.21.15.133:0/1956514333 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed30003a90 0x7fed30003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed4d177700 1 --2- 172.21.15.133:0/1956514333 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed30005210 0x7fed3000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed3ffff700 1 --2- 172.21.15.133:0/1956514333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed30004810 0x7fed30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed4c976700 1 -- 172.21.15.133:0/1956514333 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed30005210 msgr2=0x7fed3000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:20.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed4c976700 1 --2- 172.21.15.133:0/1956514333 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed30005210 0x7fed3000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed4c976700 1 -- 172.21.15.133:0/1956514333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed30004810 msgr2=0x7fed30004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:20.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed4c976700 1 --2- 172.21.15.133:0/1956514333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed30004810 0x7fed30004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed4c976700 1 -- 172.21.15.133:0/1956514333 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed30003570 con 0x7fed30003a90 2023-10-08T16:09:20.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed4c976700 1 --2- 172.21.15.133:0/1956514333 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed30003a90 0x7fed30003ea0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fed4400c390 tx=0x7fed44001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebf3f9a68d4a21cb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:20.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed3f7fe700 1 -- 172.21.15.133:0/1956514333 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4400cc60 con 0x7fed30003a90 2023-10-08T16:09:20.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed3f7fe700 1 -- 172.21.15.133:0/1956514333 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4400cdc0 con 0x7fed30003a90 2023-10-08T16:09:20.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed3f7fe700 1 -- 172.21.15.133:0/1956514333 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed44004b40 con 0x7fed30003a90 2023-10-08T16:09:20.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed4d978700 1 -- 172.21.15.133:0/1956514333 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed30003a90 msgr2=0x7fed30003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed4d978700 1 --2- 172.21.15.133:0/1956514333 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed30003a90 0x7fed30003ea0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fed4400c390 tx=0x7fed44001e70 comp rx=0 tx=0).stop 2023-10-08T16:09:20.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed4d177700 1 -- 172.21.15.133:0/1956514333 reap_dead start 2023-10-08T16:09:20.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed4d978700 1 -- 172.21.15.133:0/1956514333 shutdown_connections 2023-10-08T16:09:20.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed4d978700 1 -- 172.21.15.133:0/1956514333 >> 172.21.15.133:0/1956514333 conn(0x7fed48063670 msgr2=0x7fed480b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:20.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed4d978700 1 -- 172.21.15.133:0/1956514333 shutdown_connections 2023-10-08T16:09:20.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.505+0000 7fed4d978700 1 -- 172.21.15.133:0/1956514333 wait complete. 2023-10-08T16:09:20.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.509+0000 7fed4d978700 1 Processor -- start 2023-10-08T16:09:20.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.509+0000 7fed4d978700 1 -- start start 2023-10-08T16:09:20.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.509+0000 7fed4d978700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed30003a90 0x7fed4813d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.509+0000 7fed4d978700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed48154660 0x7fed4813ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.509+0000 7fed4d978700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed480b4140 0x7fed480aaa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.509+0000 7fed4d978700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed480a6250 con 0x7fed30003a90 2023-10-08T16:09:20.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.509+0000 7fed4d978700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4813b0a0 con 0x7fed48154660 2023-10-08T16:09:20.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.509+0000 7fed4d978700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed48153b80 con 0x7fed480b4140 2023-10-08T16:09:20.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.509+0000 7fed4c976700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed30003a90 0x7fed4813d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.509+0000 7fed4c976700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed30003a90 0x7fed4813d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58496/0 (socket says 172.21.15.133:58496) 2023-10-08T16:09:20.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.509+0000 7fed4c976700 1 -- 172.21.15.133:0/831486397 learned_addr learned my addr 172.21.15.133:0/831486397 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:20.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.509+0000 7fed4d177700 1 --2- 172.21.15.133:0/831486397 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed480b4140 0x7fed480aaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.509+0000 7fed3ffff700 1 --2- 172.21.15.133:0/831486397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed48154660 0x7fed4813ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.509+0000 7fed4c976700 1 -- 172.21.15.133:0/831486397 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed480b4140 msgr2=0x7fed480aaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.509+0000 7fed4c976700 1 --2- 172.21.15.133:0/831486397 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed480b4140 0x7fed480aaa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.509+0000 7fed4c976700 1 -- 172.21.15.133:0/831486397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed48154660 msgr2=0x7fed4813ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.509+0000 7fed4c976700 1 --2- 172.21.15.133:0/831486397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed48154660 0x7fed4813ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.509+0000 7fed4c976700 1 -- 172.21.15.133:0/831486397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed48153e60 con 0x7fed30003a90 2023-10-08T16:09:20.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.509+0000 7fed4c976700 1 --2- 172.21.15.133:0/831486397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed30003a90 0x7fed4813d730 secure :-1 s=READY pgs=4404 cs=0 l=1 rev1=1 crypto rx=0x7fed3000c4e0 tx=0x7fed44015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:20.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.509+0000 7fed3cff9700 1 -- 172.21.15.133:0/831486397 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed44001450 con 0x7fed30003a90 2023-10-08T16:09:20.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.509+0000 7fed3cff9700 1 -- 172.21.15.133:0/831486397 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed44007360 con 0x7fed30003a90 2023-10-08T16:09:20.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.509+0000 7fed4d978700 1 -- 172.21.15.133:0/831486397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed48154140 con 0x7fed30003a90 2023-10-08T16:09:20.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.509+0000 7fed3cff9700 1 -- 172.21.15.133:0/831486397 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed44007700 con 0x7fed30003a90 2023-10-08T16:09:20.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.509+0000 7fed4d978700 1 -- 172.21.15.133:0/831486397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed480b45e0 con 0x7fed30003a90 2023-10-08T16:09:20.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.513+0000 7fed4d978700 1 -- 172.21.15.133:0/831486397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed481539e0 con 0x7fed30003a90 2023-10-08T16:09:20.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.513+0000 7fed3cff9700 1 -- 172.21.15.133:0/831486397 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fed4401f630 con 0x7fed30003a90 2023-10-08T16:09:20.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.513+0000 7fed3cff9700 1 --2- 172.21.15.133:0/831486397 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fed34060550 0x7fed34062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.513+0000 7fed3ffff700 1 --2- 172.21.15.133:0/831486397 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fed34060550 0x7fed34062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.513+0000 7fed3cff9700 1 -- 172.21.15.133:0/831486397 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fed4407e4c0 con 0x7fed30003a90 2023-10-08T16:09:20.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.513+0000 7fed3ffff700 1 --2- 172.21.15.133:0/831486397 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fed34060550 0x7fed34062a00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fed38000c00 tx=0x7fed38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:20.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.521+0000 7fed3cff9700 1 -- 172.21.15.133:0/831486397 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fed481539e0 con 0x7fed30003a90 2023-10-08T16:09:20.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.681+0000 7fed4d978700 1 -- 172.21.15.133:0/831486397 --> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed480b5080 con 0x7fed34060550 2023-10-08T16:09:20.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.693+0000 7fed3cff9700 1 -- 172.21.15.133:0/831486397 <== mgr.4104 v2:172.21.15.133:6832/33362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289812 (secure 0 0 0) 0x7fed38003d20 con 0x7fed34060550 2023-10-08T16:09:20.703 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:09:20.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.701+0000 7fed4d978700 1 -- 172.21.15.133:0/831486397 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fed34060550 msgr2=0x7fed34062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.701+0000 7fed4d978700 1 --2- 172.21.15.133:0/831486397 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fed34060550 0x7fed34062a00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fed38000c00 tx=0x7fed38009040 comp rx=0 tx=0).stop 2023-10-08T16:09:20.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.701+0000 7fed4d978700 1 -- 172.21.15.133:0/831486397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed30003a90 msgr2=0x7fed4813d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.701+0000 7fed4d978700 1 --2- 172.21.15.133:0/831486397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed30003a90 0x7fed4813d730 secure :-1 s=READY pgs=4404 cs=0 l=1 rev1=1 crypto rx=0x7fed3000c4e0 tx=0x7fed44015000 comp rx=0 tx=0).stop 2023-10-08T16:09:20.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.701+0000 7fed4d978700 1 -- 172.21.15.133:0/831486397 shutdown_connections 2023-10-08T16:09:20.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.701+0000 7fed4d978700 1 --2- 172.21.15.133:0/831486397 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fed34060550 0x7fed34062a00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.701+0000 7fed4d978700 1 --2- 172.21.15.133:0/831486397 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed480b4140 0x7fed480aaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.701+0000 7fed4d978700 1 --2- 172.21.15.133:0/831486397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed48154660 0x7fed4813ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.701+0000 7fed4d978700 1 --2- 172.21.15.133:0/831486397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed30003a90 0x7fed4813d730 unknown :-1 s=CLOSED pgs=4404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.701+0000 7fed4d978700 1 -- 172.21.15.133:0/831486397 >> 172.21.15.133:0/831486397 conn(0x7fed48063670 msgr2=0x7fed4806be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:20.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.701+0000 7fed4d978700 1 -- 172.21.15.133:0/831486397 shutdown_connections 2023-10-08T16:09:20.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:20.701+0000 7fed4d978700 1 -- 172.21.15.133:0/831486397 wait complete. 2023-10-08T16:09:20.707 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-10-08T16:09:20.715 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2023-10-08T16:09:18.940597+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":85841592,"num_objects":127,"num_object_clones":21,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":8,"num_read":209,"num_read_kb":442,"num_write":18241,"num_write_kb":96379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55919,"ondisk_log_size":55919,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2618164,"kb_used_data":170228,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752356556,"statfs":{"total":773094113280,"available":770413113344,"internally_reserved":0,"allocated":174313472,"data_stored":172646425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":398776,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":3,"num_read":4,"num_read_kb":5,"num_write":68,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003920"},"pg_stats":[{"pgid":"3.3f","version":"28'511","reported_seq":579,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646405+0000","last_change":"2023-10-08T16:08:50.725515+0000","last_active":"2023-10-08T16:09:06.646405+0000","last_peered":"2023-10-08T16:09:06.646405+0000","last_clean":"2023-10-08T16:09:06.646405+0000","last_became_active":"2023-10-08T16:04:17.626468+0000","last_became_peered":"2023-10-08T16:04:17.626468+0000","last_unstale":"2023-10-08T16:09:06.646405+0000","last_undegraded":"2023-10-08T16:09:06.646405+0000","last_fullsized":"2023-10-08T16:09:06.646405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:47:37.040973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012965628,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"28'502","reported_seq":570,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.632342+0000","last_change":"2023-10-08T16:08:50.761523+0000","last_active":"2023-10-08T16:09:06.632342+0000","last_peered":"2023-10-08T16:09:06.632342+0000","last_clean":"2023-10-08T16:09:06.632342+0000","last_became_active":"2023-10-08T16:04:17.623968+0000","last_became_peered":"2023-10-08T16:04:17.623968+0000","last_unstale":"2023-10-08T16:09:06.632342+0000","last_undegraded":"2023-10-08T16:09:06.632342+0000","last_fullsized":"2023-10-08T16:09:06.632342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025754998000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"28'750","reported_seq":817,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.628419+0000","last_change":"2023-10-08T16:08:50.782249+0000","last_active":"2023-10-08T16:09:06.628419+0000","last_peered":"2023-10-08T16:09:06.628419+0000","last_clean":"2023-10-08T16:09:06.628419+0000","last_became_active":"2023-10-08T16:04:17.624219+0000","last_became_peered":"2023-10-08T16:04:17.624219+0000","last_unstale":"2023-10-08T16:09:06.628419+0000","last_undegraded":"2023-10-08T16:09:06.628419+0000","last_fullsized":"2023-10-08T16:09:06.628419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:07.785877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.046708411999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'447","reported_seq":515,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.640828+0000","last_change":"2023-10-08T16:08:50.726275+0000","last_active":"2023-10-08T16:09:06.640828+0000","last_peered":"2023-10-08T16:09:06.640828+0000","last_clean":"2023-10-08T16:09:06.640828+0000","last_became_active":"2023-10-08T16:04:17.628308+0000","last_became_peered":"2023-10-08T16:04:17.628308+0000","last_unstale":"2023-10-08T16:09:06.640828+0000","last_undegraded":"2023-10-08T16:09:06.640828+0000","last_fullsized":"2023-10-08T16:09:06.640828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:48.519448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019603182,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'456","reported_seq":523,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646223+0000","last_change":"2023-10-08T16:08:50.725181+0000","last_active":"2023-10-08T16:09:06.646223+0000","last_peered":"2023-10-08T16:09:06.646223+0000","last_clean":"2023-10-08T16:09:06.646223+0000","last_became_active":"2023-10-08T16:04:17.625650+0000","last_became_peered":"2023-10-08T16:04:17.625650+0000","last_unstale":"2023-10-08T16:09:06.646223+0000","last_undegraded":"2023-10-08T16:09:06.646223+0000","last_fullsized":"2023-10-08T16:09:06.646223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:42.972904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013008828,"stat_sum":{"num_bytes":4107,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'638","reported_seq":703,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.630901+0000","last_change":"2023-10-08T16:08:50.747973+0000","last_active":"2023-10-08T16:09:06.630901+0000","last_peered":"2023-10-08T16:09:06.630901+0000","last_clean":"2023-10-08T16:09:06.630901+0000","last_became_active":"2023-10-08T16:04:59.029141+0000","last_became_peered":"2023-10-08T16:04:59.029141+0000","last_unstale":"2023-10-08T16:09:06.630901+0000","last_undegraded":"2023-10-08T16:09:06.630901+0000","last_fullsized":"2023-10-08T16:09:06.630901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:26:02.042909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010017161,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"28'439","reported_seq":507,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.645595+0000","last_change":"2023-10-08T16:08:50.721969+0000","last_active":"2023-10-08T16:09:06.645595+0000","last_peered":"2023-10-08T16:09:06.645595+0000","last_clean":"2023-10-08T16:09:06.645595+0000","last_became_active":"2023-10-08T16:04:17.631722+0000","last_became_peered":"2023-10-08T16:04:17.631722+0000","last_unstale":"2023-10-08T16:09:06.645595+0000","last_undegraded":"2023-10-08T16:09:06.645595+0000","last_fullsized":"2023-10-08T16:09:06.645595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:52.670934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010482406,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'606","reported_seq":673,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650514+0000","last_change":"2023-10-08T16:08:50.714547+0000","last_active":"2023-10-08T16:09:06.650514+0000","last_peered":"2023-10-08T16:09:06.650514+0000","last_clean":"2023-10-08T16:09:06.650514+0000","last_became_active":"2023-10-08T16:04:17.628987+0000","last_became_peered":"2023-10-08T16:04:17.628987+0000","last_unstale":"2023-10-08T16:09:06.650514+0000","last_undegraded":"2023-10-08T16:09:06.650514+0000","last_fullsized":"2023-10-08T16:09:06.650514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:26.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011543940000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"28'702","reported_seq":770,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650736+0000","last_change":"2023-10-08T16:08:50.727041+0000","last_active":"2023-10-08T16:09:06.650736+0000","last_peered":"2023-10-08T16:09:06.650736+0000","last_clean":"2023-10-08T16:09:06.650736+0000","last_became_active":"2023-10-08T16:04:17.636350+0000","last_became_peered":"2023-10-08T16:04:17.636350+0000","last_unstale":"2023-10-08T16:09:06.650736+0000","last_undegraded":"2023-10-08T16:09:06.650736+0000","last_fullsized":"2023-10-08T16:09:06.650736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:38:37.066127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014319053,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'946","reported_seq":1024,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.636787+0000","last_change":"2023-10-08T16:08:50.720768+0000","last_active":"2023-10-08T16:09:06.636787+0000","last_peered":"2023-10-08T16:09:06.636787+0000","last_clean":"2023-10-08T16:09:06.636787+0000","last_became_active":"2023-10-08T16:04:58.696602+0000","last_became_peered":"2023-10-08T16:04:58.696602+0000","last_unstale":"2023-10-08T16:09:06.636787+0000","last_undegraded":"2023-10-08T16:09:06.636787+0000","last_fullsized":"2023-10-08T16:09:06.636787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":946,"log_dups_size":0,"ondisk_log_size":946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:04.594336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014587116000000001,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"28'515","reported_seq":583,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.647874+0000","last_change":"2023-10-08T16:08:50.717913+0000","last_active":"2023-10-08T16:09:06.647874+0000","last_peered":"2023-10-08T16:09:06.647874+0000","last_clean":"2023-10-08T16:09:06.647874+0000","last_became_active":"2023-10-08T16:04:17.627965+0000","last_became_peered":"2023-10-08T16:04:17.627965+0000","last_unstale":"2023-10-08T16:09:06.647874+0000","last_undegraded":"2023-10-08T16:09:06.647874+0000","last_fullsized":"2023-10-08T16:09:06.647874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012809017000000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'622","reported_seq":690,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.651027+0000","last_change":"2023-10-08T16:08:50.748915+0000","last_active":"2023-10-08T16:09:06.651027+0000","last_peered":"2023-10-08T16:09:06.651027+0000","last_clean":"2023-10-08T16:09:06.651027+0000","last_became_active":"2023-10-08T16:04:17.616988+0000","last_became_peered":"2023-10-08T16:04:17.616988+0000","last_unstale":"2023-10-08T16:09:06.651027+0000","last_undegraded":"2023-10-08T16:09:06.651027+0000","last_fullsized":"2023-10-08T16:09:06.651027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:49.607853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010221923000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"28'578","reported_seq":646,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.636406+0000","last_change":"2023-10-08T16:08:50.715034+0000","last_active":"2023-10-08T16:09:06.636406+0000","last_peered":"2023-10-08T16:09:06.636406+0000","last_clean":"2023-10-08T16:09:06.636406+0000","last_became_active":"2023-10-08T16:04:17.625529+0000","last_became_peered":"2023-10-08T16:04:17.625529+0000","last_unstale":"2023-10-08T16:09:06.636406+0000","last_undegraded":"2023-10-08T16:09:06.636406+0000","last_fullsized":"2023-10-08T16:09:06.636406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:07.051965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011264827,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"28'489","reported_seq":557,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.629848+0000","last_change":"2023-10-08T16:08:50.772353+0000","last_active":"2023-10-08T16:09:06.629848+0000","last_peered":"2023-10-08T16:09:06.629848+0000","last_clean":"2023-10-08T16:09:06.629848+0000","last_became_active":"2023-10-08T16:04:17.624197+0000","last_became_peered":"2023-10-08T16:04:17.624197+0000","last_unstale":"2023-10-08T16:09:06.629848+0000","last_undegraded":"2023-10-08T16:09:06.629848+0000","last_fullsized":"2023-10-08T16:09:06.629848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:08.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037453408000000001,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"28'586","reported_seq":654,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.639903+0000","last_change":"2023-10-08T16:08:50.764291+0000","last_active":"2023-10-08T16:09:06.639903+0000","last_peered":"2023-10-08T16:09:06.639903+0000","last_clean":"2023-10-08T16:09:06.639903+0000","last_became_active":"2023-10-08T16:04:17.620391+0000","last_became_peered":"2023-10-08T16:04:17.620391+0000","last_unstale":"2023-10-08T16:09:06.639903+0000","last_undegraded":"2023-10-08T16:09:06.639903+0000","last_fullsized":"2023-10-08T16:09:06.639903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:08.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029228837000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"28'650","reported_seq":717,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649001+0000","last_change":"2023-10-08T16:08:50.723712+0000","last_active":"2023-10-08T16:09:06.649001+0000","last_peered":"2023-10-08T16:09:06.649001+0000","last_clean":"2023-10-08T16:09:06.649001+0000","last_became_active":"2023-10-08T16:04:17.619843+0000","last_became_peered":"2023-10-08T16:04:17.619843+0000","last_unstale":"2023-10-08T16:09:06.649001+0000","last_undegraded":"2023-10-08T16:09:06.649001+0000","last_fullsized":"2023-10-08T16:09:06.649001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.599406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018851915,"stat_sum":{"num_bytes":4105,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"28'622","reported_seq":690,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650219+0000","last_change":"2023-10-08T16:08:50.725684+0000","last_active":"2023-10-08T16:09:06.650219+0000","last_peered":"2023-10-08T16:09:06.650219+0000","last_clean":"2023-10-08T16:09:06.650219+0000","last_became_active":"2023-10-08T16:04:17.625580+0000","last_became_peered":"2023-10-08T16:04:17.625580+0000","last_unstale":"2023-10-08T16:09:06.650219+0000","last_undegraded":"2023-10-08T16:09:06.650219+0000","last_fullsized":"2023-10-08T16:09:06.650219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:46.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018077737,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"28'589","reported_seq":656,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.636598+0000","last_change":"2023-10-08T16:08:50.751069+0000","last_active":"2023-10-08T16:09:06.636598+0000","last_peered":"2023-10-08T16:09:06.636598+0000","last_clean":"2023-10-08T16:09:06.636598+0000","last_became_active":"2023-10-08T16:04:17.627197+0000","last_became_peered":"2023-10-08T16:04:17.627197+0000","last_unstale":"2023-10-08T16:09:06.636598+0000","last_undegraded":"2023-10-08T16:09:06.636598+0000","last_fullsized":"2023-10-08T16:09:06.636598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:09.387194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098294880000000008,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"28'596","reported_seq":664,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646672+0000","last_change":"2023-10-08T16:08:50.727158+0000","last_active":"2023-10-08T16:09:06.646672+0000","last_peered":"2023-10-08T16:09:06.646672+0000","last_clean":"2023-10-08T16:09:06.646672+0000","last_became_active":"2023-10-08T16:04:17.625586+0000","last_became_peered":"2023-10-08T16:04:17.625586+0000","last_unstale":"2023-10-08T16:09:06.646672+0000","last_undegraded":"2023-10-08T16:09:06.646672+0000","last_fullsized":"2023-10-08T16:09:06.646672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.599406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014288673999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"28'769","reported_seq":837,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646513+0000","last_change":"2023-10-08T16:08:50.717675+0000","last_active":"2023-10-08T16:09:06.646513+0000","last_peered":"2023-10-08T16:09:06.646513+0000","last_clean":"2023-10-08T16:09:06.646513+0000","last_became_active":"2023-10-08T16:04:17.623200+0000","last_became_peered":"2023-10-08T16:04:17.623200+0000","last_unstale":"2023-10-08T16:09:06.646513+0000","last_undegraded":"2023-10-08T16:09:06.646513+0000","last_fullsized":"2023-10-08T16:09:06.646513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:36.869466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012983668,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"28'725","reported_seq":794,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650301+0000","last_change":"2023-10-08T16:08:50.784761+0000","last_active":"2023-10-08T16:09:06.650301+0000","last_peered":"2023-10-08T16:09:06.650301+0000","last_clean":"2023-10-08T16:09:06.650301+0000","last_became_active":"2023-10-08T16:04:17.623945+0000","last_became_peered":"2023-10-08T16:04:17.623945+0000","last_unstale":"2023-10-08T16:09:06.650301+0000","last_undegraded":"2023-10-08T16:09:06.650301+0000","last_fullsized":"2023-10-08T16:09:06.650301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:15.965581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045353759,"stat_sum":{"num_bytes":4128,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"28'829","reported_seq":920,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650027+0000","last_change":"2023-10-08T16:08:50.723672+0000","last_active":"2023-10-08T16:09:06.650027+0000","last_peered":"2023-10-08T16:09:06.650027+0000","last_clean":"2023-10-08T16:09:06.650027+0000","last_became_active":"2023-10-08T16:04:17.623904+0000","last_became_peered":"2023-10-08T16:04:17.623904+0000","last_unstale":"2023-10-08T16:09:06.650027+0000","last_undegraded":"2023-10-08T16:09:06.650027+0000","last_fullsized":"2023-10-08T16:09:06.650027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:52.670934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019052278999999998,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":25,"num_read_kb":20,"num_write":31,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'549","reported_seq":616,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.638800+0000","last_change":"2023-10-08T16:08:50.714440+0000","last_active":"2023-10-08T16:09:06.638800+0000","last_peered":"2023-10-08T16:09:06.638800+0000","last_clean":"2023-10-08T16:09:06.638800+0000","last_became_active":"2023-10-08T16:04:17.618549+0000","last_became_peered":"2023-10-08T16:04:17.618549+0000","last_unstale":"2023-10-08T16:09:06.638800+0000","last_undegraded":"2023-10-08T16:09:06.638800+0000","last_fullsized":"2023-10-08T16:09:06.638800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011087115999999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'657","reported_seq":724,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649258+0000","last_change":"2023-10-08T16:08:50.724464+0000","last_active":"2023-10-08T16:09:06.649258+0000","last_peered":"2023-10-08T16:09:06.649258+0000","last_clean":"2023-10-08T16:09:06.649258+0000","last_became_active":"2023-10-08T16:04:17.627673+0000","last_became_peered":"2023-10-08T16:04:17.627673+0000","last_unstale":"2023-10-08T16:09:06.649258+0000","last_undegraded":"2023-10-08T16:09:06.649258+0000","last_fullsized":"2023-10-08T16:09:06.649258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:26.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019445790000000001,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"28'468","reported_seq":536,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.629597+0000","last_change":"2023-10-08T16:08:50.715828+0000","last_active":"2023-10-08T16:09:06.629597+0000","last_peered":"2023-10-08T16:09:06.629597+0000","last_clean":"2023-10-08T16:09:06.629597+0000","last_became_active":"2023-10-08T16:04:17.628793+0000","last_became_peered":"2023-10-08T16:04:17.628793+0000","last_unstale":"2023-10-08T16:09:06.629597+0000","last_undegraded":"2023-10-08T16:09:06.629597+0000","last_fullsized":"2023-10-08T16:09:06.629597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:15.965581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011350429,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"28'659","reported_seq":727,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649543+0000","last_change":"2023-10-08T16:08:50.720438+0000","last_active":"2023-10-08T16:09:06.649543+0000","last_peered":"2023-10-08T16:09:06.649543+0000","last_clean":"2023-10-08T16:09:06.649543+0000","last_became_active":"2023-10-08T16:04:17.625220+0000","last_became_peered":"2023-10-08T16:04:17.625220+0000","last_unstale":"2023-10-08T16:09:06.649543+0000","last_undegraded":"2023-10-08T16:09:06.649543+0000","last_fullsized":"2023-10-08T16:09:06.649543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:39:08.533458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013452108000000001,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'351","reported_seq":419,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.612968+0000","last_change":"2023-10-08T16:08:50.761809+0000","last_active":"2023-10-08T16:09:06.612968+0000","last_peered":"2023-10-08T16:09:06.612968+0000","last_clean":"2023-10-08T16:09:06.612968+0000","last_became_active":"2023-10-08T16:04:17.629574+0000","last_became_peered":"2023-10-08T16:04:17.629574+0000","last_unstale":"2023-10-08T16:09:06.612968+0000","last_undegraded":"2023-10-08T16:09:06.612968+0000","last_fullsized":"2023-10-08T16:09:06.612968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:26.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024743081,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"28'585","reported_seq":653,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.643506+0000","last_change":"2023-10-08T16:08:50.715713+0000","last_active":"2023-10-08T16:09:06.643506+0000","last_peered":"2023-10-08T16:09:06.643506+0000","last_clean":"2023-10-08T16:09:06.643506+0000","last_became_active":"2023-10-08T16:04:17.626420+0000","last_became_peered":"2023-10-08T16:04:17.626420+0000","last_unstale":"2023-10-08T16:09:06.643506+0000","last_undegraded":"2023-10-08T16:09:06.643506+0000","last_fullsized":"2023-10-08T16:09:06.643506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011442964999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'586","reported_seq":654,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.635599+0000","last_change":"2023-10-08T16:08:50.786032+0000","last_active":"2023-10-08T16:09:06.635599+0000","last_peered":"2023-10-08T16:09:06.635599+0000","last_clean":"2023-10-08T16:09:06.635599+0000","last_became_active":"2023-10-08T16:04:17.618207+0000","last_became_peered":"2023-10-08T16:04:17.618207+0000","last_unstale":"2023-10-08T16:09:06.635599+0000","last_undegraded":"2023-10-08T16:09:06.635599+0000","last_fullsized":"2023-10-08T16:09:06.635599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:16:31.009207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042752309000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"28'401","reported_seq":469,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.647800+0000","last_change":"2023-10-08T16:08:50.725249+0000","last_active":"2023-10-08T16:09:06.647800+0000","last_peered":"2023-10-08T16:09:06.647800+0000","last_clean":"2023-10-08T16:09:06.647800+0000","last_became_active":"2023-10-08T16:04:17.627093+0000","last_became_peered":"2023-10-08T16:04:17.627093+0000","last_unstale":"2023-10-08T16:09:06.647800+0000","last_undegraded":"2023-10-08T16:09:06.647800+0000","last_fullsized":"2023-10-08T16:09:06.647800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:45.664795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020438813,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"28'943","reported_seq":1010,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649964+0000","last_change":"2023-10-08T16:08:50.753000+0000","last_active":"2023-10-08T16:09:06.649964+0000","last_peered":"2023-10-08T16:09:06.649964+0000","last_clean":"2023-10-08T16:09:06.649964+0000","last_became_active":"2023-10-08T16:04:17.629049+0000","last_became_peered":"2023-10-08T16:04:17.629049+0000","last_unstale":"2023-10-08T16:09:06.649964+0000","last_undegraded":"2023-10-08T16:09:06.649964+0000","last_fullsized":"2023-10-08T16:09:06.649964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:07.785877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01455822,"stat_sum":{"num_bytes":8206,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"28'746","reported_seq":814,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.636917+0000","last_change":"2023-10-08T16:08:50.714786+0000","last_active":"2023-10-08T16:09:06.636917+0000","last_peered":"2023-10-08T16:09:06.636917+0000","last_clean":"2023-10-08T16:09:06.636917+0000","last_became_active":"2023-10-08T16:04:17.632012+0000","last_became_peered":"2023-10-08T16:04:17.632012+0000","last_unstale":"2023-10-08T16:09:06.636917+0000","last_undegraded":"2023-10-08T16:09:06.636917+0000","last_fullsized":"2023-10-08T16:09:06.636917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010590815999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"28'514","reported_seq":582,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.627809+0000","last_change":"2023-10-08T16:08:50.747895+0000","last_active":"2023-10-08T16:09:06.627809+0000","last_peered":"2023-10-08T16:09:06.627809+0000","last_clean":"2023-10-08T16:09:06.627809+0000","last_became_active":"2023-10-08T16:04:17.623220+0000","last_became_peered":"2023-10-08T16:04:17.623220+0000","last_unstale":"2023-10-08T16:09:06.627809+0000","last_undegraded":"2023-10-08T16:09:06.627809+0000","last_fullsized":"2023-10-08T16:09:06.627809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:07.785877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010375987999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'747","reported_seq":765,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.776172+0000","last_change":"2023-10-08T16:04:16.660492+0000","last_active":"2023-10-08T16:08:57.776172+0000","last_peered":"2023-10-08T16:08:57.776172+0000","last_clean":"2023-10-08T16:08:57.776172+0000","last_became_active":"2023-10-08T16:04:16.660183+0000","last_became_peered":"2023-10-08T16:04:16.660183+0000","last_unstale":"2023-10-08T16:08:57.776172+0000","last_undegraded":"2023-10-08T16:08:57.776172+0000","last_fullsized":"2023-10-08T16:08:57.776172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:08.532886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":743,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'638","reported_seq":706,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.644690+0000","last_change":"2023-10-08T16:08:50.786087+0000","last_active":"2023-10-08T16:09:06.644690+0000","last_peered":"2023-10-08T16:09:06.644690+0000","last_clean":"2023-10-08T16:09:06.644690+0000","last_became_active":"2023-10-08T16:04:17.620532+0000","last_became_peered":"2023-10-08T16:04:17.620532+0000","last_unstale":"2023-10-08T16:09:06.644690+0000","last_undegraded":"2023-10-08T16:09:06.644690+0000","last_fullsized":"2023-10-08T16:09:06.644690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:48:25.093009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042650311000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"28'756","reported_seq":774,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:58.144652+0000","last_change":"2023-10-08T16:04:16.654209+0000","last_active":"2023-10-08T16:08:58.144652+0000","last_peered":"2023-10-08T16:08:58.144652+0000","last_clean":"2023-10-08T16:08:58.144652+0000","last_became_active":"2023-10-08T16:04:16.653936+0000","last_became_peered":"2023-10-08T16:04:16.653936+0000","last_unstale":"2023-10-08T16:08:58.144652+0000","last_undegraded":"2023-10-08T16:08:58.144652+0000","last_fullsized":"2023-10-08T16:08:58.144652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:39:19.429906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"28'11","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.775670+0000","last_change":"2023-10-08T16:04:16.656953+0000","last_active":"2023-10-08T16:08:57.775670+0000","last_peered":"2023-10-08T16:08:57.775670+0000","last_clean":"2023-10-08T16:08:57.775670+0000","last_became_active":"2023-10-08T16:04:16.656642+0000","last_became_peered":"2023-10-08T16:04:16.656642+0000","last_unstale":"2023-10-08T16:08:57.775670+0000","last_undegraded":"2023-10-08T16:08:57.775670+0000","last_fullsized":"2023-10-08T16:08:57.775670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:04.157234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'647","reported_seq":713,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.628901+0000","last_change":"2023-10-08T16:08:50.765265+0000","last_active":"2023-10-08T16:09:06.628901+0000","last_peered":"2023-10-08T16:09:06.628901+0000","last_clean":"2023-10-08T16:09:06.628901+0000","last_became_active":"2023-10-08T16:04:59.029346+0000","last_became_peered":"2023-10-08T16:04:59.029346+0000","last_unstale":"2023-10-08T16:09:06.628901+0000","last_undegraded":"2023-10-08T16:09:06.628901+0000","last_fullsized":"2023-10-08T16:09:06.628901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:26.162193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024714613999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1526","reported_seq":1544,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.705019+0000","last_change":"2023-10-08T16:04:16.651645+0000","last_active":"2023-10-08T16:08:50.705019+0000","last_peered":"2023-10-08T16:08:50.705019+0000","last_clean":"2023-10-08T16:08:50.705019+0000","last_became_active":"2023-10-08T16:04:16.651258+0000","last_became_peered":"2023-10-08T16:04:16.651258+0000","last_unstale":"2023-10-08T16:08:50.705019+0000","last_undegraded":"2023-10-08T16:08:50.705019+0000","last_fullsized":"2023-10-08T16:08:50.705019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1526,"log_dups_size":0,"ondisk_log_size":1526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:48.596542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1522,"num_write_kb":8929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"28'757","reported_seq":825,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.626273+0000","last_change":"2023-10-08T16:08:50.761686+0000","last_active":"2023-10-08T16:09:06.626273+0000","last_peered":"2023-10-08T16:09:06.626273+0000","last_clean":"2023-10-08T16:09:06.626273+0000","last_became_active":"2023-10-08T16:04:17.629765+0000","last_became_peered":"2023-10-08T16:04:17.629765+0000","last_unstale":"2023-10-08T16:09:06.626273+0000","last_undegraded":"2023-10-08T16:09:06.626273+0000","last_fullsized":"2023-10-08T16:09:06.626273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026861545000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'13","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.709453+0000","last_change":"2023-10-08T16:04:16.655712+0000","last_active":"2023-10-08T16:08:57.709453+0000","last_peered":"2023-10-08T16:08:57.709453+0000","last_clean":"2023-10-08T16:08:57.709453+0000","last_became_active":"2023-10-08T16:04:16.654002+0000","last_became_peered":"2023-10-08T16:04:16.654002+0000","last_unstale":"2023-10-08T16:08:57.709453+0000","last_undegraded":"2023-10-08T16:08:57.709453+0000","last_fullsized":"2023-10-08T16:08:57.709453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"28'595","reported_seq":662,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649572+0000","last_change":"2023-10-08T16:08:50.724955+0000","last_active":"2023-10-08T16:09:06.649572+0000","last_peered":"2023-10-08T16:09:06.649572+0000","last_clean":"2023-10-08T16:09:06.649572+0000","last_became_active":"2023-10-08T16:04:17.624071+0000","last_became_peered":"2023-10-08T16:04:17.624071+0000","last_unstale":"2023-10-08T16:09:06.649572+0000","last_undegraded":"2023-10-08T16:09:06.649572+0000","last_fullsized":"2023-10-08T16:09:06.649572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:42.972904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018261580999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"26'15","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.706688+0000","last_change":"2023-10-08T16:04:16.657245+0000","last_active":"2023-10-08T16:08:50.706688+0000","last_peered":"2023-10-08T16:08:50.706688+0000","last_clean":"2023-10-08T16:08:50.706688+0000","last_became_active":"2023-10-08T16:04:16.656992+0000","last_became_peered":"2023-10-08T16:04:16.656992+0000","last_unstale":"2023-10-08T16:08:50.706688+0000","last_undegraded":"2023-10-08T16:08:50.706688+0000","last_fullsized":"2023-10-08T16:08:50.706688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"28'498","reported_seq":566,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.648430+0000","last_change":"2023-10-08T16:08:50.783744+0000","last_active":"2023-10-08T16:09:06.648430+0000","last_peered":"2023-10-08T16:09:06.648430+0000","last_clean":"2023-10-08T16:09:06.648430+0000","last_became_active":"2023-10-08T16:04:17.621862+0000","last_became_peered":"2023-10-08T16:04:17.621862+0000","last_unstale":"2023-10-08T16:09:06.648430+0000","last_undegraded":"2023-10-08T16:09:06.648430+0000","last_fullsized":"2023-10-08T16:09:06.648430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:36.869466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045929303999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"28'55","reported_seq":73,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.158974+0000","last_change":"2023-10-08T16:04:16.656378+0000","last_active":"2023-10-08T16:09:06.158974+0000","last_peered":"2023-10-08T16:09:06.158974+0000","last_clean":"2023-10-08T16:09:06.158974+0000","last_became_active":"2023-10-08T16:04:16.656041+0000","last_became_peered":"2023-10-08T16:04:16.656041+0000","last_unstale":"2023-10-08T16:09:06.158974+0000","last_undegraded":"2023-10-08T16:09:06.158974+0000","last_fullsized":"2023-10-08T16:09:06.158974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:08.375883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'579","reported_seq":647,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649871+0000","last_change":"2023-10-08T16:08:50.749536+0000","last_active":"2023-10-08T16:09:06.649871+0000","last_peered":"2023-10-08T16:09:06.649871+0000","last_clean":"2023-10-08T16:09:06.649871+0000","last_became_active":"2023-10-08T16:04:17.620654+0000","last_became_peered":"2023-10-08T16:04:17.620654+0000","last_unstale":"2023-10-08T16:09:06.649871+0000","last_undegraded":"2023-10-08T16:09:06.649871+0000","last_fullsized":"2023-10-08T16:09:06.649871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:09.387194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010626305000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"28'802","reported_seq":820,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.709296+0000","last_change":"2023-10-08T16:04:16.653310+0000","last_active":"2023-10-08T16:08:57.709296+0000","last_peered":"2023-10-08T16:08:57.709296+0000","last_clean":"2023-10-08T16:08:57.709296+0000","last_became_active":"2023-10-08T16:04:16.653001+0000","last_became_peered":"2023-10-08T16:04:16.653001+0000","last_unstale":"2023-10-08T16:08:57.709296+0000","last_undegraded":"2023-10-08T16:08:57.709296+0000","last_fullsized":"2023-10-08T16:08:57.709296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:48.596542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194948,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":797,"num_write_kb":4446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"28'522","reported_seq":590,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646727+0000","last_change":"2023-10-08T16:08:50.725788+0000","last_active":"2023-10-08T16:09:06.646727+0000","last_peered":"2023-10-08T16:09:06.646727+0000","last_clean":"2023-10-08T16:09:06.646727+0000","last_became_active":"2023-10-08T16:04:17.631130+0000","last_became_peered":"2023-10-08T16:04:17.631130+0000","last_unstale":"2023-10-08T16:09:06.646727+0000","last_undegraded":"2023-10-08T16:09:06.646727+0000","last_fullsized":"2023-10-08T16:09:06.646727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:35.211718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013318705,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"26'1512","reported_seq":1530,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.743557+0000","last_change":"2023-10-08T16:04:16.661085+0000","last_active":"2023-10-08T16:08:50.743557+0000","last_peered":"2023-10-08T16:08:50.743557+0000","last_clean":"2023-10-08T16:08:50.743557+0000","last_became_active":"2023-10-08T16:04:16.660830+0000","last_became_peered":"2023-10-08T16:04:16.660830+0000","last_unstale":"2023-10-08T16:08:50.743557+0000","last_undegraded":"2023-10-08T16:08:50.743557+0000","last_fullsized":"2023-10-08T16:08:50.743557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1512,"log_dups_size":0,"ondisk_log_size":1512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:18.465207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1505,"num_write_kb":8987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"28'652","reported_seq":720,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.645919+0000","last_change":"2023-10-08T16:08:50.780644+0000","last_active":"2023-10-08T16:09:06.645919+0000","last_peered":"2023-10-08T16:09:06.645919+0000","last_clean":"2023-10-08T16:09:06.645919+0000","last_became_active":"2023-10-08T16:04:17.623038+0000","last_became_peered":"2023-10-08T16:04:17.623038+0000","last_unstale":"2023-10-08T16:09:06.645919+0000","last_undegraded":"2023-10-08T16:09:06.645919+0000","last_fullsized":"2023-10-08T16:09:06.645919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:20.205879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045488809999999998,"stat_sum":{"num_bytes":4107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"26'14","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.705165+0000","last_change":"2023-10-08T16:04:16.650083+0000","last_active":"2023-10-08T16:08:50.705165+0000","last_peered":"2023-10-08T16:08:50.705165+0000","last_clean":"2023-10-08T16:08:50.705165+0000","last_became_active":"2023-10-08T16:04:16.649675+0000","last_became_peered":"2023-10-08T16:04:16.649675+0000","last_unstale":"2023-10-08T16:08:50.705165+0000","last_undegraded":"2023-10-08T16:08:50.705165+0000","last_fullsized":"2023-10-08T16:08:50.705165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:04.030037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'966","reported_seq":1034,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646421+0000","last_change":"2023-10-08T16:08:50.725608+0000","last_active":"2023-10-08T16:09:06.646421+0000","last_peered":"2023-10-08T16:09:06.646421+0000","last_clean":"2023-10-08T16:09:06.646421+0000","last_became_active":"2023-10-08T16:04:17.628865+0000","last_became_peered":"2023-10-08T16:04:17.628865+0000","last_unstale":"2023-10-08T16:09:06.646421+0000","last_undegraded":"2023-10-08T16:09:06.646421+0000","last_fullsized":"2023-10-08T16:09:06.646421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":966,"log_dups_size":0,"ondisk_log_size":966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:46.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013199152,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"27'12","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:52.141852+0000","last_change":"2023-10-08T16:04:16.655486+0000","last_active":"2023-10-08T16:08:52.141852+0000","last_peered":"2023-10-08T16:08:52.141852+0000","last_clean":"2023-10-08T16:08:52.141852+0000","last_became_active":"2023-10-08T16:04:16.653342+0000","last_became_peered":"2023-10-08T16:04:16.653342+0000","last_unstale":"2023-10-08T16:08:52.141852+0000","last_undegraded":"2023-10-08T16:08:52.141852+0000","last_fullsized":"2023-10-08T16:08:52.141852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:04.157234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"28'290","reported_seq":358,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.636856+0000","last_change":"2023-10-08T16:08:50.717095+0000","last_active":"2023-10-08T16:09:06.636856+0000","last_peered":"2023-10-08T16:09:06.636856+0000","last_clean":"2023-10-08T16:09:06.636856+0000","last_became_active":"2023-10-08T16:04:17.624454+0000","last_became_peered":"2023-10-08T16:04:17.624454+0000","last_unstale":"2023-10-08T16:09:06.636856+0000","last_undegraded":"2023-10-08T16:09:06.636856+0000","last_fullsized":"2023-10-08T16:09:06.636856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012620849,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"26'22","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.737986+0000","last_change":"2023-10-08T16:04:16.659433+0000","last_active":"2023-10-08T16:08:50.737986+0000","last_peered":"2023-10-08T16:08:50.737986+0000","last_clean":"2023-10-08T16:08:50.737986+0000","last_became_active":"2023-10-08T16:04:16.658886+0000","last_became_peered":"2023-10-08T16:04:16.658886+0000","last_unstale":"2023-10-08T16:08:50.737986+0000","last_undegraded":"2023-10-08T16:08:50.737986+0000","last_fullsized":"2023-10-08T16:08:50.737986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:08.532886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"28'592","reported_seq":660,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.645466+0000","last_change":"2023-10-08T16:08:50.724877+0000","last_active":"2023-10-08T16:09:06.645466+0000","last_peered":"2023-10-08T16:09:06.645466+0000","last_clean":"2023-10-08T16:09:06.645466+0000","last_became_active":"2023-10-08T16:04:17.628605+0000","last_became_peered":"2023-10-08T16:04:17.628605+0000","last_unstale":"2023-10-08T16:09:06.645466+0000","last_undegraded":"2023-10-08T16:09:06.645466+0000","last_fullsized":"2023-10-08T16:09:06.645466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:02:45.593266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013094041000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'18","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.699963+0000","last_change":"2023-10-08T16:04:16.660881+0000","last_active":"2023-10-08T16:08:57.699963+0000","last_peered":"2023-10-08T16:08:57.699963+0000","last_clean":"2023-10-08T16:08:57.699963+0000","last_became_active":"2023-10-08T16:04:16.660651+0000","last_became_peered":"2023-10-08T16:04:16.660651+0000","last_unstale":"2023-10-08T16:08:57.699963+0000","last_undegraded":"2023-10-08T16:08:57.699963+0000","last_fullsized":"2023-10-08T16:08:57.699963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:54.682083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"28'296","reported_seq":364,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.633524+0000","last_change":"2023-10-08T16:08:50.725143+0000","last_active":"2023-10-08T16:09:06.633524+0000","last_peered":"2023-10-08T16:09:06.633524+0000","last_clean":"2023-10-08T16:09:06.633524+0000","last_became_active":"2023-10-08T16:04:17.628701+0000","last_became_peered":"2023-10-08T16:04:17.628701+0000","last_unstale":"2023-10-08T16:09:06.633524+0000","last_undegraded":"2023-10-08T16:09:06.633524+0000","last_fullsized":"2023-10-08T16:09:06.633524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:45.664795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012739413999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'276","reported_seq":294,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:53.142796+0000","last_change":"2023-10-08T16:04:16.652447+0000","last_active":"2023-10-08T16:08:53.142796+0000","last_peered":"2023-10-08T16:08:53.142796+0000","last_clean":"2023-10-08T16:08:53.142796+0000","last_became_active":"2023-10-08T16:04:16.651709+0000","last_became_peered":"2023-10-08T16:04:16.651709+0000","last_unstale":"2023-10-08T16:08:53.142796+0000","last_undegraded":"2023-10-08T16:08:53.142796+0000","last_fullsized":"2023-10-08T16:08:53.142796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:04.157234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"28'660","reported_seq":727,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646340+0000","last_change":"2023-10-08T16:08:50.727298+0000","last_active":"2023-10-08T16:09:06.646340+0000","last_peered":"2023-10-08T16:09:06.646340+0000","last_clean":"2023-10-08T16:09:06.646340+0000","last_became_active":"2023-10-08T16:04:17.630908+0000","last_became_peered":"2023-10-08T16:04:17.630908+0000","last_unstale":"2023-10-08T16:09:06.646340+0000","last_undegraded":"2023-10-08T16:09:06.646340+0000","last_fullsized":"2023-10-08T16:09:06.646340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:48.519448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014318363000000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"28'764","reported_seq":782,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.773013+0000","last_change":"2023-10-08T16:04:16.655771+0000","last_active":"2023-10-08T16:08:57.773013+0000","last_peered":"2023-10-08T16:08:57.773013+0000","last_clean":"2023-10-08T16:08:57.773013+0000","last_became_active":"2023-10-08T16:04:16.655245+0000","last_became_peered":"2023-10-08T16:04:16.655245+0000","last_unstale":"2023-10-08T16:08:57.773013+0000","last_undegraded":"2023-10-08T16:08:57.773013+0000","last_fullsized":"2023-10-08T16:08:57.773013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:48.596542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":759,"num_write_kb":4511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"28'465","reported_seq":533,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.647811+0000","last_change":"2023-10-08T16:08:50.726922+0000","last_active":"2023-10-08T16:09:06.647811+0000","last_peered":"2023-10-08T16:09:06.647811+0000","last_clean":"2023-10-08T16:09:06.647811+0000","last_became_active":"2023-10-08T16:04:17.627369+0000","last_became_peered":"2023-10-08T16:04:17.627369+0000","last_unstale":"2023-10-08T16:09:06.647811+0000","last_undegraded":"2023-10-08T16:09:06.647811+0000","last_fullsized":"2023-10-08T16:09:06.647811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020078136999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"28'12","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.770743+0000","last_change":"2023-10-08T16:04:16.654597+0000","last_active":"2023-10-08T16:08:57.770743+0000","last_peered":"2023-10-08T16:08:57.770743+0000","last_clean":"2023-10-08T16:08:57.770743+0000","last_became_active":"2023-10-08T16:04:16.654124+0000","last_became_peered":"2023-10-08T16:04:16.654124+0000","last_unstale":"2023-10-08T16:08:57.770743+0000","last_undegraded":"2023-10-08T16:08:57.770743+0000","last_fullsized":"2023-10-08T16:08:57.770743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'569","reported_seq":635,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649431+0000","last_change":"2023-10-08T16:08:50.749000+0000","last_active":"2023-10-08T16:09:06.649431+0000","last_peered":"2023-10-08T16:09:06.649431+0000","last_clean":"2023-10-08T16:09:06.649431+0000","last_became_active":"2023-10-08T16:04:58.693477+0000","last_became_peered":"2023-10-08T16:04:58.693477+0000","last_unstale":"2023-10-08T16:09:06.649431+0000","last_undegraded":"2023-10-08T16:09:06.649431+0000","last_fullsized":"2023-10-08T16:09:06.649431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:43:34.693379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0094988650000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.711580+0000","last_change":"2023-10-08T16:04:06.370834+0000","last_active":"2023-10-08T16:08:50.711580+0000","last_peered":"2023-10-08T16:08:50.711580+0000","last_clean":"2023-10-08T16:08:50.711580+0000","last_became_active":"2023-10-08T16:04:06.368022+0000","last_became_peered":"2023-10-08T16:04:06.368022+0000","last_unstale":"2023-10-08T16:08:50.711580+0000","last_undegraded":"2023-10-08T16:08:50.711580+0000","last_fullsized":"2023-10-08T16:08:50.711580+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:05.034115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:05.034115+0000","last_clean_scrub_stamp":"2023-10-08T16:04:05.034115+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:37.338076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"28'13","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.697048+0000","last_change":"2023-10-08T16:04:16.646681+0000","last_active":"2023-10-08T16:08:57.697048+0000","last_peered":"2023-10-08T16:08:57.697048+0000","last_clean":"2023-10-08T16:08:57.697048+0000","last_became_active":"2023-10-08T16:04:16.646086+0000","last_became_peered":"2023-10-08T16:04:16.646086+0000","last_unstale":"2023-10-08T16:08:57.697048+0000","last_undegraded":"2023-10-08T16:08:57.697048+0000","last_fullsized":"2023-10-08T16:08:57.697048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:24.778540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'510","reported_seq":578,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649793+0000","last_change":"2023-10-08T16:08:50.714760+0000","last_active":"2023-10-08T16:09:06.649793+0000","last_peered":"2023-10-08T16:09:06.649793+0000","last_clean":"2023-10-08T16:09:06.649793+0000","last_became_active":"2023-10-08T16:04:17.629127+0000","last_became_peered":"2023-10-08T16:04:17.629127+0000","last_unstale":"2023-10-08T16:09:06.649793+0000","last_undegraded":"2023-10-08T16:09:06.649793+0000","last_fullsized":"2023-10-08T16:09:06.649793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:33.720945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011169416999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"27'1504","reported_seq":1522,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:52.141724+0000","last_change":"2023-10-08T16:04:16.661382+0000","last_active":"2023-10-08T16:08:52.141724+0000","last_peered":"2023-10-08T16:08:52.141724+0000","last_clean":"2023-10-08T16:08:52.141724+0000","last_became_active":"2023-10-08T16:04:16.661186+0000","last_became_peered":"2023-10-08T16:04:16.661186+0000","last_unstale":"2023-10-08T16:08:52.141724+0000","last_undegraded":"2023-10-08T16:08:52.141724+0000","last_fullsized":"2023-10-08T16:08:52.141724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1504,"log_dups_size":0,"ondisk_log_size":1504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:06.774566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1499,"num_write_kb":8970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"28'493","reported_seq":561,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.644348+0000","last_change":"2023-10-08T16:08:50.779348+0000","last_active":"2023-10-08T16:09:06.644348+0000","last_peered":"2023-10-08T16:09:06.644348+0000","last_clean":"2023-10-08T16:09:06.644348+0000","last_became_active":"2023-10-08T16:04:17.615671+0000","last_became_peered":"2023-10-08T16:04:17.615671+0000","last_unstale":"2023-10-08T16:09:06.644348+0000","last_undegraded":"2023-10-08T16:09:06.644348+0000","last_fullsized":"2023-10-08T16:09:06.644348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:05.041349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.043805617999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"28'75","reported_seq":155,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:07.150577+0000","last_change":"2023-10-08T16:04:16.654721+0000","last_active":"2023-10-08T16:09:07.150577+0000","last_peered":"2023-10-08T16:09:07.150577+0000","last_clean":"2023-10-08T16:09:07.150577+0000","last_became_active":"2023-10-08T16:04:16.654359+0000","last_became_peered":"2023-10-08T16:04:16.654359+0000","last_unstale":"2023-10-08T16:09:07.150577+0000","last_undegraded":"2023-10-08T16:09:07.150577+0000","last_fullsized":"2023-10-08T16:09:07.150577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:04.030037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":279988,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":321,"num_write":71,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'386","reported_seq":453,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.621683+0000","last_change":"2023-10-08T16:08:50.765489+0000","last_active":"2023-10-08T16:09:06.621683+0000","last_peered":"2023-10-08T16:09:06.621683+0000","last_clean":"2023-10-08T16:09:06.621683+0000","last_became_active":"2023-10-08T16:04:17.624876+0000","last_became_peered":"2023-10-08T16:04:17.624876+0000","last_unstale":"2023-10-08T16:09:06.621683+0000","last_undegraded":"2023-10-08T16:09:06.621683+0000","last_fullsized":"2023-10-08T16:09:06.621683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:15.965581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024289327999999999,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"27'1399","reported_seq":1417,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:52.140934+0000","last_change":"2023-10-08T16:04:16.654812+0000","last_active":"2023-10-08T16:08:52.140934+0000","last_peered":"2023-10-08T16:08:52.140934+0000","last_clean":"2023-10-08T16:08:52.140934+0000","last_became_active":"2023-10-08T16:04:16.654454+0000","last_became_peered":"2023-10-08T16:04:16.654454+0000","last_unstale":"2023-10-08T16:08:52.140934+0000","last_undegraded":"2023-10-08T16:08:52.140934+0000","last_fullsized":"2023-10-08T16:08:52.140934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1399,"log_dups_size":0,"ondisk_log_size":1399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1390,"num_write_kb":8905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"28'618","reported_seq":686,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.642629+0000","last_change":"2023-10-08T16:08:50.750159+0000","last_active":"2023-10-08T16:09:06.642629+0000","last_peered":"2023-10-08T16:09:06.642629+0000","last_clean":"2023-10-08T16:09:06.642629+0000","last_became_active":"2023-10-08T16:04:17.619294+0000","last_became_peered":"2023-10-08T16:04:17.619294+0000","last_unstale":"2023-10-08T16:09:06.642629+0000","last_undegraded":"2023-10-08T16:09:06.642629+0000","last_fullsized":"2023-10-08T16:09:06.642629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:25.789851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011233748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"27'7","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:55.141419+0000","last_change":"2023-10-08T16:04:16.662004+0000","last_active":"2023-10-08T16:08:55.141419+0000","last_peered":"2023-10-08T16:08:55.141419+0000","last_clean":"2023-10-08T16:08:55.141419+0000","last_became_active":"2023-10-08T16:04:16.661756+0000","last_became_peered":"2023-10-08T16:04:16.661756+0000","last_unstale":"2023-10-08T16:08:55.141419+0000","last_undegraded":"2023-10-08T16:08:55.141419+0000","last_fullsized":"2023-10-08T16:08:55.141419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:06.774566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"28'513","reported_seq":581,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.648937+0000","last_change":"2023-10-08T16:08:50.726661+0000","last_active":"2023-10-08T16:09:06.648937+0000","last_peered":"2023-10-08T16:09:06.648937+0000","last_clean":"2023-10-08T16:09:06.648937+0000","last_became_active":"2023-10-08T16:04:17.616348+0000","last_became_peered":"2023-10-08T16:04:17.616348+0000","last_unstale":"2023-10-08T16:09:06.648937+0000","last_undegraded":"2023-10-08T16:09:06.648937+0000","last_fullsized":"2023-10-08T16:09:06.648937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:08.121055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016977602000000001,"stat_sum":{"num_bytes":4107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"26'21","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.712617+0000","last_change":"2023-10-08T16:04:16.662731+0000","last_active":"2023-10-08T16:08:50.712617+0000","last_peered":"2023-10-08T16:08:50.712617+0000","last_clean":"2023-10-08T16:08:50.712617+0000","last_became_active":"2023-10-08T16:04:16.662446+0000","last_became_peered":"2023-10-08T16:04:16.662446+0000","last_unstale":"2023-10-08T16:08:50.712617+0000","last_undegraded":"2023-10-08T16:08:50.712617+0000","last_fullsized":"2023-10-08T16:08:50.712617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:59.297962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'604","reported_seq":672,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.613363+0000","last_change":"2023-10-08T16:08:50.759947+0000","last_active":"2023-10-08T16:09:06.613363+0000","last_peered":"2023-10-08T16:09:06.613363+0000","last_clean":"2023-10-08T16:09:06.613363+0000","last_became_active":"2023-10-08T16:04:17.624319+0000","last_became_peered":"2023-10-08T16:04:17.624319+0000","last_unstale":"2023-10-08T16:09:06.613363+0000","last_undegraded":"2023-10-08T16:09:06.613363+0000","last_fullsized":"2023-10-08T16:09:06.613363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024480915999999998,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"28'47","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:07.155741+0000","last_change":"2023-10-08T16:04:16.661076+0000","last_active":"2023-10-08T16:09:07.155741+0000","last_peered":"2023-10-08T16:09:07.155741+0000","last_clean":"2023-10-08T16:09:07.155741+0000","last_became_active":"2023-10-08T16:04:16.660704+0000","last_became_peered":"2023-10-08T16:04:16.660704+0000","last_unstale":"2023-10-08T16:09:07.155741+0000","last_undegraded":"2023-10-08T16:09:07.155741+0000","last_fullsized":"2023-10-08T16:09:07.155741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"28'626","reported_seq":694,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646062+0000","last_change":"2023-10-08T16:08:50.715485+0000","last_active":"2023-10-08T16:09:06.646062+0000","last_peered":"2023-10-08T16:09:06.646062+0000","last_clean":"2023-10-08T16:09:06.646062+0000","last_became_active":"2023-10-08T16:04:17.631615+0000","last_became_peered":"2023-10-08T16:04:17.631615+0000","last_unstale":"2023-10-08T16:09:06.646062+0000","last_undegraded":"2023-10-08T16:09:06.646062+0000","last_fullsized":"2023-10-08T16:09:06.646062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.599406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011336120999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"27'12","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:53.144513+0000","last_change":"2023-10-08T16:04:16.659489+0000","last_active":"2023-10-08T16:08:53.144513+0000","last_peered":"2023-10-08T16:08:53.144513+0000","last_clean":"2023-10-08T16:08:53.144513+0000","last_became_active":"2023-10-08T16:04:16.659148+0000","last_became_peered":"2023-10-08T16:04:16.659148+0000","last_unstale":"2023-10-08T16:08:53.144513+0000","last_undegraded":"2023-10-08T16:08:53.144513+0000","last_fullsized":"2023-10-08T16:08:53.144513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'436","reported_seq":505,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.624840+0000","last_change":"2023-10-08T16:08:50.780938+0000","last_active":"2023-10-08T16:09:06.624840+0000","last_peered":"2023-10-08T16:09:06.624840+0000","last_clean":"2023-10-08T16:09:06.624840+0000","last_became_active":"2023-10-08T16:04:17.624385+0000","last_became_peered":"2023-10-08T16:04:17.624385+0000","last_unstale":"2023-10-08T16:09:06.624840+0000","last_undegraded":"2023-10-08T16:09:06.624840+0000","last_fullsized":"2023-10-08T16:09:06.624840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:03.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.044071592,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"26'758","reported_seq":776,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.711386+0000","last_change":"2023-10-08T16:04:16.662618+0000","last_active":"2023-10-08T16:08:50.711386+0000","last_peered":"2023-10-08T16:08:50.711386+0000","last_clean":"2023-10-08T16:08:50.711386+0000","last_became_active":"2023-10-08T16:04:16.662327+0000","last_became_peered":"2023-10-08T16:04:16.662327+0000","last_unstale":"2023-10-08T16:08:50.711386+0000","last_undegraded":"2023-10-08T16:08:50.711386+0000","last_fullsized":"2023-10-08T16:08:50.711386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:06:41.062441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":753,"num_write_kb":4504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'450","reported_seq":518,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.642591+0000","last_change":"2023-10-08T16:08:50.749200+0000","last_active":"2023-10-08T16:09:06.642591+0000","last_peered":"2023-10-08T16:09:06.642591+0000","last_clean":"2023-10-08T16:09:06.642591+0000","last_became_active":"2023-10-08T16:04:17.622898+0000","last_became_peered":"2023-10-08T16:04:17.622898+0000","last_unstale":"2023-10-08T16:09:06.642591+0000","last_undegraded":"2023-10-08T16:09:06.642591+0000","last_fullsized":"2023-10-08T16:09:06.642591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:47.130200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075401410000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'10","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.773333+0000","last_change":"2023-10-08T16:04:16.661483+0000","last_active":"2023-10-08T16:08:57.773333+0000","last_peered":"2023-10-08T16:08:57.773333+0000","last_clean":"2023-10-08T16:08:57.773333+0000","last_became_active":"2023-10-08T16:04:16.661055+0000","last_became_peered":"2023-10-08T16:04:16.661055+0000","last_unstale":"2023-10-08T16:08:57.773333+0000","last_undegraded":"2023-10-08T16:08:57.773333+0000","last_fullsized":"2023-10-08T16:08:57.773333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"28'501","reported_seq":569,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.626089+0000","last_change":"2023-10-08T16:08:50.713213+0000","last_active":"2023-10-08T16:09:06.626089+0000","last_peered":"2023-10-08T16:09:06.626089+0000","last_clean":"2023-10-08T16:09:06.626089+0000","last_became_active":"2023-10-08T16:04:17.626991+0000","last_became_peered":"2023-10-08T16:04:17.626991+0000","last_unstale":"2023-10-08T16:09:06.626089+0000","last_undegraded":"2023-10-08T16:09:06.626089+0000","last_fullsized":"2023-10-08T16:09:06.626089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:56.205550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010148346000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'11","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:52.136834+0000","last_change":"2023-10-08T16:04:16.657613+0000","last_active":"2023-10-08T16:08:52.136834+0000","last_peered":"2023-10-08T16:08:52.136834+0000","last_clean":"2023-10-08T16:08:52.136834+0000","last_became_active":"2023-10-08T16:04:16.657299+0000","last_became_peered":"2023-10-08T16:04:16.657299+0000","last_unstale":"2023-10-08T16:08:52.136834+0000","last_undegraded":"2023-10-08T16:08:52.136834+0000","last_fullsized":"2023-10-08T16:08:52.136834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:24.778540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"28'597","reported_seq":663,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.632951+0000","last_change":"2023-10-08T16:08:50.715044+0000","last_active":"2023-10-08T16:09:06.632951+0000","last_peered":"2023-10-08T16:09:06.632951+0000","last_clean":"2023-10-08T16:09:06.632951+0000","last_became_active":"2023-10-08T16:04:17.620693+0000","last_became_peered":"2023-10-08T16:04:17.620693+0000","last_unstale":"2023-10-08T16:09:06.632951+0000","last_undegraded":"2023-10-08T16:09:06.632951+0000","last_fullsized":"2023-10-08T16:09:06.632951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:03.510628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011078684,"stat_sum":{"num_bytes":4121,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'97","reported_seq":115,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.712638+0000","last_change":"2023-10-08T16:04:16.663488+0000","last_active":"2023-10-08T16:08:50.712638+0000","last_peered":"2023-10-08T16:08:50.712638+0000","last_clean":"2023-10-08T16:08:50.712638+0000","last_became_active":"2023-10-08T16:04:16.663184+0000","last_became_peered":"2023-10-08T16:04:16.663184+0000","last_unstale":"2023-10-08T16:08:50.712638+0000","last_undegraded":"2023-10-08T16:08:50.712638+0000","last_fullsized":"2023-10-08T16:08:50.712638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:26.863386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":4152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"28'778","reported_seq":846,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.637315+0000","last_change":"2023-10-08T16:08:50.716768+0000","last_active":"2023-10-08T16:09:06.637315+0000","last_peered":"2023-10-08T16:09:06.637315+0000","last_clean":"2023-10-08T16:09:06.637315+0000","last_became_active":"2023-10-08T16:04:17.622898+0000","last_became_peered":"2023-10-08T16:04:17.622898+0000","last_unstale":"2023-10-08T16:09:06.637315+0000","last_undegraded":"2023-10-08T16:09:06.637315+0000","last_fullsized":"2023-10-08T16:09:06.637315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:33.720945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012379262,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"28'812","reported_seq":879,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.648671+0000","last_change":"2023-10-08T16:08:50.726432+0000","last_active":"2023-10-08T16:09:06.648671+0000","last_peered":"2023-10-08T16:09:06.648671+0000","last_clean":"2023-10-08T16:09:06.648671+0000","last_became_active":"2023-10-08T16:04:17.617179+0000","last_became_peered":"2023-10-08T16:04:17.617179+0000","last_unstale":"2023-10-08T16:09:06.648671+0000","last_undegraded":"2023-10-08T16:09:06.648671+0000","last_fullsized":"2023-10-08T16:09:06.648671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:56.205550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016893819000000001,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"27'2503","reported_seq":2521,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:52.142091+0000","last_change":"2023-10-08T16:04:16.661467+0000","last_active":"2023-10-08T16:08:52.142091+0000","last_peered":"2023-10-08T16:08:52.142091+0000","last_clean":"2023-10-08T16:08:52.142091+0000","last_became_active":"2023-10-08T16:04:16.661215+0000","last_became_peered":"2023-10-08T16:04:16.661215+0000","last_unstale":"2023-10-08T16:08:52.142091+0000","last_undegraded":"2023-10-08T16:08:52.142091+0000","last_fullsized":"2023-10-08T16:08:52.142091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":2503,"log_dups_size":0,"ondisk_log_size":2503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:00:46.118889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2502,"num_write_kb":5839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'612","reported_seq":679,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.647511+0000","last_change":"2023-10-08T16:08:50.727342+0000","last_active":"2023-10-08T16:09:06.647511+0000","last_peered":"2023-10-08T16:09:06.647511+0000","last_clean":"2023-10-08T16:09:06.647511+0000","last_became_active":"2023-10-08T16:04:17.617216+0000","last_became_peered":"2023-10-08T16:04:17.617216+0000","last_unstale":"2023-10-08T16:09:06.647511+0000","last_undegraded":"2023-10-08T16:09:06.647511+0000","last_fullsized":"2023-10-08T16:09:06.647511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:07.051965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020241687000000001,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1662","reported_seq":1680,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.915060+0000","last_change":"2023-10-08T16:04:16.661825+0000","last_active":"2023-10-08T16:09:06.915060+0000","last_peered":"2023-10-08T16:09:06.915060+0000","last_clean":"2023-10-08T16:09:06.915060+0000","last_became_active":"2023-10-08T16:04:16.661224+0000","last_became_peered":"2023-10-08T16:04:16.661224+0000","last_unstale":"2023-10-08T16:09:06.915060+0000","last_undegraded":"2023-10-08T16:09:06.915060+0000","last_fullsized":"2023-10-08T16:09:06.915060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":1662,"log_dups_size":0,"ondisk_log_size":1662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:08.375883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9345162,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1650,"num_write_kb":9972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"28'531","reported_seq":599,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.648573+0000","last_change":"2023-10-08T16:08:50.784243+0000","last_active":"2023-10-08T16:09:06.648573+0000","last_peered":"2023-10-08T16:09:06.648573+0000","last_clean":"2023-10-08T16:09:06.648573+0000","last_became_active":"2023-10-08T16:04:17.621550+0000","last_became_peered":"2023-10-08T16:04:17.621550+0000","last_unstale":"2023-10-08T16:09:06.648573+0000","last_undegraded":"2023-10-08T16:09:06.648573+0000","last_fullsized":"2023-10-08T16:09:06.648573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:22:33.720945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.046468506999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"26'764","reported_seq":782,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:50.704289+0000","last_change":"2023-10-08T16:04:16.662223+0000","last_active":"2023-10-08T16:08:50.704289+0000","last_peered":"2023-10-08T16:08:50.704289+0000","last_clean":"2023-10-08T16:08:50.704289+0000","last_became_active":"2023-10-08T16:04:16.661907+0000","last_became_peered":"2023-10-08T16:04:16.661907+0000","last_unstale":"2023-10-08T16:08:50.704289+0000","last_undegraded":"2023-10-08T16:08:50.704289+0000","last_fullsized":"2023-10-08T16:08:50.704289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:04.030037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":4591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"28'524","reported_seq":592,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.637537+0000","last_change":"2023-10-08T16:08:50.715393+0000","last_active":"2023-10-08T16:09:06.637537+0000","last_peered":"2023-10-08T16:09:06.637537+0000","last_clean":"2023-10-08T16:09:06.637537+0000","last_became_active":"2023-10-08T16:04:17.627562+0000","last_became_peered":"2023-10-08T16:04:17.627562+0000","last_unstale":"2023-10-08T16:09:06.637537+0000","last_undegraded":"2023-10-08T16:09:06.637537+0000","last_fullsized":"2023-10-08T16:09:06.637537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:08.121055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011393438000000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"27'2621","reported_seq":2639,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-08T16:08:51.147036+0000","last_change":"2023-10-08T16:04:16.663088+0000","last_active":"2023-10-08T16:08:51.147036+0000","last_peered":"2023-10-08T16:08:51.147036+0000","last_clean":"2023-10-08T16:08:51.147036+0000","last_became_active":"2023-10-08T16:04:16.662714+0000","last_became_peered":"2023-10-08T16:04:16.662714+0000","last_unstale":"2023-10-08T16:08:51.147036+0000","last_undegraded":"2023-10-08T16:08:51.147036+0000","last_fullsized":"2023-10-08T16:08:51.147036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":2621,"log_dups_size":0,"ondisk_log_size":2621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:54.682083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2619,"num_write_kb":5944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":82,"num_object_clones":21,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":8,"num_read":31,"num_read_kb":21,"num_write":110,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37743,"ondisk_log_size":37743,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":85124036,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":62,"num_read_kb":321,"num_write":17972,"num_write_kb":93766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":170311680,"data_stored":170248072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18059,"ondisk_log_size":18059,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574912,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":348308,"kb_used_data":38732,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94023532,"statfs":{"total":96636764160,"available":96280096768,"internally_reserved":0,"allocated":39661568,"data_stored":39449571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.83199999999999996,"15min":0.86199999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.2070000000000001,"5min":1.976,"15min":1.976},"last":1.1890000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82699999999999996,"15min":0.85999999999999999},"min":{"1min":0.379,"5min":0.314,"15min":0.314},"max":{"1min":1.2150000000000001,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.877}]},{"osd":1,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.85799999999999998,"15min":0.86799999999999999},"min":{"1min":0.45600000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.837,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.88900000000000001,"15min":0.90900000000000003},"min":{"1min":0.55000000000000004,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.24,"5min":1.54,"15min":1.54},"last":1.24}]},{"osd":2,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.90300000000000002,"15min":0.90500000000000003},"min":{"1min":0.60899999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.26,"5min":1.478,"15min":1.478},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.89000000000000001,"15min":0.92200000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.415,"5min":1.948,"15min":1.948},"last":1.1639999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96599999999999997,"15min":0.97899999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.008,"5min":1.014,"15min":1.048},"min":{"1min":0.70599999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3360000000000001,"5min":1.552,"15min":1.552},"last":0.98499999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.97899999999999998,"15min":1},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.5600000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.0609999999999999,"15min":1.083},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.083}]},{"osd":5,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.0249999999999999,"15min":1.0569999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6479999999999999,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0920000000000001,"15min":1.1220000000000001},"min":{"1min":0.52600000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.4990000000000001,"5min":1.726,"15min":1.726},"last":1.272}]},{"osd":6,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.161,"15min":1.212},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.6240000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.222},{"interface":"front","average":{"1min":1.149,"5min":1.1739999999999999,"15min":1.1970000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.296}]}]},{"osd":6,"up_from":13,"seq":55834574913,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319052,"kb_used_data":17668,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94052788,"statfs":{"total":96636764160,"available":96310054912,"internally_reserved":0,"allocated":18092032,"data_stored":17887733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.77100000000000002,"15min":0.76700000000000002},"min":{"1min":0.45400000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":3.8290000000000002,"5min":3.8290000000000002,"15min":3.8290000000000002},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.999,"5min":0.83399999999999996,"15min":0.748},"min":{"1min":0.48999999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":3.8519999999999999,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":1.179}]},{"osd":1,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.91000000000000003,"15min":0.91200000000000003},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3740000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.02}]},{"osd":2,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86799999999999999,"15min":0.84999999999999998},"min":{"1min":0.60299999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1830000000000001,"5min":1.25,"15min":1.25},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.90600000000000003,"15min":0.91500000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.24,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.1080000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.92200000000000004,"15min":0.85999999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.4199999999999999,"5min":2.173,"15min":2.173},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.998,"15min":0.96199999999999997},"min":{"1min":0.58099999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2350000000000001,"5min":1.381,"15min":1.381},"last":0.97199999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.96999999999999997,"15min":0.998},"min":{"1min":0.55600000000000005,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.373,"5min":1.413,"15min":1.413},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.01,"5min":1.0489999999999999,"15min":1.022},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.383,"5min":2.25,"15min":2.25},"last":1.0640000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0820000000000001,"15min":1.04},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.319,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":1.141},{"interface":"front","average":{"1min":1.319,"5min":1.3080000000000001,"15min":1.2030000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":6.0439999999999996,"5min":17.428999999999998,"15min":17.428999999999998},"last":1.2390000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.1579999999999999,"15min":1.1020000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":6.0229999999999997,"5min":6.0229999999999997,"15min":6.0229999999999997},"last":1.296},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.224,"15min":1.202},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":3.706,"5min":3.706,"15min":3.706},"last":1.3180000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":330424,"kb_used_data":20848,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94041416,"statfs":{"total":96636764160,"available":96298409984,"internally_reserved":0,"allocated":21348352,"data_stored":21141337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.80000000000000004,"15min":0.876},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.024,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.81100000000000005,"15min":0.81899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":4.2839999999999998,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.79500000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":0.86699999999999999,"15min":0.83999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":4.399,"5min":4.399,"15min":4.399},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.89200000000000002,"15min":0.89500000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":4.5149999999999997,"5min":4.5149999999999997,"15min":4.5149999999999997},"last":1.111}]},{"osd":2,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.85499999999999998,"15min":0.89400000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.089,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.90200000000000002,"15min":0.89800000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.0700000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":0.98999999999999999,"15min":1.0009999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":4.7140000000000004,"5min":4.7140000000000004,"15min":4.7140000000000004},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.044,"15min":1.0600000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":4.6920000000000002,"5min":4.6920000000000002,"15min":4.6920000000000002},"last":1.1499999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":1.014,"15min":1.0449999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.5800000000000001,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.996},{"interface":"front","average":{"1min":0.89800000000000002,"5min":1.012,"15min":1.095},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.224,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.0289999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0489999999999999,"15min":1.079},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.198},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.1180000000000001,"15min":1.208},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2390000000000001,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.1839999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.101,"15min":1.2},"min":{"1min":0.61799999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.228,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.228},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.169,"15min":1.1890000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.387}]}]},{"osd":4,"up_from":13,"seq":55834574913,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":334488,"kb_used_data":29008,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94037352,"statfs":{"total":96636764160,"available":96294248448,"internally_reserved":0,"allocated":29704192,"data_stored":29497190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.80100000000000005,"15min":0.81299999999999994},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.2250000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79700000000000004,"15min":0.78700000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.163,"5min":1.641,"15min":1.641},"last":1.0409999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.84199999999999997},"min":{"1min":0.36299999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1779999999999999,"5min":1.292,"15min":1.292},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.89000000000000001,"15min":0.874},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.248,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.80300000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.86199999999999999,"15min":0.873},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1659999999999999,"5min":1.276,"15min":1.276},"last":1.081},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.012,"15min":0.96399999999999997},"min":{"1min":0.56200000000000006,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.339,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.1950000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.92200000000000004,"15min":0.96599999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2709999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0389999999999999,"15min":1.091},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2330000000000001,"5min":1.448,"15min":1.448},"last":1.1579999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.0169999999999999,"15min":1.0209999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2629999999999999,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.002,"5min":1.1000000000000001,"15min":1.075},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.208,"5min":9.8480000000000008,"15min":9.8480000000000008},"last":0.76900000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.044,"15min":1.1319999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.248,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1539999999999999,"15min":1.1699999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3939999999999999,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.1020000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1919999999999999,"15min":1.1699999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.3280000000000001,"5min":8.8290000000000006,"15min":8.8290000000000006},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1870000000000001,"15min":1.2629999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3859999999999999,"5min":1.71,"15min":1.71},"last":1.22}]}]},{"osd":3,"up_from":13,"seq":55834574912,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":318408,"kb_used_data":17024,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94053432,"statfs":{"total":96636764160,"available":96310714368,"internally_reserved":0,"allocated":17432576,"data_stored":17223470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65300000000000002,"15min":0.66000000000000003},"min":{"1min":0.52400000000000002,"5min":0.214,"15min":0.214},"max":{"1min":0.89100000000000001,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70299999999999996,"15min":0.71099999999999997},"min":{"1min":0.40999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.026,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":0.73599999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.69999999999999996,"15min":0.65600000000000003},"min":{"1min":0.42399999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1120000000000001,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.85099999999999998,"15min":0.76900000000000002},"min":{"1min":0.45700000000000002,"5min":0.249,"15min":0.249},"max":{"1min":1.3420000000000001,"5min":8.3059999999999992,"15min":8.3059999999999992},"last":0.79100000000000004}]},{"osd":2,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.1100000000000001,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.81299999999999994,"15min":0.78500000000000003},"min":{"1min":0.53900000000000003,"5min":0.433,"15min":0.433},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.65900000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.99299999999999999,"15min":1.0309999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.2310000000000001,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":0.996},{"interface":"front","average":{"1min":1.04,"5min":0.997,"15min":1.0049999999999999},"min":{"1min":0.74399999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3919999999999999,"5min":2.202,"15min":2.202},"last":1.1259999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0569999999999999,"15min":1.0820000000000001},"min":{"1min":0.69099999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.4379999999999999,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.012,"5min":1.0760000000000001,"15min":1.099},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.341,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.345}]},{"osd":6,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0620000000000001,"15min":1.0680000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3220000000000001,"5min":2.113,"15min":2.113},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1299999999999999,"15min":1.1679999999999999},"min":{"1min":0.72999999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.5129999999999999,"5min":3.351,"15min":3.351},"last":1.24}]},{"osd":7,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.1459999999999999,"15min":1.2110000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.353,"5min":2.984,"15min":2.984},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.1799999999999999,"15min":1.141},"min":{"1min":0.69999999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":6.3940000000000001,"5min":6.3940000000000001,"15min":6.3940000000000001},"last":1.177}]}]},{"osd":2,"up_from":13,"seq":55834574912,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310200,"kb_used_data":4720,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94061640,"statfs":{"total":96636764160,"available":96319119360,"internally_reserved":0,"allocated":4833280,"data_stored":4631728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.36099999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63,"15min":0.621},"min":{"1min":0.44800000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.83899999999999997,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.68500000000000005}]},{"osd":1,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.72199999999999998,"15min":0.748},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.753,"15min":0.74099999999999999},"min":{"1min":0.52400000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.76700000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.74399999999999999,"15min":0.75900000000000001},"min":{"1min":0.57899999999999996,"5min":0.315,"15min":0.315},"max":{"1min":0.871,"5min":1.454,"15min":1.454},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.86399999999999999,"15min":0.874},"min":{"1min":0.505,"5min":0.433,"15min":0.433},"max":{"1min":1.115,"5min":1.306,"15min":1.306},"last":1.1080000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.97299999999999998,"15min":1.0149999999999999},"min":{"1min":0.60499999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2250000000000001,"5min":1.954,"15min":1.954},"last":1.212},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.998,"15min":1.0349999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.377,"5min":1.804,"15min":1.804},"last":1.052}]},{"osd":5,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.96499999999999997,"15min":1.0149999999999999},"min":{"1min":0.61699999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.401,"5min":1.873,"15min":1.873},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0569999999999999,"15min":1.0960000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.206,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.024}]},{"osd":6,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.05,"15min":1.0860000000000001},"min":{"1min":0.70399999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.329,"5min":1.974,"15min":1.974},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.995,"5min":1.0469999999999999,"15min":1.079},"min":{"1min":0.66300000000000003,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.361,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.1779999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.1140000000000001,"15min":1.147},"min":{"1min":0.84999999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.3029999999999999,"5min":1.915,"15min":1.915},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.115,"15min":1.1599999999999999},"min":{"1min":0.79100000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.4219999999999999,"5min":2.524,"15min":2.524},"last":1.2549999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326288,"kb_used_data":20808,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94045552,"statfs":{"total":96636764160,"available":96302645248,"internally_reserved":0,"allocated":21307392,"data_stored":21108603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60399999999999998,"15min":0.60799999999999998},"min":{"1min":0.315,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.98999999999999999,"5min":1.024,"15min":1.024},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.65700000000000003,"15min":0.65100000000000002},"min":{"1min":0.39100000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.74199999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68200000000000005,"15min":0.65000000000000002},"min":{"1min":0.42899999999999999,"5min":0.373,"15min":0.373},"max":{"1min":1.3129999999999999,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":1.159},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.747,"15min":0.76300000000000001},"min":{"1min":0.53100000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.80200000000000005}]},{"osd":3,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79500000000000004,"15min":0.83799999999999997},"min":{"1min":0.51200000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.224,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.76400000000000001,"15min":0.76300000000000001},"min":{"1min":0.47199999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.153,"5min":1.25,"15min":1.25},"last":0.89600000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.90900000000000003,"15min":0.93200000000000005},"min":{"1min":0.60399999999999998,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.173,"5min":1.492,"15min":1.492},"last":1.02},{"interface":"front","average":{"1min":0.91200000000000003,"5min":1.0169999999999999,"15min":1.0149999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2210000000000001,"5min":3.5910000000000002,"15min":3.5910000000000002},"last":1.3320000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":1.03,"15min":1.0369999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.2829999999999999,"5min":3.6280000000000001,"15min":3.6280000000000001},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.109,"5min":1.075,"15min":1.113},"min":{"1min":0.69499999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.4650000000000001,"5min":1.641,"15min":1.641},"last":1.0009999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0409999999999999,"15min":1.091},"min":{"1min":0.71299999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.4299999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.117,"15min":1.1419999999999999},"min":{"1min":0.71099999999999997,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3660000000000001,"5min":3.657,"15min":3.657},"last":1.4870000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:08:18 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.103,"15min":1.1499999999999999},"min":{"1min":0.751,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.548,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.079,"5min":1.085,"15min":1.1220000000000001},"min":{"1min":0.68200000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3260000000000001,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.1910000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574912,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":330996,"kb_used_data":21420,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94040844,"statfs":{"total":96636764160,"available":96297824256,"internally_reserved":0,"allocated":21934080,"data_stored":21706793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.66000000000000003,"15min":0.64500000000000002},"min":{"1min":0.46000000000000002,"5min":0.318,"15min":0.318},"max":{"1min":3.9449999999999998,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.40699999999999997,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1659999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.68999999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.72099999999999997,"15min":0.70299999999999996},"min":{"1min":0.52100000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.755},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.77800000000000002,"15min":0.77400000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.3340000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.83399999999999996}]},{"osd":3,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.42699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":4.2229999999999999,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.84099999999999997,"15min":0.82299999999999995},"min":{"1min":0.628,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.88300000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.99199999999999999,"15min":0.999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.722,"5min":1.734,"15min":1.734},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.97299999999999998,"15min":1.014},"min":{"1min":0.63400000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.286,"5min":1.552,"15min":1.552},"last":1.006}]},{"osd":5,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.98399999999999999,"15min":1.0109999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.361,"5min":1.601,"15min":1.601},"last":1.157},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.0740000000000001,"15min":1.0760000000000001},"min":{"1min":0.76900000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.133}]},{"osd":6,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.115,"15min":1.129},"min":{"1min":0.71899999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.056},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1060000000000001,"15min":1.087},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.0900000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:08:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.161,"15min":1.157},"min":{"1min":0.81499999999999995,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.0940000000000001,"15min":1.1160000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":1.228}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20983808,"data_stored":20972130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20979712,"data_stored":20971680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4476928,"data_stored":4474292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17068032,"data_stored":17057848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17743872,"data_stored":17734414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":38711296,"data_stored":38705844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":24687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":16404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":36917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":45103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":16417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":49208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":32800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":32840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:09:20.724 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.724 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.724 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.724 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.724 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.725 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.725 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.725 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.725 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.725 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.725 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.726 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.726 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.726 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.726 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.726 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.726 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.727 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.727 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.727 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.727 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.727 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.727 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.729 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.729 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.729 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.729 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.730 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.730 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.730 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.730 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.730 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.730 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.731 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.731 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.731 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.731 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.731 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.731 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.732 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.732 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.732 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.732 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.732 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.732 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.733 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.733 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.733 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.733 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.733 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.733 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.734 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.734 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.734 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.734 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.734 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.734 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.735 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.735 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.735 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.735 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.735 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.735 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.736 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.736 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-08T16:04:05.034115+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=5, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.736 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.736 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.736 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.736 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.737 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.737 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.737 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.737 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.737 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.737 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.738 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.738 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.738 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.738 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.738 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.738 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.739 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.739 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.739 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.739 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.739 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.739 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.740 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.740 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.740 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.740 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.740 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.740 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.741 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.741 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.741 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.741 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:20.741 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-08T16:09:40.742 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:09:40.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.856+0000 7fa04e0fb700 1 Processor -- start 2023-10-08T16:09:40.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.856+0000 7fa04e0fb700 1 -- start start 2023-10-08T16:09:40.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.856+0000 7fa04e0fb700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0480b59f0 0x7fa0480b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:40.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.856+0000 7fa04e0fb700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa048142fe0 0x7fa04814cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:40.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.856+0000 7fa04e0fb700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0480b2150 con 0x7fa0481423c0 2023-10-08T16:09:40.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.856+0000 7fa04e0fb700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0480b1070 con 0x7fa048142fe0 2023-10-08T16:09:40.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.856+0000 7fa04e0fb700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa048143420 con 0x7fa0480b59f0 2023-10-08T16:09:40.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.860+0000 7fa04d8fa700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa048142fe0 0x7fa04814cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:40.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.860+0000 7fa04d0f9700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0480b59f0 0x7fa0480b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:40.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.860+0000 7fa04c8f8700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fa0481423c0 0x7fa0481428d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.133:38896/0 (socket says 172.21.15.133:38896) 2023-10-08T16:09:40.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.860+0000 7fa04d8fa700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa048142fe0 0x7fa04814cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.133:59650/0 (socket says 172.21.15.133:59650) 2023-10-08T16:09:40.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.860+0000 7fa04c8f8700 1 -- 172.21.15.133:0/2747513653 learned_addr learned my addr 172.21.15.133:0/2747513653 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:09:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.860+0000 7fa04d0f9700 1 -- 172.21.15.133:0/2747513653 >> v2:172.21.15.190:3300/0 conn(0x7fa048142fe0 msgr2=0x7fa04814cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.860+0000 7fa04d0f9700 1 --2- 172.21.15.133:0/2747513653 >> v2:172.21.15.190:3300/0 conn(0x7fa048142fe0 0x7fa04814cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.860+0000 7fa04d0f9700 1 -- 172.21.15.133:0/2747513653 >> v1:172.21.15.190:6789/0 conn(0x7fa0481423c0 legacy=0x7fa0481428d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.860+0000 7fa04d0f9700 1 -- 172.21.15.133:0/2747513653 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0480b26f0 con 0x7fa0480b59f0 2023-10-08T16:09:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.860+0000 7fa04d8fa700 1 --2- 172.21.15.133:0/2747513653 >> v2:172.21.15.190:3300/0 conn(0x7fa048142fe0 0x7fa04814cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:40.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.860+0000 7fa04d0f9700 1 --2- 172.21.15.133:0/2747513653 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0480b59f0 0x7fa0480b2b80 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fa0440098d0 tx=0x7fa044009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=673c317624b7603f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:40.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.864+0000 7fa03bfff700 1 -- 172.21.15.133:0/2747513653 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa044005c10 con 0x7fa0480b59f0 2023-10-08T16:09:40.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.864+0000 7fa03bfff700 1 -- 172.21.15.133:0/2747513653 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa044005d70 con 0x7fa0480b59f0 2023-10-08T16:09:40.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.864+0000 7fa03bfff700 1 -- 172.21.15.133:0/2747513653 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa044006280 con 0x7fa0480b59f0 2023-10-08T16:09:40.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.864+0000 7fa04e0fb700 1 -- 172.21.15.133:0/2747513653 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0480b59f0 msgr2=0x7fa0480b2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:40.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.864+0000 7fa04e0fb700 1 --2- 172.21.15.133:0/2747513653 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0480b59f0 0x7fa0480b2b80 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fa0440098d0 tx=0x7fa044009120 comp rx=0 tx=0).stop 2023-10-08T16:09:40.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.864+0000 7fa04e0fb700 1 -- 172.21.15.133:0/2747513653 shutdown_connections 2023-10-08T16:09:40.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.864+0000 7fa04e0fb700 1 --2- 172.21.15.133:0/2747513653 >> v2:172.21.15.190:3300/0 conn(0x7fa048142fe0 0x7fa04814cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.864+0000 7fa04e0fb700 1 --2- 172.21.15.133:0/2747513653 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0480b59f0 0x7fa0480b2b80 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.864+0000 7fa04e0fb700 1 -- 172.21.15.133:0/2747513653 >> 172.21.15.133:0/2747513653 conn(0x7fa048062ba0 msgr2=0x7fa048062fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:40.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.864+0000 7fa04e0fb700 1 -- 172.21.15.133:0/2747513653 shutdown_connections 2023-10-08T16:09:40.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.864+0000 7fa04e0fb700 1 -- 172.21.15.133:0/2747513653 wait complete. 2023-10-08T16:09:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.864+0000 7fa04e0fb700 1 Processor -- start 2023-10-08T16:09:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.864+0000 7fa04e0fb700 1 -- start start 2023-10-08T16:09:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.864+0000 7fa04e0fb700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0480b59f0 0x7fa0480aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.864+0000 7fa04e0fb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0481423c0 0x7fa0481552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.864+0000 7fa04e0fb700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa048142fe0 0x7fa048155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.868+0000 7fa04e0fb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa048151cd0 con 0x7fa0481423c0 2023-10-08T16:09:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.868+0000 7fa04e0fb700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0480af040 con 0x7fa0480b59f0 2023-10-08T16:09:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.868+0000 7fa04e0fb700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0480af960 con 0x7fa048142fe0 2023-10-08T16:09:40.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.868+0000 7fa04c8f8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0481423c0 0x7fa0481552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:40.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.868+0000 7fa04c8f8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0481423c0 0x7fa0481552d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51002/0 (socket says 172.21.15.133:51002) 2023-10-08T16:09:40.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.868+0000 7fa04c8f8700 1 -- 172.21.15.133:0/1500359163 learned_addr learned my addr 172.21.15.133:0/1500359163 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:09:40.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.868+0000 7fa04d8fa700 1 --2- 172.21.15.133:0/1500359163 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa048142fe0 0x7fa048155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:40.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.868+0000 7fa04d0f9700 1 --2- 172.21.15.133:0/1500359163 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0480b59f0 0x7fa0480aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:40.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.868+0000 7fa04c8f8700 1 -- 172.21.15.133:0/1500359163 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa048142fe0 msgr2=0x7fa048155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:40.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.868+0000 7fa04c8f8700 1 --2- 172.21.15.133:0/1500359163 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa048142fe0 0x7fa048155810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.868+0000 7fa04c8f8700 1 -- 172.21.15.133:0/1500359163 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0480b59f0 msgr2=0x7fa0480aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:40.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.868+0000 7fa04c8f8700 1 --2- 172.21.15.133:0/1500359163 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0480b59f0 0x7fa0480aeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.868+0000 7fa04c8f8700 1 -- 172.21.15.133:0/1500359163 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa040009a20 con 0x7fa0481423c0 2023-10-08T16:09:40.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.868+0000 7fa04c8f8700 1 --2- 172.21.15.133:0/1500359163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0481423c0 0x7fa0481552d0 secure :-1 s=READY pgs=4405 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00c790 tx=0x7fa03c007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:40.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.868+0000 7fa0397fa700 1 -- 172.21.15.133:0/1500359163 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c005b30 con 0x7fa0481423c0 2023-10-08T16:09:40.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.868+0000 7fa0397fa700 1 -- 172.21.15.133:0/1500359163 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03c005c90 con 0x7fa0481423c0 2023-10-08T16:09:40.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.868+0000 7fa04e0fb700 1 -- 172.21.15.133:0/1500359163 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0440093c0 con 0x7fa0481423c0 2023-10-08T16:09:40.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.868+0000 7fa0397fa700 1 -- 172.21.15.133:0/1500359163 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c004a80 con 0x7fa0481423c0 2023-10-08T16:09:40.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.868+0000 7fa04e0fb700 1 -- 172.21.15.133:0/1500359163 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa048152520 con 0x7fa0481423c0 2023-10-08T16:09:40.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.868+0000 7fa0397fa700 1 -- 172.21.15.133:0/1500359163 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa03c0070d0 con 0x7fa0481423c0 2023-10-08T16:09:40.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.872+0000 7fa04e0fb700 1 -- 172.21.15.133:0/1500359163 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa048152020 con 0x7fa0481423c0 2023-10-08T16:09:40.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.872+0000 7fa0397fa700 1 --2- 172.21.15.133:0/1500359163 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fa02c060550 0x7fa02c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:40.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.872+0000 7fa04d0f9700 1 --2- 172.21.15.133:0/1500359163 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fa02c060550 0x7fa02c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:40.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.872+0000 7fa0397fa700 1 -- 172.21.15.133:0/1500359163 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fa03c07baf0 con 0x7fa0481423c0 2023-10-08T16:09:40.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.872+0000 7fa04d0f9700 1 --2- 172.21.15.133:0/1500359163 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fa02c060550 0x7fa02c062a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa0480b5fa0 tx=0x7fa044016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:40.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:40.880+0000 7fa0397fa700 1 -- 172.21.15.133:0/1500359163 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa03c049be0 con 0x7fa0481423c0 2023-10-08T16:09:41.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:41.040+0000 7fa04e0fb700 1 -- 172.21.15.133:0/1500359163 --> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa04804be40 con 0x7fa02c060550 2023-10-08T16:09:41.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:41.052+0000 7fa0397fa700 1 -- 172.21.15.133:0/1500359163 <== mgr.4104 v2:172.21.15.133:6832/33362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289831 (secure 0 0 0) 0x7fa04804be40 con 0x7fa02c060550 2023-10-08T16:09:41.062 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:09:41.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:41.060+0000 7fa04e0fb700 1 -- 172.21.15.133:0/1500359163 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fa02c060550 msgr2=0x7fa02c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:41.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:41.060+0000 7fa04e0fb700 1 --2- 172.21.15.133:0/1500359163 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fa02c060550 0x7fa02c062a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa0480b5fa0 tx=0x7fa044016000 comp rx=0 tx=0).stop 2023-10-08T16:09:41.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:41.060+0000 7fa04e0fb700 1 -- 172.21.15.133:0/1500359163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0481423c0 msgr2=0x7fa0481552d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:41.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:41.060+0000 7fa04e0fb700 1 --2- 172.21.15.133:0/1500359163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0481423c0 0x7fa0481552d0 secure :-1 s=READY pgs=4405 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00c790 tx=0x7fa03c007f40 comp rx=0 tx=0).stop 2023-10-08T16:09:41.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:41.060+0000 7fa04e0fb700 1 -- 172.21.15.133:0/1500359163 shutdown_connections 2023-10-08T16:09:41.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:41.060+0000 7fa04e0fb700 1 --2- 172.21.15.133:0/1500359163 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fa02c060550 0x7fa02c062a00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:41.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:41.060+0000 7fa04e0fb700 1 --2- 172.21.15.133:0/1500359163 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa048142fe0 0x7fa048155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:41.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:41.060+0000 7fa04e0fb700 1 --2- 172.21.15.133:0/1500359163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0481423c0 0x7fa0481552d0 unknown :-1 s=CLOSED pgs=4405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:41.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:41.060+0000 7fa04e0fb700 1 --2- 172.21.15.133:0/1500359163 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0480b59f0 0x7fa0480aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:41.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:41.060+0000 7fa04e0fb700 1 -- 172.21.15.133:0/1500359163 >> 172.21.15.133:0/1500359163 conn(0x7fa048062ba0 msgr2=0x7fa0480b00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:41.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:41.060+0000 7fa04e0fb700 1 -- 172.21.15.133:0/1500359163 shutdown_connections 2023-10-08T16:09:41.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:09:41.060+0000 7fa04e0fb700 1 -- 172.21.15.133:0/1500359163 wait complete. 2023-10-08T16:09:41.066 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-10-08T16:09:41.076 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2023-10-08T16:09:40.948129+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":85845472,"num_objects":127,"num_object_clones":21,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":8,"num_read":209,"num_read_kb":442,"num_write":18242,"num_write_kb":96383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55992,"ondisk_log_size":55992,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2622268,"kb_used_data":170236,"kb_used_omap":0,"kb_used_meta":2451968,"kb_avail":752352452,"statfs":{"total":773094113280,"available":770408910848,"internally_reserved":0,"allocated":174321664,"data_stored":172654185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2510815232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003989"},"pg_stats":[{"pgid":"3.3f","version":"28'511","reported_seq":580,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650801+0000","last_change":"2023-10-08T16:08:50.725515+0000","last_active":"2023-10-08T16:09:06.650801+0000","last_peered":"2023-10-08T16:09:06.650801+0000","last_clean":"2023-10-08T16:09:06.650801+0000","last_became_active":"2023-10-08T16:04:17.626468+0000","last_became_peered":"2023-10-08T16:04:17.626468+0000","last_unstale":"2023-10-08T16:09:06.650801+0000","last_undegraded":"2023-10-08T16:09:06.650801+0000","last_fullsized":"2023-10-08T16:09:06.650801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012965628,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"28'502","reported_seq":581,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:30.128019+0000","last_change":"2023-10-08T16:09:30.127903+0000","last_active":"2023-10-08T16:09:30.128019+0000","last_peered":"2023-10-08T16:09:30.128019+0000","last_clean":"2023-10-08T16:09:30.128019+0000","last_became_active":"2023-10-08T16:04:17.623968+0000","last_became_peered":"2023-10-08T16:04:17.623968+0000","last_unstale":"2023-10-08T16:09:30.128019+0000","last_undegraded":"2023-10-08T16:09:30.128019+0000","last_fullsized":"2023-10-08T16:09:30.128019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'502","last_scrub_stamp":"2023-10-08T16:09:30.127492+0000","last_deep_scrub":"28'502","last_deep_scrub_stamp":"2023-10-08T16:09:30.127492+0000","last_clean_scrub_stamp":"2023-10-08T16:09:30.127492+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:10:49.129682+0000","scrub_duration":0.0045437120000000001,"objects_trimmed":0,"snaptrim_duration":0.025754998000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"28'751","reported_seq":829,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:35.484095+0000","last_change":"2023-10-08T16:09:35.483973+0000","last_active":"2023-10-08T16:09:35.484095+0000","last_peered":"2023-10-08T16:09:35.484095+0000","last_clean":"2023-10-08T16:09:35.484095+0000","last_became_active":"2023-10-08T16:04:17.624219+0000","last_became_peered":"2023-10-08T16:04:17.624219+0000","last_unstale":"2023-10-08T16:09:35.484095+0000","last_undegraded":"2023-10-08T16:09:35.484095+0000","last_fullsized":"2023-10-08T16:09:35.484095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'751","last_scrub_stamp":"2023-10-08T16:09:35.483714+0000","last_deep_scrub":"28'751","last_deep_scrub_stamp":"2023-10-08T16:09:35.483714+0000","last_clean_scrub_stamp":"2023-10-08T16:09:35.483714+0000","objects_scrubbed":2,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:53.398487+0000","scrub_duration":0.0086411349999999994,"objects_trimmed":0,"snaptrim_duration":0.046708411999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'447","reported_seq":516,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.648420+0000","last_change":"2023-10-08T16:08:50.726275+0000","last_active":"2023-10-08T16:09:06.648420+0000","last_peered":"2023-10-08T16:09:06.648420+0000","last_clean":"2023-10-08T16:09:06.648420+0000","last_became_active":"2023-10-08T16:04:17.628308+0000","last_became_peered":"2023-10-08T16:04:17.628308+0000","last_unstale":"2023-10-08T16:09:06.648420+0000","last_undegraded":"2023-10-08T16:09:06.648420+0000","last_fullsized":"2023-10-08T16:09:06.648420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019603182,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'456","reported_seq":524,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646272+0000","last_change":"2023-10-08T16:08:50.725181+0000","last_active":"2023-10-08T16:09:06.646272+0000","last_peered":"2023-10-08T16:09:06.646272+0000","last_clean":"2023-10-08T16:09:06.646272+0000","last_became_active":"2023-10-08T16:04:17.625650+0000","last_became_peered":"2023-10-08T16:04:17.625650+0000","last_unstale":"2023-10-08T16:09:06.646272+0000","last_undegraded":"2023-10-08T16:09:06.646272+0000","last_fullsized":"2023-10-08T16:09:06.646272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013008828,"stat_sum":{"num_bytes":4107,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'641","reported_seq":717,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:32.516400+0000","last_change":"2023-10-08T16:09:32.516346+0000","last_active":"2023-10-08T16:09:32.516400+0000","last_peered":"2023-10-08T16:09:32.516400+0000","last_clean":"2023-10-08T16:09:32.516400+0000","last_became_active":"2023-10-08T16:04:59.029141+0000","last_became_peered":"2023-10-08T16:04:59.029141+0000","last_unstale":"2023-10-08T16:09:32.516400+0000","last_undegraded":"2023-10-08T16:09:32.516400+0000","last_fullsized":"2023-10-08T16:09:32.516400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'641","last_scrub_stamp":"2023-10-08T16:09:32.516164+0000","last_deep_scrub":"28'641","last_deep_scrub_stamp":"2023-10-08T16:09:32.516164+0000","last_clean_scrub_stamp":"2023-10-08T16:09:32.516164+0000","objects_scrubbed":3,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:50.430937+0000","scrub_duration":0.011603842,"objects_trimmed":0,"snaptrim_duration":0.010017161,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"28'439","reported_seq":508,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.645653+0000","last_change":"2023-10-08T16:08:50.721969+0000","last_active":"2023-10-08T16:09:06.645653+0000","last_peered":"2023-10-08T16:09:06.645653+0000","last_clean":"2023-10-08T16:09:06.645653+0000","last_became_active":"2023-10-08T16:04:17.631722+0000","last_became_peered":"2023-10-08T16:04:17.631722+0000","last_unstale":"2023-10-08T16:09:06.645653+0000","last_undegraded":"2023-10-08T16:09:06.645653+0000","last_fullsized":"2023-10-08T16:09:06.645653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010482406,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'606","reported_seq":674,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:07.156697+0000","last_change":"2023-10-08T16:08:50.714547+0000","last_active":"2023-10-08T16:09:07.156697+0000","last_peered":"2023-10-08T16:09:07.156697+0000","last_clean":"2023-10-08T16:09:07.156697+0000","last_became_active":"2023-10-08T16:04:17.628987+0000","last_became_peered":"2023-10-08T16:04:17.628987+0000","last_unstale":"2023-10-08T16:09:07.156697+0000","last_undegraded":"2023-10-08T16:09:07.156697+0000","last_fullsized":"2023-10-08T16:09:07.156697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011543940000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"28'702","reported_seq":771,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650879+0000","last_change":"2023-10-08T16:08:50.727041+0000","last_active":"2023-10-08T16:09:06.650879+0000","last_peered":"2023-10-08T16:09:06.650879+0000","last_clean":"2023-10-08T16:09:06.650879+0000","last_became_active":"2023-10-08T16:04:17.636350+0000","last_became_peered":"2023-10-08T16:04:17.636350+0000","last_unstale":"2023-10-08T16:09:06.650879+0000","last_undegraded":"2023-10-08T16:09:06.650879+0000","last_fullsized":"2023-10-08T16:09:06.650879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014319053,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'946","reported_seq":1025,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.636866+0000","last_change":"2023-10-08T16:08:50.720768+0000","last_active":"2023-10-08T16:09:06.636866+0000","last_peered":"2023-10-08T16:09:06.636866+0000","last_clean":"2023-10-08T16:09:06.636866+0000","last_became_active":"2023-10-08T16:04:58.696602+0000","last_became_peered":"2023-10-08T16:04:58.696602+0000","last_unstale":"2023-10-08T16:09:06.636866+0000","last_undegraded":"2023-10-08T16:09:06.636866+0000","last_fullsized":"2023-10-08T16:09:06.636866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":946,"log_dups_size":0,"ondisk_log_size":946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014587116000000001,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"28'517","reported_seq":596,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:30.599563+0000","last_change":"2023-10-08T16:09:30.599506+0000","last_active":"2023-10-08T16:09:30.599563+0000","last_peered":"2023-10-08T16:09:30.599563+0000","last_clean":"2023-10-08T16:09:30.599563+0000","last_became_active":"2023-10-08T16:04:17.627965+0000","last_became_peered":"2023-10-08T16:04:17.627965+0000","last_unstale":"2023-10-08T16:09:30.599563+0000","last_undegraded":"2023-10-08T16:09:30.599563+0000","last_fullsized":"2023-10-08T16:09:30.599563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'517","last_scrub_stamp":"2023-10-08T16:09:30.599375+0000","last_deep_scrub":"28'517","last_deep_scrub_stamp":"2023-10-08T16:09:30.599375+0000","last_clean_scrub_stamp":"2023-10-08T16:09:30.599375+0000","objects_scrubbed":2,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:41.494405+0000","scrub_duration":0.0091910640000000005,"objects_trimmed":0,"snaptrim_duration":0.012809017000000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'623","reported_seq":702,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:38.311592+0000","last_change":"2023-10-08T16:09:38.311514+0000","last_active":"2023-10-08T16:09:38.311592+0000","last_peered":"2023-10-08T16:09:38.311592+0000","last_clean":"2023-10-08T16:09:38.311592+0000","last_became_active":"2023-10-08T16:04:17.616988+0000","last_became_peered":"2023-10-08T16:04:17.616988+0000","last_unstale":"2023-10-08T16:09:38.311592+0000","last_undegraded":"2023-10-08T16:09:38.311592+0000","last_fullsized":"2023-10-08T16:09:38.311592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'623","last_scrub_stamp":"2023-10-08T16:09:38.311231+0000","last_deep_scrub":"28'623","last_deep_scrub_stamp":"2023-10-08T16:09:38.311231+0000","last_clean_scrub_stamp":"2023-10-08T16:09:38.311231+0000","objects_scrubbed":1,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:47.744886+0000","scrub_duration":0.0086635310000000004,"objects_trimmed":0,"snaptrim_duration":0.010221923000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"28'578","reported_seq":647,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.636501+0000","last_change":"2023-10-08T16:08:50.715034+0000","last_active":"2023-10-08T16:09:06.636501+0000","last_peered":"2023-10-08T16:09:06.636501+0000","last_clean":"2023-10-08T16:09:06.636501+0000","last_became_active":"2023-10-08T16:04:17.625529+0000","last_became_peered":"2023-10-08T16:04:17.625529+0000","last_unstale":"2023-10-08T16:09:06.636501+0000","last_undegraded":"2023-10-08T16:09:06.636501+0000","last_fullsized":"2023-10-08T16:09:06.636501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011264827,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"28'489","reported_seq":558,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.629955+0000","last_change":"2023-10-08T16:08:50.772353+0000","last_active":"2023-10-08T16:09:06.629955+0000","last_peered":"2023-10-08T16:09:06.629955+0000","last_clean":"2023-10-08T16:09:06.629955+0000","last_became_active":"2023-10-08T16:04:17.624197+0000","last_became_peered":"2023-10-08T16:04:17.624197+0000","last_unstale":"2023-10-08T16:09:06.629955+0000","last_undegraded":"2023-10-08T16:09:06.629955+0000","last_fullsized":"2023-10-08T16:09:06.629955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037453408000000001,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"28'589","reported_seq":668,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:34.179421+0000","last_change":"2023-10-08T16:09:34.179325+0000","last_active":"2023-10-08T16:09:34.179421+0000","last_peered":"2023-10-08T16:09:34.179421+0000","last_clean":"2023-10-08T16:09:34.179421+0000","last_became_active":"2023-10-08T16:04:17.620391+0000","last_became_peered":"2023-10-08T16:04:17.620391+0000","last_unstale":"2023-10-08T16:09:34.179421+0000","last_undegraded":"2023-10-08T16:09:34.179421+0000","last_fullsized":"2023-10-08T16:09:34.179421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'589","last_scrub_stamp":"2023-10-08T16:09:34.178927+0000","last_deep_scrub":"28'589","last_deep_scrub_stamp":"2023-10-08T16:09:34.178927+0000","last_clean_scrub_stamp":"2023-10-08T16:09:34.178927+0000","objects_scrubbed":3,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:45.073957+0000","scrub_duration":0.011898857000000001,"objects_trimmed":0,"snaptrim_duration":0.029228837000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"28'650","reported_seq":718,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649069+0000","last_change":"2023-10-08T16:08:50.723712+0000","last_active":"2023-10-08T16:09:06.649069+0000","last_peered":"2023-10-08T16:09:06.649069+0000","last_clean":"2023-10-08T16:09:06.649069+0000","last_became_active":"2023-10-08T16:04:17.619843+0000","last_became_peered":"2023-10-08T16:04:17.619843+0000","last_unstale":"2023-10-08T16:09:06.649069+0000","last_undegraded":"2023-10-08T16:09:06.649069+0000","last_fullsized":"2023-10-08T16:09:06.649069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018851915,"stat_sum":{"num_bytes":4105,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"28'622","reported_seq":691,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650316+0000","last_change":"2023-10-08T16:08:50.725684+0000","last_active":"2023-10-08T16:09:06.650316+0000","last_peered":"2023-10-08T16:09:06.650316+0000","last_clean":"2023-10-08T16:09:06.650316+0000","last_became_active":"2023-10-08T16:04:17.625580+0000","last_became_peered":"2023-10-08T16:04:17.625580+0000","last_unstale":"2023-10-08T16:09:06.650316+0000","last_undegraded":"2023-10-08T16:09:06.650316+0000","last_fullsized":"2023-10-08T16:09:06.650316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018077737,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"28'592","reported_seq":670,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:31.535573+0000","last_change":"2023-10-08T16:09:31.535491+0000","last_active":"2023-10-08T16:09:31.535573+0000","last_peered":"2023-10-08T16:09:31.535573+0000","last_clean":"2023-10-08T16:09:31.535573+0000","last_became_active":"2023-10-08T16:04:17.627197+0000","last_became_peered":"2023-10-08T16:04:17.627197+0000","last_unstale":"2023-10-08T16:09:31.535573+0000","last_undegraded":"2023-10-08T16:09:31.535573+0000","last_fullsized":"2023-10-08T16:09:31.535573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'592","last_scrub_stamp":"2023-10-08T16:09:31.535221+0000","last_deep_scrub":"28'592","last_deep_scrub_stamp":"2023-10-08T16:09:31.535221+0000","last_clean_scrub_stamp":"2023-10-08T16:09:31.535221+0000","objects_scrubbed":3,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:56:01.556005+0000","scrub_duration":0.011238002,"objects_trimmed":0,"snaptrim_duration":0.0098294880000000008,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"28'596","reported_seq":675,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.806907+0000","last_change":"2023-10-08T16:09:20.806843+0000","last_active":"2023-10-08T16:09:20.806907+0000","last_peered":"2023-10-08T16:09:20.806907+0000","last_clean":"2023-10-08T16:09:20.806907+0000","last_became_active":"2023-10-08T16:04:17.625586+0000","last_became_peered":"2023-10-08T16:04:17.625586+0000","last_unstale":"2023-10-08T16:09:20.806907+0000","last_undegraded":"2023-10-08T16:09:20.806907+0000","last_fullsized":"2023-10-08T16:09:20.806907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'596","last_scrub_stamp":"2023-10-08T16:09:20.806564+0000","last_deep_scrub":"28'596","last_deep_scrub_stamp":"2023-10-08T16:09:20.806564+0000","last_clean_scrub_stamp":"2023-10-08T16:09:20.806564+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:23:55.634452+0000","scrub_duration":0.0041559450000000003,"objects_trimmed":0,"snaptrim_duration":0.014288673999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"28'769","reported_seq":838,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646679+0000","last_change":"2023-10-08T16:08:50.717675+0000","last_active":"2023-10-08T16:09:06.646679+0000","last_peered":"2023-10-08T16:09:06.646679+0000","last_clean":"2023-10-08T16:09:06.646679+0000","last_became_active":"2023-10-08T16:04:17.623200+0000","last_became_peered":"2023-10-08T16:04:17.623200+0000","last_unstale":"2023-10-08T16:09:06.646679+0000","last_undegraded":"2023-10-08T16:09:06.646679+0000","last_fullsized":"2023-10-08T16:09:06.646679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012983668,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"28'725","reported_seq":795,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650485+0000","last_change":"2023-10-08T16:08:50.784761+0000","last_active":"2023-10-08T16:09:06.650485+0000","last_peered":"2023-10-08T16:09:06.650485+0000","last_clean":"2023-10-08T16:09:06.650485+0000","last_became_active":"2023-10-08T16:04:17.623945+0000","last_became_peered":"2023-10-08T16:04:17.623945+0000","last_unstale":"2023-10-08T16:09:06.650485+0000","last_undegraded":"2023-10-08T16:09:06.650485+0000","last_fullsized":"2023-10-08T16:09:06.650485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045353759,"stat_sum":{"num_bytes":4128,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"28'829","reported_seq":921,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650139+0000","last_change":"2023-10-08T16:08:50.723672+0000","last_active":"2023-10-08T16:09:06.650139+0000","last_peered":"2023-10-08T16:09:06.650139+0000","last_clean":"2023-10-08T16:09:06.650139+0000","last_became_active":"2023-10-08T16:04:17.623904+0000","last_became_peered":"2023-10-08T16:04:17.623904+0000","last_unstale":"2023-10-08T16:09:06.650139+0000","last_undegraded":"2023-10-08T16:09:06.650139+0000","last_fullsized":"2023-10-08T16:09:06.650139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019052278999999998,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":25,"num_read_kb":20,"num_write":31,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'549","reported_seq":617,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.639715+0000","last_change":"2023-10-08T16:08:50.714440+0000","last_active":"2023-10-08T16:09:06.639715+0000","last_peered":"2023-10-08T16:09:06.639715+0000","last_clean":"2023-10-08T16:09:06.639715+0000","last_became_active":"2023-10-08T16:04:17.618549+0000","last_became_peered":"2023-10-08T16:04:17.618549+0000","last_unstale":"2023-10-08T16:09:06.639715+0000","last_undegraded":"2023-10-08T16:09:06.639715+0000","last_fullsized":"2023-10-08T16:09:06.639715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011087115999999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'657","reported_seq":725,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649375+0000","last_change":"2023-10-08T16:08:50.724464+0000","last_active":"2023-10-08T16:09:06.649375+0000","last_peered":"2023-10-08T16:09:06.649375+0000","last_clean":"2023-10-08T16:09:06.649375+0000","last_became_active":"2023-10-08T16:04:17.627673+0000","last_became_peered":"2023-10-08T16:04:17.627673+0000","last_unstale":"2023-10-08T16:09:06.649375+0000","last_undegraded":"2023-10-08T16:09:06.649375+0000","last_fullsized":"2023-10-08T16:09:06.649375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019445790000000001,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"28'468","reported_seq":537,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.630126+0000","last_change":"2023-10-08T16:08:50.715828+0000","last_active":"2023-10-08T16:09:06.630126+0000","last_peered":"2023-10-08T16:09:06.630126+0000","last_clean":"2023-10-08T16:09:06.630126+0000","last_became_active":"2023-10-08T16:04:17.628793+0000","last_became_peered":"2023-10-08T16:04:17.628793+0000","last_unstale":"2023-10-08T16:09:06.630126+0000","last_undegraded":"2023-10-08T16:09:06.630126+0000","last_fullsized":"2023-10-08T16:09:06.630126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011350429,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"28'659","reported_seq":728,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.649924+0000","last_change":"2023-10-08T16:08:50.720438+0000","last_active":"2023-10-08T16:09:06.649924+0000","last_peered":"2023-10-08T16:09:06.649924+0000","last_clean":"2023-10-08T16:09:06.649924+0000","last_became_active":"2023-10-08T16:04:17.625220+0000","last_became_peered":"2023-10-08T16:04:17.625220+0000","last_unstale":"2023-10-08T16:09:06.649924+0000","last_undegraded":"2023-10-08T16:09:06.649924+0000","last_fullsized":"2023-10-08T16:09:06.649924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013452108000000001,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'351","reported_seq":430,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:32.175421+0000","last_change":"2023-10-08T16:09:32.175337+0000","last_active":"2023-10-08T16:09:32.175421+0000","last_peered":"2023-10-08T16:09:32.175421+0000","last_clean":"2023-10-08T16:09:32.175421+0000","last_became_active":"2023-10-08T16:04:17.629574+0000","last_became_peered":"2023-10-08T16:04:17.629574+0000","last_unstale":"2023-10-08T16:09:32.175421+0000","last_undegraded":"2023-10-08T16:09:32.175421+0000","last_fullsized":"2023-10-08T16:09:32.175421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'351","last_scrub_stamp":"2023-10-08T16:09:32.175035+0000","last_deep_scrub":"28'351","last_deep_scrub_stamp":"2023-10-08T16:09:32.175035+0000","last_clean_scrub_stamp":"2023-10-08T16:09:32.175035+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:49.594680+0000","scrub_duration":0.0040114620000000004,"objects_trimmed":0,"snaptrim_duration":0.024743081,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"28'585","reported_seq":654,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.643615+0000","last_change":"2023-10-08T16:08:50.715713+0000","last_active":"2023-10-08T16:09:06.643615+0000","last_peered":"2023-10-08T16:09:06.643615+0000","last_clean":"2023-10-08T16:09:06.643615+0000","last_became_active":"2023-10-08T16:04:17.626420+0000","last_became_peered":"2023-10-08T16:04:17.626420+0000","last_unstale":"2023-10-08T16:09:06.643615+0000","last_undegraded":"2023-10-08T16:09:06.643615+0000","last_fullsized":"2023-10-08T16:09:06.643615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011442964999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'586","reported_seq":665,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:39.418064+0000","last_change":"2023-10-08T16:09:39.417990+0000","last_active":"2023-10-08T16:09:39.418064+0000","last_peered":"2023-10-08T16:09:39.418064+0000","last_clean":"2023-10-08T16:09:39.418064+0000","last_became_active":"2023-10-08T16:04:17.618207+0000","last_became_peered":"2023-10-08T16:04:17.618207+0000","last_unstale":"2023-10-08T16:09:39.418064+0000","last_undegraded":"2023-10-08T16:09:39.418064+0000","last_fullsized":"2023-10-08T16:09:39.418064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'586","last_scrub_stamp":"2023-10-08T16:09:39.417718+0000","last_deep_scrub":"28'586","last_deep_scrub_stamp":"2023-10-08T16:09:39.417718+0000","last_clean_scrub_stamp":"2023-10-08T16:09:39.417718+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:56.837364+0000","scrub_duration":0.0037683299999999999,"objects_trimmed":0,"snaptrim_duration":0.042752309000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"28'401","reported_seq":470,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.647858+0000","last_change":"2023-10-08T16:08:50.725249+0000","last_active":"2023-10-08T16:09:06.647858+0000","last_peered":"2023-10-08T16:09:06.647858+0000","last_clean":"2023-10-08T16:09:06.647858+0000","last_became_active":"2023-10-08T16:04:17.627093+0000","last_became_peered":"2023-10-08T16:04:17.627093+0000","last_unstale":"2023-10-08T16:09:06.647858+0000","last_undegraded":"2023-10-08T16:09:06.647858+0000","last_fullsized":"2023-10-08T16:09:06.647858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020438813,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"28'946","reported_seq":1024,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:28.533253+0000","last_change":"2023-10-08T16:09:28.533141+0000","last_active":"2023-10-08T16:09:28.533253+0000","last_peered":"2023-10-08T16:09:28.533253+0000","last_clean":"2023-10-08T16:09:28.533253+0000","last_became_active":"2023-10-08T16:04:17.629049+0000","last_became_peered":"2023-10-08T16:04:17.629049+0000","last_unstale":"2023-10-08T16:09:28.533253+0000","last_undegraded":"2023-10-08T16:09:28.533253+0000","last_fullsized":"2023-10-08T16:09:28.533253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'946","last_scrub_stamp":"2023-10-08T16:09:28.532841+0000","last_deep_scrub":"28'946","last_deep_scrub_stamp":"2023-10-08T16:09:28.532841+0000","last_clean_scrub_stamp":"2023-10-08T16:09:28.532841+0000","objects_scrubbed":5,"log_size":946,"log_dups_size":0,"ondisk_log_size":946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:37.966495+0000","scrub_duration":0.013109762,"objects_trimmed":0,"snaptrim_duration":0.01455822,"stat_sum":{"num_bytes":8206,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"28'746","reported_seq":815,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.636979+0000","last_change":"2023-10-08T16:08:50.714786+0000","last_active":"2023-10-08T16:09:06.636979+0000","last_peered":"2023-10-08T16:09:06.636979+0000","last_clean":"2023-10-08T16:09:06.636979+0000","last_became_active":"2023-10-08T16:04:17.632012+0000","last_became_peered":"2023-10-08T16:04:17.632012+0000","last_unstale":"2023-10-08T16:09:06.636979+0000","last_undegraded":"2023-10-08T16:09:06.636979+0000","last_fullsized":"2023-10-08T16:09:06.636979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010590815999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"28'514","reported_seq":593,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:33.210343+0000","last_change":"2023-10-08T16:09:33.210256+0000","last_active":"2023-10-08T16:09:33.210343+0000","last_peered":"2023-10-08T16:09:33.210343+0000","last_clean":"2023-10-08T16:09:33.210343+0000","last_became_active":"2023-10-08T16:04:17.623220+0000","last_became_peered":"2023-10-08T16:04:17.623220+0000","last_unstale":"2023-10-08T16:09:33.210343+0000","last_undegraded":"2023-10-08T16:09:33.210343+0000","last_fullsized":"2023-10-08T16:09:33.210343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'514","last_scrub_stamp":"2023-10-08T16:09:33.209999+0000","last_deep_scrub":"28'514","last_deep_scrub_stamp":"2023-10-08T16:09:33.209999+0000","last_clean_scrub_stamp":"2023-10-08T16:09:33.209999+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:59.313227+0000","scrub_duration":0.0040553860000000002,"objects_trimmed":0,"snaptrim_duration":0.010375987999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'748","reported_seq":777,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:21.543351+0000","last_change":"2023-10-08T16:09:21.543315+0000","last_active":"2023-10-08T16:09:21.543351+0000","last_peered":"2023-10-08T16:09:21.543351+0000","last_clean":"2023-10-08T16:09:21.543351+0000","last_became_active":"2023-10-08T16:04:16.660183+0000","last_became_peered":"2023-10-08T16:04:16.660183+0000","last_unstale":"2023-10-08T16:09:21.543351+0000","last_undegraded":"2023-10-08T16:09:21.543351+0000","last_fullsized":"2023-10-08T16:09:21.543351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'748","last_scrub_stamp":"2023-10-08T16:09:21.543182+0000","last_deep_scrub":"28'748","last_deep_scrub_stamp":"2023-10-08T16:09:21.543182+0000","last_clean_scrub_stamp":"2023-10-08T16:09:21.543182+0000","objects_scrubbed":1,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:24.849342+0000","scrub_duration":0.022119043000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":743,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'638","reported_seq":717,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:36.437028+0000","last_change":"2023-10-08T16:09:36.436892+0000","last_active":"2023-10-08T16:09:36.437028+0000","last_peered":"2023-10-08T16:09:36.437028+0000","last_clean":"2023-10-08T16:09:36.437028+0000","last_became_active":"2023-10-08T16:04:17.620532+0000","last_became_peered":"2023-10-08T16:04:17.620532+0000","last_unstale":"2023-10-08T16:09:36.437028+0000","last_undegraded":"2023-10-08T16:09:36.437028+0000","last_fullsized":"2023-10-08T16:09:36.437028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'638","last_scrub_stamp":"2023-10-08T16:09:36.436578+0000","last_deep_scrub":"28'638","last_deep_scrub_stamp":"2023-10-08T16:09:36.436578+0000","last_clean_scrub_stamp":"2023-10-08T16:09:36.436578+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:34.975714+0000","scrub_duration":0.0046835050000000001,"objects_trimmed":0,"snaptrim_duration":0.042650311000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"28'757","reported_seq":786,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:23.727018+0000","last_change":"2023-10-08T16:09:23.726922+0000","last_active":"2023-10-08T16:09:23.727018+0000","last_peered":"2023-10-08T16:09:23.727018+0000","last_clean":"2023-10-08T16:09:23.727018+0000","last_became_active":"2023-10-08T16:04:16.653936+0000","last_became_peered":"2023-10-08T16:04:16.653936+0000","last_unstale":"2023-10-08T16:09:23.727018+0000","last_undegraded":"2023-10-08T16:09:23.727018+0000","last_fullsized":"2023-10-08T16:09:23.727018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'757","last_scrub_stamp":"2023-10-08T16:09:23.726712+0000","last_deep_scrub":"28'757","last_deep_scrub_stamp":"2023-10-08T16:09:23.726712+0000","last_clean_scrub_stamp":"2023-10-08T16:09:23.726712+0000","objects_scrubbed":1,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:53.747495+0000","scrub_duration":0.024528384,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"28'11","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:25.609965+0000","last_change":"2023-10-08T16:09:25.609898+0000","last_active":"2023-10-08T16:09:25.609965+0000","last_peered":"2023-10-08T16:09:25.609965+0000","last_clean":"2023-10-08T16:09:25.609965+0000","last_became_active":"2023-10-08T16:04:16.656642+0000","last_became_peered":"2023-10-08T16:04:16.656642+0000","last_unstale":"2023-10-08T16:09:25.609965+0000","last_undegraded":"2023-10-08T16:09:25.609965+0000","last_fullsized":"2023-10-08T16:09:25.609965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2023-10-08T16:09:25.609667+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2023-10-08T16:09:25.609667+0000","last_clean_scrub_stamp":"2023-10-08T16:09:25.609667+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:35.043321+0000","scrub_duration":0.004097987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'647","reported_seq":714,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.629611+0000","last_change":"2023-10-08T16:08:50.765265+0000","last_active":"2023-10-08T16:09:06.629611+0000","last_peered":"2023-10-08T16:09:06.629611+0000","last_clean":"2023-10-08T16:09:06.629611+0000","last_became_active":"2023-10-08T16:04:59.029346+0000","last_became_peered":"2023-10-08T16:04:59.029346+0000","last_unstale":"2023-10-08T16:09:06.629611+0000","last_undegraded":"2023-10-08T16:09:06.629611+0000","last_fullsized":"2023-10-08T16:09:06.629611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024714613999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'1528","reported_seq":1557,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:27.726484+0000","last_change":"2023-10-08T16:09:27.726436+0000","last_active":"2023-10-08T16:09:27.726484+0000","last_peered":"2023-10-08T16:09:27.726484+0000","last_clean":"2023-10-08T16:09:27.726484+0000","last_became_active":"2023-10-08T16:04:16.651258+0000","last_became_peered":"2023-10-08T16:04:16.651258+0000","last_unstale":"2023-10-08T16:09:27.726484+0000","last_undegraded":"2023-10-08T16:09:27.726484+0000","last_fullsized":"2023-10-08T16:09:27.726484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1528","last_scrub_stamp":"2023-10-08T16:09:27.726254+0000","last_deep_scrub":"28'1528","last_deep_scrub_stamp":"2023-10-08T16:09:27.726254+0000","last_clean_scrub_stamp":"2023-10-08T16:09:27.726254+0000","objects_scrubbed":2,"log_size":1528,"log_dups_size":0,"ondisk_log_size":1528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:45.641026+0000","scrub_duration":0.043874232999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1522,"num_write_kb":8929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"28'757","reported_seq":826,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.626510+0000","last_change":"2023-10-08T16:08:50.761686+0000","last_active":"2023-10-08T16:09:06.626510+0000","last_peered":"2023-10-08T16:09:06.626510+0000","last_clean":"2023-10-08T16:09:06.626510+0000","last_became_active":"2023-10-08T16:04:17.629765+0000","last_became_peered":"2023-10-08T16:04:17.629765+0000","last_unstale":"2023-10-08T16:09:06.626510+0000","last_undegraded":"2023-10-08T16:09:06.626510+0000","last_fullsized":"2023-10-08T16:09:06.626510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026861545000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'13","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:26.641725+0000","last_change":"2023-10-08T16:09:26.641657+0000","last_active":"2023-10-08T16:09:26.641725+0000","last_peered":"2023-10-08T16:09:26.641725+0000","last_clean":"2023-10-08T16:09:26.641725+0000","last_became_active":"2023-10-08T16:04:16.654002+0000","last_became_peered":"2023-10-08T16:04:16.654002+0000","last_unstale":"2023-10-08T16:09:26.641725+0000","last_undegraded":"2023-10-08T16:09:26.641725+0000","last_fullsized":"2023-10-08T16:09:26.641725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2023-10-08T16:09:26.641400+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2023-10-08T16:09:26.641400+0000","last_clean_scrub_stamp":"2023-10-08T16:09:26.641400+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:10:45.643591+0000","scrub_duration":0.0040653290000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"28'595","reported_seq":663,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:07.157799+0000","last_change":"2023-10-08T16:08:50.724955+0000","last_active":"2023-10-08T16:09:07.157799+0000","last_peered":"2023-10-08T16:09:07.157799+0000","last_clean":"2023-10-08T16:09:07.157799+0000","last_became_active":"2023-10-08T16:04:17.624071+0000","last_became_peered":"2023-10-08T16:04:17.624071+0000","last_unstale":"2023-10-08T16:09:07.157799+0000","last_undegraded":"2023-10-08T16:09:07.157799+0000","last_fullsized":"2023-10-08T16:09:07.157799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018261580999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"26'15","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:28.703566+0000","last_change":"2023-10-08T16:09:28.703480+0000","last_active":"2023-10-08T16:09:28.703566+0000","last_peered":"2023-10-08T16:09:28.703566+0000","last_clean":"2023-10-08T16:09:28.703566+0000","last_became_active":"2023-10-08T16:04:16.656992+0000","last_became_peered":"2023-10-08T16:04:16.656992+0000","last_unstale":"2023-10-08T16:09:28.703566+0000","last_undegraded":"2023-10-08T16:09:28.703566+0000","last_fullsized":"2023-10-08T16:09:28.703566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'15","last_scrub_stamp":"2023-10-08T16:09:28.703215+0000","last_deep_scrub":"26'15","last_deep_scrub_stamp":"2023-10-08T16:09:28.703215+0000","last_clean_scrub_stamp":"2023-10-08T16:09:28.703215+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:27.242351+0000","scrub_duration":0.003527681,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"28'498","reported_seq":577,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:37.423510+0000","last_change":"2023-10-08T16:09:37.423417+0000","last_active":"2023-10-08T16:09:37.423510+0000","last_peered":"2023-10-08T16:09:37.423510+0000","last_clean":"2023-10-08T16:09:37.423510+0000","last_became_active":"2023-10-08T16:04:17.621862+0000","last_became_peered":"2023-10-08T16:04:17.621862+0000","last_unstale":"2023-10-08T16:09:37.423510+0000","last_undegraded":"2023-10-08T16:09:37.423510+0000","last_fullsized":"2023-10-08T16:09:37.423510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'498","last_scrub_stamp":"2023-10-08T16:09:37.423145+0000","last_deep_scrub":"28'498","last_deep_scrub_stamp":"2023-10-08T16:09:37.423145+0000","last_clean_scrub_stamp":"2023-10-08T16:09:37.423145+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:10:56.425335+0000","scrub_duration":0.0043366359999999996,"objects_trimmed":0,"snaptrim_duration":0.045929303999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"28'56","reported_seq":85,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:28.186088+0000","last_change":"2023-10-08T16:09:28.186016+0000","last_active":"2023-10-08T16:09:28.186088+0000","last_peered":"2023-10-08T16:09:28.186088+0000","last_clean":"2023-10-08T16:09:28.186088+0000","last_became_active":"2023-10-08T16:04:16.656041+0000","last_became_peered":"2023-10-08T16:04:16.656041+0000","last_unstale":"2023-10-08T16:09:28.186088+0000","last_undegraded":"2023-10-08T16:09:28.186088+0000","last_fullsized":"2023-10-08T16:09:28.186088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'56","last_scrub_stamp":"2023-10-08T16:09:28.185753+0000","last_deep_scrub":"28'56","last_deep_scrub_stamp":"2023-10-08T16:09:28.185753+0000","last_clean_scrub_stamp":"2023-10-08T16:09:28.185753+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:46.100526+0000","scrub_duration":0.0085979019999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'579","reported_seq":658,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:34.260199+0000","last_change":"2023-10-08T16:09:34.260069+0000","last_active":"2023-10-08T16:09:34.260199+0000","last_peered":"2023-10-08T16:09:34.260199+0000","last_clean":"2023-10-08T16:09:34.260199+0000","last_became_active":"2023-10-08T16:04:17.620654+0000","last_became_peered":"2023-10-08T16:04:17.620654+0000","last_unstale":"2023-10-08T16:09:34.260199+0000","last_undegraded":"2023-10-08T16:09:34.260199+0000","last_fullsized":"2023-10-08T16:09:34.260199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'579","last_scrub_stamp":"2023-10-08T16:09:34.259764+0000","last_deep_scrub":"28'579","last_deep_scrub_stamp":"2023-10-08T16:09:34.259764+0000","last_clean_scrub_stamp":"2023-10-08T16:09:34.259764+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:20:52.892594+0000","scrub_duration":0.0038350179999999999,"objects_trimmed":0,"snaptrim_duration":0.010626305000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"28'805","reported_seq":834,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:28.611581+0000","last_change":"2023-10-08T16:09:28.611547+0000","last_active":"2023-10-08T16:09:28.611581+0000","last_peered":"2023-10-08T16:09:28.611581+0000","last_clean":"2023-10-08T16:09:28.611581+0000","last_became_active":"2023-10-08T16:04:16.653001+0000","last_became_peered":"2023-10-08T16:04:16.653001+0000","last_unstale":"2023-10-08T16:09:28.611581+0000","last_undegraded":"2023-10-08T16:09:28.611581+0000","last_fullsized":"2023-10-08T16:09:28.611581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'805","last_scrub_stamp":"2023-10-08T16:09:28.611394+0000","last_deep_scrub":"28'805","last_deep_scrub_stamp":"2023-10-08T16:09:28.611394+0000","last_clean_scrub_stamp":"2023-10-08T16:09:28.611394+0000","objects_scrubbed":4,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:46.031039+0000","scrub_duration":0.025885490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194948,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":797,"num_write_kb":4446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"28'522","reported_seq":591,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646775+0000","last_change":"2023-10-08T16:08:50.725788+0000","last_active":"2023-10-08T16:09:06.646775+0000","last_peered":"2023-10-08T16:09:06.646775+0000","last_clean":"2023-10-08T16:09:06.646775+0000","last_became_active":"2023-10-08T16:04:17.631130+0000","last_became_peered":"2023-10-08T16:04:17.631130+0000","last_unstale":"2023-10-08T16:09:06.646775+0000","last_undegraded":"2023-10-08T16:09:06.646775+0000","last_fullsized":"2023-10-08T16:09:06.646775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013318705,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"28'1516","reported_seq":1545,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:19.369792+0000","last_change":"2023-10-08T16:09:19.369726+0000","last_active":"2023-10-08T16:09:19.369792+0000","last_peered":"2023-10-08T16:09:19.369792+0000","last_clean":"2023-10-08T16:09:19.369792+0000","last_became_active":"2023-10-08T16:04:16.660830+0000","last_became_peered":"2023-10-08T16:04:16.660830+0000","last_unstale":"2023-10-08T16:09:19.369792+0000","last_undegraded":"2023-10-08T16:09:19.369792+0000","last_fullsized":"2023-10-08T16:09:19.369792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1516","last_scrub_stamp":"2023-10-08T16:09:19.369511+0000","last_deep_scrub":"28'1516","last_deep_scrub_stamp":"2023-10-08T16:09:19.369511+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.369511+0000","objects_scrubbed":4,"log_size":1516,"log_dups_size":0,"ondisk_log_size":1516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:32:53.363596+0000","scrub_duration":0.042270937000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1505,"num_write_kb":8987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"28'654","reported_seq":733,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:25.411523+0000","last_change":"2023-10-08T16:09:25.411435+0000","last_active":"2023-10-08T16:09:25.411523+0000","last_peered":"2023-10-08T16:09:25.411523+0000","last_clean":"2023-10-08T16:09:25.411523+0000","last_became_active":"2023-10-08T16:04:17.623038+0000","last_became_peered":"2023-10-08T16:04:17.623038+0000","last_unstale":"2023-10-08T16:09:25.411523+0000","last_undegraded":"2023-10-08T16:09:25.411523+0000","last_fullsized":"2023-10-08T16:09:25.411523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'654","last_scrub_stamp":"2023-10-08T16:09:25.411173+0000","last_deep_scrub":"28'654","last_deep_scrub_stamp":"2023-10-08T16:09:25.411173+0000","last_clean_scrub_stamp":"2023-10-08T16:09:25.411173+0000","objects_scrubbed":2,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:28.717332+0000","scrub_duration":0.010251712,"objects_trimmed":0,"snaptrim_duration":0.045488809999999998,"stat_sum":{"num_bytes":4107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"26'14","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:29.695218+0000","last_change":"2023-10-08T16:09:29.695141+0000","last_active":"2023-10-08T16:09:29.695218+0000","last_peered":"2023-10-08T16:09:29.695218+0000","last_clean":"2023-10-08T16:09:29.695218+0000","last_became_active":"2023-10-08T16:04:16.649675+0000","last_became_peered":"2023-10-08T16:04:16.649675+0000","last_unstale":"2023-10-08T16:09:29.695218+0000","last_undegraded":"2023-10-08T16:09:29.695218+0000","last_fullsized":"2023-10-08T16:09:29.695218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'14","last_scrub_stamp":"2023-10-08T16:09:29.694856+0000","last_deep_scrub":"26'14","last_deep_scrub_stamp":"2023-10-08T16:09:29.694856+0000","last_clean_scrub_stamp":"2023-10-08T16:09:29.694856+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:35:23.444046+0000","scrub_duration":0.0044355009999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'966","reported_seq":1035,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646480+0000","last_change":"2023-10-08T16:08:50.725608+0000","last_active":"2023-10-08T16:09:06.646480+0000","last_peered":"2023-10-08T16:09:06.646480+0000","last_clean":"2023-10-08T16:09:06.646480+0000","last_became_active":"2023-10-08T16:04:17.628865+0000","last_became_peered":"2023-10-08T16:04:17.628865+0000","last_unstale":"2023-10-08T16:09:06.646480+0000","last_undegraded":"2023-10-08T16:09:06.646480+0000","last_fullsized":"2023-10-08T16:09:06.646480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":966,"log_dups_size":0,"ondisk_log_size":966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013199152,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"27'12","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:24.699933+0000","last_change":"2023-10-08T16:09:24.699855+0000","last_active":"2023-10-08T16:09:24.699933+0000","last_peered":"2023-10-08T16:09:24.699933+0000","last_clean":"2023-10-08T16:09:24.699933+0000","last_became_active":"2023-10-08T16:04:16.653342+0000","last_became_peered":"2023-10-08T16:04:16.653342+0000","last_unstale":"2023-10-08T16:09:24.699933+0000","last_undegraded":"2023-10-08T16:09:24.699933+0000","last_fullsized":"2023-10-08T16:09:24.699933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2023-10-08T16:09:24.699597+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2023-10-08T16:09:24.699597+0000","last_clean_scrub_stamp":"2023-10-08T16:09:24.699597+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:42.614369+0000","scrub_duration":0.003422217,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"28'290","reported_seq":369,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:29.576032+0000","last_change":"2023-10-08T16:09:29.575956+0000","last_active":"2023-10-08T16:09:29.576032+0000","last_peered":"2023-10-08T16:09:29.576032+0000","last_clean":"2023-10-08T16:09:29.576032+0000","last_became_active":"2023-10-08T16:04:17.624454+0000","last_became_peered":"2023-10-08T16:04:17.624454+0000","last_unstale":"2023-10-08T16:09:29.576032+0000","last_undegraded":"2023-10-08T16:09:29.576032+0000","last_fullsized":"2023-10-08T16:09:29.576032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'290","last_scrub_stamp":"2023-10-08T16:09:29.575702+0000","last_deep_scrub":"28'290","last_deep_scrub_stamp":"2023-10-08T16:09:29.575702+0000","last_clean_scrub_stamp":"2023-10-08T16:09:29.575702+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:58.715495+0000","scrub_duration":0.0044317380000000002,"objects_trimmed":0,"snaptrim_duration":0.012620849,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"28'26","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:25.562641+0000","last_change":"2023-10-08T16:09:25.562521+0000","last_active":"2023-10-08T16:09:25.562641+0000","last_peered":"2023-10-08T16:09:25.562641+0000","last_clean":"2023-10-08T16:09:25.562641+0000","last_became_active":"2023-10-08T16:04:16.658886+0000","last_became_peered":"2023-10-08T16:04:16.658886+0000","last_unstale":"2023-10-08T16:09:25.562641+0000","last_undegraded":"2023-10-08T16:09:25.562641+0000","last_fullsized":"2023-10-08T16:09:25.562641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'26","last_scrub_stamp":"2023-10-08T16:09:25.562132+0000","last_deep_scrub":"28'26","last_deep_scrub_stamp":"2023-10-08T16:09:25.562132+0000","last_clean_scrub_stamp":"2023-10-08T16:09:25.562132+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:37:32.665776+0000","scrub_duration":0.011851375000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"28'592","reported_seq":661,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.645533+0000","last_change":"2023-10-08T16:08:50.724877+0000","last_active":"2023-10-08T16:09:06.645533+0000","last_peered":"2023-10-08T16:09:06.645533+0000","last_clean":"2023-10-08T16:09:06.645533+0000","last_became_active":"2023-10-08T16:04:17.628605+0000","last_became_peered":"2023-10-08T16:04:17.628605+0000","last_unstale":"2023-10-08T16:09:06.645533+0000","last_undegraded":"2023-10-08T16:09:06.645533+0000","last_fullsized":"2023-10-08T16:09:06.645533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013094041000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'19","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:29.245466+0000","last_change":"2023-10-08T16:09:29.245405+0000","last_active":"2023-10-08T16:09:29.245466+0000","last_peered":"2023-10-08T16:09:29.245466+0000","last_clean":"2023-10-08T16:09:29.245466+0000","last_became_active":"2023-10-08T16:04:16.660651+0000","last_became_peered":"2023-10-08T16:04:16.660651+0000","last_unstale":"2023-10-08T16:09:29.245466+0000","last_undegraded":"2023-10-08T16:09:29.245466+0000","last_fullsized":"2023-10-08T16:09:29.245466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'19","last_scrub_stamp":"2023-10-08T16:09:29.245108+0000","last_deep_scrub":"28'19","last_deep_scrub_stamp":"2023-10-08T16:09:29.245108+0000","last_clean_scrub_stamp":"2023-10-08T16:09:29.245108+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:33:03.239192+0000","scrub_duration":0.0073818440000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"28'296","reported_seq":365,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.645199+0000","last_change":"2023-10-08T16:08:50.725143+0000","last_active":"2023-10-08T16:09:06.645199+0000","last_peered":"2023-10-08T16:09:06.645199+0000","last_clean":"2023-10-08T16:09:06.645199+0000","last_became_active":"2023-10-08T16:04:17.628701+0000","last_became_peered":"2023-10-08T16:04:17.628701+0000","last_unstale":"2023-10-08T16:09:06.645199+0000","last_undegraded":"2023-10-08T16:09:06.645199+0000","last_fullsized":"2023-10-08T16:09:06.645199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012739413999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'278","reported_seq":307,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:24.541205+0000","last_change":"2023-10-08T16:09:24.541140+0000","last_active":"2023-10-08T16:09:24.541205+0000","last_peered":"2023-10-08T16:09:24.541205+0000","last_clean":"2023-10-08T16:09:24.541205+0000","last_became_active":"2023-10-08T16:04:16.651709+0000","last_became_peered":"2023-10-08T16:04:16.651709+0000","last_unstale":"2023-10-08T16:09:24.541205+0000","last_undegraded":"2023-10-08T16:09:24.541205+0000","last_fullsized":"2023-10-08T16:09:24.541205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'278","last_scrub_stamp":"2023-10-08T16:09:24.540994+0000","last_deep_scrub":"28'278","last_deep_scrub_stamp":"2023-10-08T16:09:24.540994+0000","last_clean_scrub_stamp":"2023-10-08T16:09:24.540994+0000","objects_scrubbed":2,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:20:43.173823+0000","scrub_duration":0.020437908000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"28'660","reported_seq":728,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646592+0000","last_change":"2023-10-08T16:08:50.727298+0000","last_active":"2023-10-08T16:09:06.646592+0000","last_peered":"2023-10-08T16:09:06.646592+0000","last_clean":"2023-10-08T16:09:06.646592+0000","last_became_active":"2023-10-08T16:04:17.630908+0000","last_became_peered":"2023-10-08T16:04:17.630908+0000","last_unstale":"2023-10-08T16:09:06.646592+0000","last_undegraded":"2023-10-08T16:09:06.646592+0000","last_fullsized":"2023-10-08T16:09:06.646592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014318363000000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"28'766","reported_seq":795,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:21.169223+0000","last_change":"2023-10-08T16:09:21.169188+0000","last_active":"2023-10-08T16:09:21.169223+0000","last_peered":"2023-10-08T16:09:21.169223+0000","last_clean":"2023-10-08T16:09:21.169223+0000","last_became_active":"2023-10-08T16:04:16.655245+0000","last_became_peered":"2023-10-08T16:04:16.655245+0000","last_unstale":"2023-10-08T16:09:21.169223+0000","last_undegraded":"2023-10-08T16:09:21.169223+0000","last_fullsized":"2023-10-08T16:09:21.169223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'766","last_scrub_stamp":"2023-10-08T16:09:21.169034+0000","last_deep_scrub":"28'766","last_deep_scrub_stamp":"2023-10-08T16:09:21.169034+0000","last_clean_scrub_stamp":"2023-10-08T16:09:21.169034+0000","objects_scrubbed":2,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:37:28.272678+0000","scrub_duration":0.023529600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":759,"num_write_kb":4511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"28'465","reported_seq":544,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:32.759016+0000","last_change":"2023-10-08T16:09:32.758894+0000","last_active":"2023-10-08T16:09:32.759016+0000","last_peered":"2023-10-08T16:09:32.759016+0000","last_clean":"2023-10-08T16:09:32.759016+0000","last_became_active":"2023-10-08T16:04:17.627369+0000","last_became_peered":"2023-10-08T16:04:17.627369+0000","last_unstale":"2023-10-08T16:09:32.759016+0000","last_undegraded":"2023-10-08T16:09:32.759016+0000","last_fullsized":"2023-10-08T16:09:32.759016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'465","last_scrub_stamp":"2023-10-08T16:09:32.758612+0000","last_deep_scrub":"28'465","last_deep_scrub_stamp":"2023-10-08T16:09:32.758612+0000","last_clean_scrub_stamp":"2023-10-08T16:09:32.758612+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:50:17.550433+0000","scrub_duration":0.0040334330000000003,"objects_trimmed":0,"snaptrim_duration":0.020078136999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"28'12","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:23.499905+0000","last_change":"2023-10-08T16:09:23.499833+0000","last_active":"2023-10-08T16:09:23.499905+0000","last_peered":"2023-10-08T16:09:23.499905+0000","last_clean":"2023-10-08T16:09:23.499905+0000","last_became_active":"2023-10-08T16:04:16.654124+0000","last_became_peered":"2023-10-08T16:04:16.654124+0000","last_unstale":"2023-10-08T16:09:23.499905+0000","last_undegraded":"2023-10-08T16:09:23.499905+0000","last_fullsized":"2023-10-08T16:09:23.499905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2023-10-08T16:09:23.499570+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2023-10-08T16:09:23.499570+0000","last_clean_scrub_stamp":"2023-10-08T16:09:23.499570+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:49.602798+0000","scrub_duration":0.0041480989999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'569","reported_seq":646,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:33.468529+0000","last_change":"2023-10-08T16:09:33.468457+0000","last_active":"2023-10-08T16:09:33.468529+0000","last_peered":"2023-10-08T16:09:33.468529+0000","last_clean":"2023-10-08T16:09:33.468529+0000","last_became_active":"2023-10-08T16:04:58.693477+0000","last_became_peered":"2023-10-08T16:04:58.693477+0000","last_unstale":"2023-10-08T16:09:33.468529+0000","last_undegraded":"2023-10-08T16:09:33.468529+0000","last_fullsized":"2023-10-08T16:09:33.468529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'569","last_scrub_stamp":"2023-10-08T16:09:33.468193+0000","last_deep_scrub":"28'569","last_deep_scrub_stamp":"2023-10-08T16:09:33.468193+0000","last_clean_scrub_stamp":"2023-10-08T16:09:33.468193+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:32.007329+0000","scrub_duration":0.0039894070000000004,"objects_trimmed":0,"snaptrim_duration":0.0094988650000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":184,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:22.835688+0000","last_change":"2023-10-08T16:09:22.835644+0000","last_active":"2023-10-08T16:09:22.835688+0000","last_peered":"2023-10-08T16:09:22.835688+0000","last_clean":"2023-10-08T16:09:22.835688+0000","last_became_active":"2023-10-08T16:04:06.368022+0000","last_became_peered":"2023-10-08T16:04:06.368022+0000","last_unstale":"2023-10-08T16:09:22.835688+0000","last_undegraded":"2023-10-08T16:09:22.835688+0000","last_fullsized":"2023-10-08T16:09:22.835688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2023-10-08T16:09:22.835476+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2023-10-08T16:09:22.835476+0000","last_clean_scrub_stamp":"2023-10-08T16:09:22.835476+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:21.374611+0000","scrub_duration":0.013473255999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"28'13","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:22.681945+0000","last_change":"2023-10-08T16:09:22.681883+0000","last_active":"2023-10-08T16:09:22.681945+0000","last_peered":"2023-10-08T16:09:22.681945+0000","last_clean":"2023-10-08T16:09:22.681945+0000","last_became_active":"2023-10-08T16:04:16.646086+0000","last_became_peered":"2023-10-08T16:04:16.646086+0000","last_unstale":"2023-10-08T16:09:22.681945+0000","last_undegraded":"2023-10-08T16:09:22.681945+0000","last_fullsized":"2023-10-08T16:09:22.681945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2023-10-08T16:09:22.681612+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2023-10-08T16:09:22.681612+0000","last_clean_scrub_stamp":"2023-10-08T16:09:22.681612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:32.115267+0000","scrub_duration":0.0043686569999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'510","reported_seq":589,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:35.338576+0000","last_change":"2023-10-08T16:09:35.338451+0000","last_active":"2023-10-08T16:09:35.338576+0000","last_peered":"2023-10-08T16:09:35.338576+0000","last_clean":"2023-10-08T16:09:35.338576+0000","last_became_active":"2023-10-08T16:04:17.629127+0000","last_became_peered":"2023-10-08T16:04:17.629127+0000","last_unstale":"2023-10-08T16:09:35.338576+0000","last_undegraded":"2023-10-08T16:09:35.338576+0000","last_fullsized":"2023-10-08T16:09:35.338576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'510","last_scrub_stamp":"2023-10-08T16:09:35.338140+0000","last_deep_scrub":"28'510","last_deep_scrub_stamp":"2023-10-08T16:09:35.338140+0000","last_clean_scrub_stamp":"2023-10-08T16:09:35.338140+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:50:20.129961+0000","scrub_duration":0.0040502020000000001,"objects_trimmed":0,"snaptrim_duration":0.011169416999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"28'1506","reported_seq":1535,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:25.858697+0000","last_change":"2023-10-08T16:09:25.858543+0000","last_active":"2023-10-08T16:09:25.858697+0000","last_peered":"2023-10-08T16:09:25.858697+0000","last_clean":"2023-10-08T16:09:25.858697+0000","last_became_active":"2023-10-08T16:04:16.661186+0000","last_became_peered":"2023-10-08T16:04:16.661186+0000","last_unstale":"2023-10-08T16:09:25.858697+0000","last_undegraded":"2023-10-08T16:09:25.858697+0000","last_fullsized":"2023-10-08T16:09:25.858697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1506","last_scrub_stamp":"2023-10-08T16:09:25.858210+0000","last_deep_scrub":"28'1506","last_deep_scrub_stamp":"2023-10-08T16:09:25.858210+0000","last_clean_scrub_stamp":"2023-10-08T16:09:25.858210+0000","objects_scrubbed":2,"log_size":1506,"log_dups_size":0,"ondisk_log_size":1506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:43.277855+0000","scrub_duration":0.039533828999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1499,"num_write_kb":8970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"28'493","reported_seq":572,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:34.511897+0000","last_change":"2023-10-08T16:09:34.511828+0000","last_active":"2023-10-08T16:09:34.511897+0000","last_peered":"2023-10-08T16:09:34.511897+0000","last_clean":"2023-10-08T16:09:34.511897+0000","last_became_active":"2023-10-08T16:04:17.615671+0000","last_became_peered":"2023-10-08T16:04:17.615671+0000","last_unstale":"2023-10-08T16:09:34.511897+0000","last_undegraded":"2023-10-08T16:09:34.511897+0000","last_fullsized":"2023-10-08T16:09:34.511897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'493","last_scrub_stamp":"2023-10-08T16:09:34.511546+0000","last_deep_scrub":"28'493","last_deep_scrub_stamp":"2023-10-08T16:09:34.511546+0000","last_clean_scrub_stamp":"2023-10-08T16:09:34.511546+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:56:04.532329+0000","scrub_duration":0.0042317580000000004,"objects_trimmed":0,"snaptrim_duration":0.043805617999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"28'75","reported_seq":166,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.438844+0000","last_change":"2023-10-08T16:09:20.438777+0000","last_active":"2023-10-08T16:09:20.438844+0000","last_peered":"2023-10-08T16:09:20.438844+0000","last_clean":"2023-10-08T16:09:20.438844+0000","last_became_active":"2023-10-08T16:04:16.654359+0000","last_became_peered":"2023-10-08T16:04:16.654359+0000","last_unstale":"2023-10-08T16:09:20.438844+0000","last_undegraded":"2023-10-08T16:09:20.438844+0000","last_fullsized":"2023-10-08T16:09:20.438844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-10-08T16:09:20.438516+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-10-08T16:09:20.438516+0000","last_clean_scrub_stamp":"2023-10-08T16:09:20.438516+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:18.855971+0000","scrub_duration":0.0049952249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":279988,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":321,"num_write":71,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'389","reported_seq":467,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:33.195937+0000","last_change":"2023-10-08T16:09:33.195879+0000","last_active":"2023-10-08T16:09:33.195937+0000","last_peered":"2023-10-08T16:09:33.195937+0000","last_clean":"2023-10-08T16:09:33.195937+0000","last_became_active":"2023-10-08T16:04:17.624876+0000","last_became_peered":"2023-10-08T16:04:17.624876+0000","last_unstale":"2023-10-08T16:09:33.195937+0000","last_undegraded":"2023-10-08T16:09:33.195937+0000","last_fullsized":"2023-10-08T16:09:33.195937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'389","last_scrub_stamp":"2023-10-08T16:09:33.195676+0000","last_deep_scrub":"28'389","last_deep_scrub_stamp":"2023-10-08T16:09:33.195676+0000","last_clean_scrub_stamp":"2023-10-08T16:09:33.195676+0000","objects_scrubbed":3,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:13:02.335470+0000","scrub_duration":0.010915272,"objects_trimmed":0,"snaptrim_duration":0.024289327999999999,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"28'1401","reported_seq":1430,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:26.761613+0000","last_change":"2023-10-08T16:09:26.761563+0000","last_active":"2023-10-08T16:09:26.761613+0000","last_peered":"2023-10-08T16:09:26.761613+0000","last_clean":"2023-10-08T16:09:26.761613+0000","last_became_active":"2023-10-08T16:04:16.654454+0000","last_became_peered":"2023-10-08T16:04:16.654454+0000","last_unstale":"2023-10-08T16:09:26.761613+0000","last_undegraded":"2023-10-08T16:09:26.761613+0000","last_fullsized":"2023-10-08T16:09:26.761613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1401","last_scrub_stamp":"2023-10-08T16:09:26.761369+0000","last_deep_scrub":"28'1401","last_deep_scrub_stamp":"2023-10-08T16:09:26.761369+0000","last_clean_scrub_stamp":"2023-10-08T16:09:26.761369+0000","objects_scrubbed":2,"log_size":1401,"log_dups_size":0,"ondisk_log_size":1401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:31.493587+0000","scrub_duration":0.039489099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1390,"num_write_kb":8905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"28'618","reported_seq":697,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:35.224258+0000","last_change":"2023-10-08T16:09:35.224192+0000","last_active":"2023-10-08T16:09:35.224258+0000","last_peered":"2023-10-08T16:09:35.224258+0000","last_clean":"2023-10-08T16:09:35.224258+0000","last_became_active":"2023-10-08T16:04:17.619294+0000","last_became_peered":"2023-10-08T16:04:17.619294+0000","last_unstale":"2023-10-08T16:09:35.224258+0000","last_undegraded":"2023-10-08T16:09:35.224258+0000","last_fullsized":"2023-10-08T16:09:35.224258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'618","last_scrub_stamp":"2023-10-08T16:09:35.223925+0000","last_deep_scrub":"28'618","last_deep_scrub_stamp":"2023-10-08T16:09:35.223925+0000","last_clean_scrub_stamp":"2023-10-08T16:09:35.223925+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:37:42.327569+0000","scrub_duration":0.0042708449999999997,"objects_trimmed":0,"snaptrim_duration":0.011233748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"27'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:24.162687+0000","last_change":"2023-10-08T16:09:24.162557+0000","last_active":"2023-10-08T16:09:24.162687+0000","last_peered":"2023-10-08T16:09:24.162687+0000","last_clean":"2023-10-08T16:09:24.162687+0000","last_became_active":"2023-10-08T16:04:16.661756+0000","last_became_peered":"2023-10-08T16:04:16.661756+0000","last_unstale":"2023-10-08T16:09:24.162687+0000","last_undegraded":"2023-10-08T16:09:24.162687+0000","last_fullsized":"2023-10-08T16:09:24.162687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-10-08T16:09:24.162263+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-10-08T16:09:24.162263+0000","last_clean_scrub_stamp":"2023-10-08T16:09:24.162263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:33.595918+0000","scrub_duration":0.0046575389999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"28'515","reported_seq":594,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:31.715455+0000","last_change":"2023-10-08T16:09:31.715390+0000","last_active":"2023-10-08T16:09:31.715455+0000","last_peered":"2023-10-08T16:09:31.715455+0000","last_clean":"2023-10-08T16:09:31.715455+0000","last_became_active":"2023-10-08T16:04:17.616348+0000","last_became_peered":"2023-10-08T16:04:17.616348+0000","last_unstale":"2023-10-08T16:09:31.715455+0000","last_undegraded":"2023-10-08T16:09:31.715455+0000","last_fullsized":"2023-10-08T16:09:31.715455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'515","last_scrub_stamp":"2023-10-08T16:09:31.715159+0000","last_deep_scrub":"28'515","last_deep_scrub_stamp":"2023-10-08T16:09:31.715159+0000","last_clean_scrub_stamp":"2023-10-08T16:09:31.715159+0000","objects_scrubbed":2,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:49.134804+0000","scrub_duration":0.0093125989999999995,"objects_trimmed":0,"snaptrim_duration":0.016977602000000001,"stat_sum":{"num_bytes":4107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"26'21","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:26.813271+0000","last_change":"2023-10-08T16:09:26.813177+0000","last_active":"2023-10-08T16:09:26.813271+0000","last_peered":"2023-10-08T16:09:26.813271+0000","last_clean":"2023-10-08T16:09:26.813271+0000","last_became_active":"2023-10-08T16:04:16.662446+0000","last_became_peered":"2023-10-08T16:04:16.662446+0000","last_unstale":"2023-10-08T16:09:26.813271+0000","last_undegraded":"2023-10-08T16:09:26.813271+0000","last_fullsized":"2023-10-08T16:09:26.813271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'21","last_scrub_stamp":"2023-10-08T16:09:26.812910+0000","last_deep_scrub":"26'21","last_deep_scrub_stamp":"2023-10-08T16:09:26.812910+0000","last_clean_scrub_stamp":"2023-10-08T16:09:26.812910+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:55.952703+0000","scrub_duration":0.0040640759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'606","reported_seq":685,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:29.158906+0000","last_change":"2023-10-08T16:09:29.158842+0000","last_active":"2023-10-08T16:09:29.158906+0000","last_peered":"2023-10-08T16:09:29.158906+0000","last_clean":"2023-10-08T16:09:29.158906+0000","last_became_active":"2023-10-08T16:04:17.624319+0000","last_became_peered":"2023-10-08T16:04:17.624319+0000","last_unstale":"2023-10-08T16:09:29.158906+0000","last_undegraded":"2023-10-08T16:09:29.158906+0000","last_fullsized":"2023-10-08T16:09:29.158906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'606","last_scrub_stamp":"2023-10-08T16:09:29.158591+0000","last_deep_scrub":"28'606","last_deep_scrub_stamp":"2023-10-08T16:09:29.158591+0000","last_clean_scrub_stamp":"2023-10-08T16:09:29.158591+0000","objects_scrubbed":2,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:27.697727+0000","scrub_duration":0.0096838069999999991,"objects_trimmed":0,"snaptrim_duration":0.024480915999999998,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"28'47","reported_seq":76,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:19.116634+0000","last_change":"2023-10-08T16:09:19.116588+0000","last_active":"2023-10-08T16:09:19.116634+0000","last_peered":"2023-10-08T16:09:19.116634+0000","last_clean":"2023-10-08T16:09:19.116634+0000","last_became_active":"2023-10-08T16:04:16.660704+0000","last_became_peered":"2023-10-08T16:04:16.660704+0000","last_unstale":"2023-10-08T16:09:19.116634+0000","last_undegraded":"2023-10-08T16:09:19.116634+0000","last_fullsized":"2023-10-08T16:09:19.116634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'47","last_scrub_stamp":"2023-10-08T16:09:19.116491+0000","last_deep_scrub":"28'47","last_deep_scrub_stamp":"2023-10-08T16:09:19.116491+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.116491+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:45.219718+0000","scrub_duration":0.003732735,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"28'626","reported_seq":705,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:31.471750+0000","last_change":"2023-10-08T16:09:31.471628+0000","last_active":"2023-10-08T16:09:31.471750+0000","last_peered":"2023-10-08T16:09:31.471750+0000","last_clean":"2023-10-08T16:09:31.471750+0000","last_became_active":"2023-10-08T16:04:17.631615+0000","last_became_peered":"2023-10-08T16:04:17.631615+0000","last_unstale":"2023-10-08T16:09:31.471750+0000","last_undegraded":"2023-10-08T16:09:31.471750+0000","last_fullsized":"2023-10-08T16:09:31.471750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'626","last_scrub_stamp":"2023-10-08T16:09:31.471310+0000","last_deep_scrub":"28'626","last_deep_scrub_stamp":"2023-10-08T16:09:31.471310+0000","last_clean_scrub_stamp":"2023-10-08T16:09:31.471310+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:30.010445+0000","scrub_duration":0.0043343189999999997,"objects_trimmed":0,"snaptrim_duration":0.011336120999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"28'13","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:25.681310+0000","last_change":"2023-10-08T16:09:25.681241+0000","last_active":"2023-10-08T16:09:25.681310+0000","last_peered":"2023-10-08T16:09:25.681310+0000","last_clean":"2023-10-08T16:09:25.681310+0000","last_became_active":"2023-10-08T16:04:16.659148+0000","last_became_peered":"2023-10-08T16:04:16.659148+0000","last_unstale":"2023-10-08T16:09:25.681310+0000","last_undegraded":"2023-10-08T16:09:25.681310+0000","last_fullsized":"2023-10-08T16:09:25.681310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2023-10-08T16:09:25.680987+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2023-10-08T16:09:25.680987+0000","last_clean_scrub_stamp":"2023-10-08T16:09:25.680987+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:24.220123+0000","scrub_duration":0.0066810940000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'436","reported_seq":506,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.632038+0000","last_change":"2023-10-08T16:08:50.780938+0000","last_active":"2023-10-08T16:09:06.632038+0000","last_peered":"2023-10-08T16:09:06.632038+0000","last_clean":"2023-10-08T16:09:06.632038+0000","last_became_active":"2023-10-08T16:04:17.624385+0000","last_became_peered":"2023-10-08T16:04:17.624385+0000","last_unstale":"2023-10-08T16:09:06.632038+0000","last_undegraded":"2023-10-08T16:09:06.632038+0000","last_fullsized":"2023-10-08T16:09:06.632038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.044071592,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"26'758","reported_seq":777,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:08:57.769809+0000","last_change":"2023-10-08T16:04:16.662618+0000","last_active":"2023-10-08T16:08:57.769809+0000","last_peered":"2023-10-08T16:08:57.769809+0000","last_clean":"2023-10-08T16:08:57.769809+0000","last_became_active":"2023-10-08T16:04:16.662327+0000","last_became_peered":"2023-10-08T16:04:16.662327+0000","last_unstale":"2023-10-08T16:08:57.769809+0000","last_undegraded":"2023-10-08T16:08:57.769809+0000","last_fullsized":"2023-10-08T16:08:57.769809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:15.610555+0000","last_clean_scrub_stamp":"2023-10-08T16:04:15.610555+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":753,"num_write_kb":4504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'450","reported_seq":519,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.644002+0000","last_change":"2023-10-08T16:08:50.749200+0000","last_active":"2023-10-08T16:09:06.644002+0000","last_peered":"2023-10-08T16:09:06.644002+0000","last_clean":"2023-10-08T16:09:06.644002+0000","last_became_active":"2023-10-08T16:04:17.622898+0000","last_became_peered":"2023-10-08T16:04:17.622898+0000","last_unstale":"2023-10-08T16:09:06.644002+0000","last_undegraded":"2023-10-08T16:09:06.644002+0000","last_fullsized":"2023-10-08T16:09:06.644002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075401410000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'10","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.131846+0000","last_change":"2023-10-08T16:09:20.131788+0000","last_active":"2023-10-08T16:09:20.131846+0000","last_peered":"2023-10-08T16:09:20.131846+0000","last_clean":"2023-10-08T16:09:20.131846+0000","last_became_active":"2023-10-08T16:04:16.661055+0000","last_became_peered":"2023-10-08T16:04:16.661055+0000","last_unstale":"2023-10-08T16:09:20.131846+0000","last_undegraded":"2023-10-08T16:09:20.131846+0000","last_fullsized":"2023-10-08T16:09:20.131846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2023-10-08T16:09:20.131603+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2023-10-08T16:09:20.131603+0000","last_clean_scrub_stamp":"2023-10-08T16:09:20.131603+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:20:38.764433+0000","scrub_duration":0.0035988970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"28'502","reported_seq":581,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:34.370256+0000","last_change":"2023-10-08T16:09:34.370190+0000","last_active":"2023-10-08T16:09:34.370256+0000","last_peered":"2023-10-08T16:09:34.370256+0000","last_clean":"2023-10-08T16:09:34.370256+0000","last_became_active":"2023-10-08T16:04:17.626991+0000","last_became_peered":"2023-10-08T16:04:17.626991+0000","last_unstale":"2023-10-08T16:09:34.370256+0000","last_undegraded":"2023-10-08T16:09:34.370256+0000","last_fullsized":"2023-10-08T16:09:34.370256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'502","last_scrub_stamp":"2023-10-08T16:09:34.369933+0000","last_deep_scrub":"28'502","last_deep_scrub_stamp":"2023-10-08T16:09:34.369933+0000","last_clean_scrub_stamp":"2023-10-08T16:09:34.369933+0000","objects_scrubbed":1,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:51.789578+0000","scrub_duration":0.0074754299999999999,"objects_trimmed":0,"snaptrim_duration":0.010148346000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'11","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:27.146089+0000","last_change":"2023-10-08T16:09:27.146023+0000","last_active":"2023-10-08T16:09:27.146089+0000","last_peered":"2023-10-08T16:09:27.146089+0000","last_clean":"2023-10-08T16:09:27.146089+0000","last_became_active":"2023-10-08T16:04:16.657299+0000","last_became_peered":"2023-10-08T16:04:16.657299+0000","last_unstale":"2023-10-08T16:09:27.146089+0000","last_undegraded":"2023-10-08T16:09:27.146089+0000","last_fullsized":"2023-10-08T16:09:27.146089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2023-10-08T16:09:27.145765+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2023-10-08T16:09:27.145765+0000","last_clean_scrub_stamp":"2023-10-08T16:09:27.145765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:57.166548+0000","scrub_duration":0.0039273509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"28'602","reported_seq":679,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:32.438112+0000","last_change":"2023-10-08T16:09:32.438015+0000","last_active":"2023-10-08T16:09:32.438112+0000","last_peered":"2023-10-08T16:09:32.438112+0000","last_clean":"2023-10-08T16:09:32.438112+0000","last_became_active":"2023-10-08T16:04:17.620693+0000","last_became_peered":"2023-10-08T16:04:17.620693+0000","last_unstale":"2023-10-08T16:09:32.438112+0000","last_undegraded":"2023-10-08T16:09:32.438112+0000","last_fullsized":"2023-10-08T16:09:32.438112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'602","last_scrub_stamp":"2023-10-08T16:09:32.437705+0000","last_deep_scrub":"28'602","last_deep_scrub_stamp":"2023-10-08T16:09:32.437705+0000","last_clean_scrub_stamp":"2023-10-08T16:09:32.437705+0000","objects_scrubbed":5,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:35:26.186896+0000","scrub_duration":0.016386810000000002,"objects_trimmed":0,"snaptrim_duration":0.011078684,"stat_sum":{"num_bytes":4121,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'99","reported_seq":128,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:23.883532+0000","last_change":"2023-10-08T16:09:23.883485+0000","last_active":"2023-10-08T16:09:23.883532+0000","last_peered":"2023-10-08T16:09:23.883532+0000","last_clean":"2023-10-08T16:09:23.883532+0000","last_became_active":"2023-10-08T16:04:16.663184+0000","last_became_peered":"2023-10-08T16:04:16.663184+0000","last_unstale":"2023-10-08T16:09:23.883532+0000","last_undegraded":"2023-10-08T16:09:23.883532+0000","last_fullsized":"2023-10-08T16:09:23.883532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'99","last_scrub_stamp":"2023-10-08T16:09:23.883297+0000","last_deep_scrub":"28'99","last_deep_scrub_stamp":"2023-10-08T16:09:23.883297+0000","last_clean_scrub_stamp":"2023-10-08T16:09:23.883297+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:10:42.885487+0000","scrub_duration":0.019422511,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":4152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"28'778","reported_seq":847,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.637363+0000","last_change":"2023-10-08T16:08:50.716768+0000","last_active":"2023-10-08T16:09:06.637363+0000","last_peered":"2023-10-08T16:09:06.637363+0000","last_clean":"2023-10-08T16:09:06.637363+0000","last_became_active":"2023-10-08T16:04:17.622898+0000","last_became_peered":"2023-10-08T16:04:17.622898+0000","last_unstale":"2023-10-08T16:09:06.637363+0000","last_undegraded":"2023-10-08T16:09:06.637363+0000","last_fullsized":"2023-10-08T16:09:06.637363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012379262,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"28'812","reported_seq":880,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.648807+0000","last_change":"2023-10-08T16:08:50.726432+0000","last_active":"2023-10-08T16:09:06.648807+0000","last_peered":"2023-10-08T16:09:06.648807+0000","last_clean":"2023-10-08T16:09:06.648807+0000","last_became_active":"2023-10-08T16:04:17.617179+0000","last_became_peered":"2023-10-08T16:04:17.617179+0000","last_unstale":"2023-10-08T16:09:06.648807+0000","last_undegraded":"2023-10-08T16:09:06.648807+0000","last_fullsized":"2023-10-08T16:09:06.648807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016893819000000001,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"28'2505","reported_seq":2534,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:27.835009+0000","last_change":"2023-10-08T16:09:27.834959+0000","last_active":"2023-10-08T16:09:27.835009+0000","last_peered":"2023-10-08T16:09:27.835009+0000","last_clean":"2023-10-08T16:09:27.835009+0000","last_became_active":"2023-10-08T16:04:16.661215+0000","last_became_peered":"2023-10-08T16:04:16.661215+0000","last_unstale":"2023-10-08T16:09:27.835009+0000","last_undegraded":"2023-10-08T16:09:27.835009+0000","last_fullsized":"2023-10-08T16:09:27.835009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2505","last_scrub_stamp":"2023-10-08T16:09:27.834807+0000","last_deep_scrub":"28'2505","last_deep_scrub_stamp":"2023-10-08T16:09:27.834807+0000","last_clean_scrub_stamp":"2023-10-08T16:09:27.834807+0000","objects_scrubbed":2,"log_size":2505,"log_dups_size":0,"ondisk_log_size":2505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:38.729836+0000","scrub_duration":0.024538131000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2502,"num_write_kb":5839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'612","reported_seq":680,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.647580+0000","last_change":"2023-10-08T16:08:50.727342+0000","last_active":"2023-10-08T16:09:06.647580+0000","last_peered":"2023-10-08T16:09:06.647580+0000","last_clean":"2023-10-08T16:09:06.647580+0000","last_became_active":"2023-10-08T16:04:17.617216+0000","last_became_peered":"2023-10-08T16:04:17.617216+0000","last_unstale":"2023-10-08T16:09:06.647580+0000","last_undegraded":"2023-10-08T16:09:06.647580+0000","last_fullsized":"2023-10-08T16:09:06.647580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020241687000000001,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1666","reported_seq":1695,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:38.888154+0000","last_change":"2023-10-08T16:09:38.888088+0000","last_active":"2023-10-08T16:09:38.888154+0000","last_peered":"2023-10-08T16:09:38.888154+0000","last_clean":"2023-10-08T16:09:38.888154+0000","last_became_active":"2023-10-08T16:04:16.661224+0000","last_became_peered":"2023-10-08T16:04:16.661224+0000","last_unstale":"2023-10-08T16:09:38.888154+0000","last_undegraded":"2023-10-08T16:09:38.888154+0000","last_fullsized":"2023-10-08T16:09:38.888154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1666","last_scrub_stamp":"2023-10-08T16:09:38.887848+0000","last_deep_scrub":"28'1666","last_deep_scrub_stamp":"2023-10-08T16:09:38.887848+0000","last_clean_scrub_stamp":"2023-10-08T16:09:38.887848+0000","objects_scrubbed":4,"log_size":1666,"log_dups_size":0,"ondisk_log_size":1666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:00.791153+0000","scrub_duration":0.041569068000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9349042,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1651,"num_write_kb":9976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"28'531","reported_seq":600,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.648690+0000","last_change":"2023-10-08T16:08:50.784243+0000","last_active":"2023-10-08T16:09:06.648690+0000","last_peered":"2023-10-08T16:09:06.648690+0000","last_clean":"2023-10-08T16:09:06.648690+0000","last_became_active":"2023-10-08T16:04:17.621550+0000","last_became_peered":"2023-10-08T16:04:17.621550+0000","last_unstale":"2023-10-08T16:09:06.648690+0000","last_undegraded":"2023-10-08T16:09:06.648690+0000","last_fullsized":"2023-10-08T16:09:06.648690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.046468506999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"28'765","reported_seq":794,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:29.514816+0000","last_change":"2023-10-08T16:09:29.514743+0000","last_active":"2023-10-08T16:09:29.514816+0000","last_peered":"2023-10-08T16:09:29.514816+0000","last_clean":"2023-10-08T16:09:29.514816+0000","last_became_active":"2023-10-08T16:04:16.661907+0000","last_became_peered":"2023-10-08T16:04:16.661907+0000","last_unstale":"2023-10-08T16:09:29.514816+0000","last_undegraded":"2023-10-08T16:09:29.514816+0000","last_fullsized":"2023-10-08T16:09:29.514816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'765","last_scrub_stamp":"2023-10-08T16:09:29.514581+0000","last_deep_scrub":"28'765","last_deep_scrub_stamp":"2023-10-08T16:09:29.514581+0000","last_clean_scrub_stamp":"2023-10-08T16:09:29.514581+0000","objects_scrubbed":1,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:59.535364+0000","scrub_duration":0.024557628000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":4591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"28'526","reported_seq":605,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:30.490508+0000","last_change":"2023-10-08T16:09:30.490432+0000","last_active":"2023-10-08T16:09:30.490508+0000","last_peered":"2023-10-08T16:09:30.490508+0000","last_clean":"2023-10-08T16:09:30.490508+0000","last_became_active":"2023-10-08T16:04:17.627562+0000","last_became_peered":"2023-10-08T16:04:17.627562+0000","last_unstale":"2023-10-08T16:09:30.490508+0000","last_undegraded":"2023-10-08T16:09:30.490508+0000","last_fullsized":"2023-10-08T16:09:30.490508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'526","last_scrub_stamp":"2023-10-08T16:09:30.490173+0000","last_deep_scrub":"28'526","last_deep_scrub_stamp":"2023-10-08T16:09:30.490173+0000","last_clean_scrub_stamp":"2023-10-08T16:09:30.490173+0000","objects_scrubbed":2,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:48.404946+0000","scrub_duration":0.0091133989999999995,"objects_trimmed":0,"snaptrim_duration":0.011393438000000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"28'2624","reported_seq":2653,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:23.416533+0000","last_change":"2023-10-08T16:09:23.416452+0000","last_active":"2023-10-08T16:09:23.416533+0000","last_peered":"2023-10-08T16:09:23.416533+0000","last_clean":"2023-10-08T16:09:23.416533+0000","last_became_active":"2023-10-08T16:04:16.662714+0000","last_became_peered":"2023-10-08T16:04:16.662714+0000","last_unstale":"2023-10-08T16:09:23.416533+0000","last_undegraded":"2023-10-08T16:09:23.416533+0000","last_fullsized":"2023-10-08T16:09:23.416533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2624","last_scrub_stamp":"2023-10-08T16:09:23.416303+0000","last_deep_scrub":"28'2624","last_deep_scrub_stamp":"2023-10-08T16:09:23.416303+0000","last_clean_scrub_stamp":"2023-10-08T16:09:23.416303+0000","objects_scrubbed":3,"log_size":2624,"log_dups_size":0,"ondisk_log_size":2624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:49.519531+0000","scrub_duration":0.026130798,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2619,"num_write_kb":5944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":82,"num_object_clones":21,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":8,"num_read":31,"num_read_kb":21,"num_write":110,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37776,"ondisk_log_size":37776,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":85127916,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":62,"num_read_kb":321,"num_write":17973,"num_write_kb":93770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":170319872,"data_stored":170255832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18097,"ondisk_log_size":18097,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574917,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":348312,"kb_used_data":38736,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94023528,"statfs":{"total":96636764160,"available":96280092672,"internally_reserved":0,"allocated":39665664,"data_stored":39453451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.83199999999999996,"15min":0.86199999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.2070000000000001,"5min":1.976,"15min":1.976},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82699999999999996,"15min":0.85999999999999999},"min":{"1min":0.379,"5min":0.314,"15min":0.314},"max":{"1min":1.2150000000000001,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.98599999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.85799999999999998,"15min":0.86799999999999999},"min":{"1min":0.45600000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.837,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.88900000000000001,"15min":0.90900000000000003},"min":{"1min":0.55000000000000004,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.24,"5min":1.54,"15min":1.54},"last":1.0549999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.90300000000000002,"15min":0.90500000000000003},"min":{"1min":0.60899999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.26,"5min":1.478,"15min":1.478},"last":0.878},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.89000000000000001,"15min":0.92200000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.415,"5min":1.948,"15min":1.948},"last":0.84899999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96599999999999997,"15min":0.97899999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.008,"5min":1.014,"15min":1.048},"min":{"1min":0.70599999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3360000000000001,"5min":1.552,"15min":1.552},"last":1.216}]},{"osd":4,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.97899999999999998,"15min":1},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.5600000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.0609999999999999,"15min":1.083},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.121}]},{"osd":5,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.0249999999999999,"15min":1.0569999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6479999999999999,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0920000000000001,"15min":1.1220000000000001},"min":{"1min":0.52600000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.4990000000000001,"5min":1.726,"15min":1.726},"last":1.1000000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.161,"15min":1.212},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.6240000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.1739999999999999,"15min":1.1970000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.03}]}]},{"osd":6,"up_from":13,"seq":55834574918,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319056,"kb_used_data":17672,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94052784,"statfs":{"total":96636764160,"available":96310050816,"internally_reserved":0,"allocated":18096128,"data_stored":17891613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.77100000000000002,"15min":0.76700000000000002},"min":{"1min":0.45400000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":3.8290000000000002,"5min":3.8290000000000002,"15min":3.8290000000000002},"last":0.751},{"interface":"front","average":{"1min":0.999,"5min":0.83399999999999996,"15min":0.748},"min":{"1min":0.48999999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":3.8519999999999999,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.82999999999999996}]},{"osd":1,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.91000000000000003,"15min":0.91200000000000003},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3740000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.98499999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86799999999999999,"15min":0.84999999999999998},"min":{"1min":0.60299999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1830000000000001,"5min":1.25,"15min":1.25},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.90600000000000003,"15min":0.91500000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.24,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.0609999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.92200000000000004,"15min":0.85999999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.4199999999999999,"5min":2.173,"15min":2.173},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.998,"15min":0.96199999999999997},"min":{"1min":0.58099999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2350000000000001,"5min":1.381,"15min":1.381},"last":1.135}]},{"osd":4,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.96999999999999997,"15min":0.998},"min":{"1min":0.55600000000000005,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.373,"5min":1.413,"15min":1.413},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.01,"5min":1.0489999999999999,"15min":1.022},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.383,"5min":2.25,"15min":2.25},"last":1.01}]},{"osd":5,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0820000000000001,"15min":1.04},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.319,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.319,"5min":1.3080000000000001,"15min":1.2030000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":6.0439999999999996,"5min":17.428999999999998,"15min":17.428999999999998},"last":0.88800000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.1579999999999999,"15min":1.1020000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":6.0229999999999997,"5min":6.0229999999999997,"15min":6.0229999999999997},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.224,"15min":1.202},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":3.706,"5min":3.706,"15min":3.706},"last":1.097}]}]},{"osd":5,"up_from":13,"seq":55834574919,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":330424,"kb_used_data":20848,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94041416,"statfs":{"total":96636764160,"available":96298409984,"internally_reserved":0,"allocated":21348352,"data_stored":21141337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.80000000000000004,"15min":0.876},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.024,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.81100000000000005,"15min":0.81899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":4.2839999999999998,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":1.077}]},{"osd":1,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":0.86699999999999999,"15min":0.83999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":4.399,"5min":4.399,"15min":4.399},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.89200000000000002,"15min":0.89500000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":4.5149999999999997,"5min":4.5149999999999997,"15min":4.5149999999999997},"last":1.032}]},{"osd":2,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.85499999999999998,"15min":0.89400000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.089,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.90200000000000002,"15min":0.89800000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.97999999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":0.98999999999999999,"15min":1.0009999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":4.7140000000000004,"5min":4.7140000000000004,"15min":4.7140000000000004},"last":1.246},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.044,"15min":1.0600000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":4.6920000000000002,"5min":4.6920000000000002,"15min":4.6920000000000002},"last":1.2749999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":1.014,"15min":1.0449999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.5800000000000001,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.89800000000000002,"5min":1.012,"15min":1.095},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.224,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.335}]},{"osd":6,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0489999999999999,"15min":1.079},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.1180000000000001,"15min":1.208},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2390000000000001,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.149}]},{"osd":7,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.101,"15min":1.2},"min":{"1min":0.61799999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.228,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.169,"15min":1.1890000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.111}]}]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":334488,"kb_used_data":29008,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94037352,"statfs":{"total":96636764160,"available":96294248448,"internally_reserved":0,"allocated":29704192,"data_stored":29497190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.80100000000000005,"15min":0.81299999999999994},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.2250000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79700000000000004,"15min":0.78700000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.163,"5min":1.641,"15min":1.641},"last":1.069}]},{"osd":1,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.84199999999999997},"min":{"1min":0.36299999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1779999999999999,"5min":1.292,"15min":1.292},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.89000000000000001,"15min":0.874},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.248,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.88}]},{"osd":2,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.86199999999999999,"15min":0.873},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1659999999999999,"5min":1.276,"15min":1.276},"last":1.101},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.012,"15min":0.96399999999999997},"min":{"1min":0.56200000000000006,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.339,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.995}]},{"osd":3,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.92200000000000004,"15min":0.96599999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2709999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":1.157},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0389999999999999,"15min":1.091},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2330000000000001,"5min":1.448,"15min":1.448},"last":0.93300000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.0169999999999999,"15min":1.0209999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2629999999999999,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.046},{"interface":"front","average":{"1min":1.002,"5min":1.1000000000000001,"15min":1.075},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.208,"5min":9.8480000000000008,"15min":9.8480000000000008},"last":0.78500000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.044,"15min":1.1319999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.248,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1539999999999999,"15min":1.1699999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3939999999999999,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.135}]},{"osd":7,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1919999999999999,"15min":1.1699999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.3280000000000001,"5min":8.8290000000000006,"15min":8.8290000000000006},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1870000000000001,"15min":1.2629999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3859999999999999,"5min":1.71,"15min":1.71},"last":1.0129999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574917,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":318408,"kb_used_data":17024,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94053432,"statfs":{"total":96636764160,"available":96310714368,"internally_reserved":0,"allocated":17432576,"data_stored":17223470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65300000000000002,"15min":0.66000000000000003},"min":{"1min":0.52400000000000002,"5min":0.214,"15min":0.214},"max":{"1min":0.89100000000000001,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70299999999999996,"15min":0.71099999999999997},"min":{"1min":0.40999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.026,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":0.88900000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.69999999999999996,"15min":0.65600000000000003},"min":{"1min":0.42399999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1120000000000001,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":0.748},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.85099999999999998,"15min":0.76900000000000002},"min":{"1min":0.45700000000000002,"5min":0.249,"15min":0.249},"max":{"1min":1.3420000000000001,"5min":8.3059999999999992,"15min":8.3059999999999992},"last":0.67600000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.1100000000000001,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.81299999999999994,"15min":0.78500000000000003},"min":{"1min":0.53900000000000003,"5min":0.433,"15min":0.433},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.29}]},{"osd":4,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.99299999999999999,"15min":1.0309999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.2310000000000001,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.04,"5min":0.997,"15min":1.0049999999999999},"min":{"1min":0.74399999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3919999999999999,"5min":2.202,"15min":2.202},"last":1.01}]},{"osd":5,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0569999999999999,"15min":1.0820000000000001},"min":{"1min":0.69099999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.4379999999999999,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.012,"5min":1.0760000000000001,"15min":1.099},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.341,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.1259999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0620000000000001,"15min":1.0680000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3220000000000001,"5min":2.113,"15min":2.113},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1299999999999999,"15min":1.1679999999999999},"min":{"1min":0.72999999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.5129999999999999,"5min":3.351,"15min":3.351},"last":1.165}]},{"osd":7,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.1459999999999999,"15min":1.2110000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.353,"5min":2.984,"15min":2.984},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.1799999999999999,"15min":1.141},"min":{"1min":0.69999999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":6.3940000000000001,"5min":6.3940000000000001,"15min":6.3940000000000001},"last":1.2170000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314296,"kb_used_data":4720,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94057544,"statfs":{"total":96636764160,"available":96314925056,"internally_reserved":0,"allocated":4833280,"data_stored":4631728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.61399999999999999,"15min":0.63200000000000001},"min":{"1min":0.30299999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.78800000000000003,"5min":1.131,"15min":1.131},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63600000000000001,"15min":0.623},"min":{"1min":0.32200000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.86699999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.1579999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71099999999999997,"15min":0.74399999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0329999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76200000000000001,"15min":0.74399999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0549999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.82999999999999996}]},{"osd":3,"last update":"Sun Oct 8 16:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73099999999999998,"15min":0.755},"min":{"1min":0.36599999999999999,"5min":0.315,"15min":0.315},"max":{"1min":1.038,"5min":1.454,"15min":1.454},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.85499999999999998,"15min":0.871},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.169,"5min":1.306,"15min":1.306},"last":1.129}]},{"osd":4,"last update":"Sun Oct 8 16:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.94799999999999995,"15min":1.006},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.212,"5min":1.954,"15min":1.954},"last":1.2},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.98199999999999998,"15min":1.03},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.298,"5min":1.804,"15min":1.804},"last":0.94999999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.93999999999999995,"15min":1.0069999999999999},"min":{"1min":0.56799999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.242,"5min":1.873,"15min":1.873},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.01,"5min":1.0349999999999999,"15min":1.089},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.288,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.3029999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:09:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.03,"15min":1.079},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.3240000000000001,"5min":1.974,"15min":1.974},"last":1.052},{"interface":"front","average":{"1min":1.01,"5min":1.03,"15min":1.0740000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.341,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.032}]},{"osd":7,"last update":"Sun Oct 8 16:09:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.091,"15min":1.139},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.3400000000000001,"5min":1.915,"15min":1.915},"last":1.232},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.089,"15min":1.151},"min":{"1min":0.70599999999999996,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.3380000000000001,"5min":2.524,"15min":2.524},"last":1.2729999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326288,"kb_used_data":20808,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94045552,"statfs":{"total":96636764160,"available":96302645248,"internally_reserved":0,"allocated":21307392,"data_stored":21108603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60799999999999998,"15min":0.60999999999999999},"min":{"1min":0.39200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.94899999999999995,"5min":1.024,"15min":1.024},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.67400000000000004,"15min":0.65700000000000003},"min":{"1min":0.505,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.54000000000000004}]},{"osd":2,"last update":"Sun Oct 8 16:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.70199999999999996,"15min":0.65700000000000003},"min":{"1min":0.50900000000000001,"5min":0.373,"15min":0.373},"max":{"1min":1.3460000000000001,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.75800000000000001,"15min":0.76600000000000001},"min":{"1min":0.61199999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0549999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.93600000000000005}]},{"osd":3,"last update":"Sun Oct 8 16:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.78600000000000003,"15min":0.83499999999999996},"min":{"1min":0.52600000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.0049999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.755},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.79400000000000004,"15min":0.77300000000000002},"min":{"1min":0.45000000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.84299999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:09:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.92700000000000005,"15min":0.93799999999999994},"min":{"1min":0.69499999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0189999999999999,"15min":1.016},"min":{"1min":0.79900000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5700000000000001,"5min":3.5910000000000002,"15min":3.5910000000000002},"last":0.81100000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:09:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0269999999999999,"15min":1.036},"min":{"1min":0.82199999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.472,"5min":3.6280000000000001,"15min":3.6280000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.069,"5min":1.0620000000000001,"15min":1.1080000000000001},"min":{"1min":0.77000000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.385,"5min":1.641,"15min":1.641},"last":1.2090000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:09:20 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.0389999999999999,"15min":1.091},"min":{"1min":0.77900000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.04},{"interface":"front","average":{"1min":1.113,"5min":1.1080000000000001,"15min":1.139},"min":{"1min":0.748,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.6339999999999999,"5min":3.657,"15min":3.657},"last":1.0149999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:09:20 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.095,"15min":1.147},"min":{"1min":0.86799999999999999,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.401,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.153},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.095,"15min":1.125},"min":{"1min":0.90500000000000003,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.101,"5min":2.101,"15min":2.101},"last":1.1339999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":330996,"kb_used_data":21420,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94040844,"statfs":{"total":96636764160,"available":96297824256,"internally_reserved":0,"allocated":21934080,"data_stored":21706793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:09:15 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65800000000000003,"15min":0.64400000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.95799999999999996,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.70599999999999996,"15min":0.69799999999999995},"min":{"1min":0.376,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.3580000000000001,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.626}]},{"osd":2,"last update":"Sun Oct 8 16:09:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.70599999999999996},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.1839999999999999,"5min":1.766,"15min":1.766},"last":0.51300000000000001},{"interface":"front","average":{"1min":1.05,"5min":0.83399999999999996,"15min":0.79200000000000004},"min":{"1min":0.437,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":5.9610000000000003,"5min":5.9610000000000003,"15min":5.9610000000000003},"last":0.874}]},{"osd":3,"last update":"Sun Oct 8 16:09:15 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.749,"15min":0.76700000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.042,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.83899999999999997,"15min":0.82199999999999995},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.1579999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.69099999999999995}]},{"osd":4,"last update":"Sun Oct 8 16:09:15 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.99399999999999999,"15min":1},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.95399999999999996,"15min":1.008},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3089999999999999,"5min":1.552,"15min":1.552},"last":1.0249999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:09:15 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97399999999999998,"15min":1.008},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.4510000000000001,"5min":1.601,"15min":1.601},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.999,"5min":1.0580000000000001,"15min":1.071},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.407,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.99199999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:09:15 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.0900000000000001,"15min":1.121},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4970000000000001,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.333,"5min":1.157,"15min":1.1040000000000001},"min":{"1min":0.67000000000000004,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":5.827,"5min":5.827,"15min":5.827},"last":1.056}]},{"osd":7,"last update":"Sun Oct 8 16:09:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.167,"15min":1.159},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0880000000000001,"15min":1.1140000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.478,"5min":1.51,"15min":1.51},"last":0.89500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20983808,"data_stored":20972130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20979712,"data_stored":20971680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4476928,"data_stored":4474292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17068032,"data_stored":17057848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17747968,"data_stored":17738294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":38715392,"data_stored":38709724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":24687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":16404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":36917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":45103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":16417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":49208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":32800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":32840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:09:41.084 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.084 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.085 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.085 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.085 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.085 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.086 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.086 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.086 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.086 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.086 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.087 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.087 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.087 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.087 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.087 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.088 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.088 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.088 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.088 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.089 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.089 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.089 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.089 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.090 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.090 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.090 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.091 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.091 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.091 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.092 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2023-10-08T16:04:15.610555+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.092 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.092 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.092 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.093 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.093 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:09:41.093 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-08T16:09:49.882 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:09:49.885 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:10:01.094 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:10:01.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.208+0000 7ff6cea48700 1 Processor -- start 2023-10-08T16:10:01.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.208+0000 7ff6cea48700 1 -- start start 2023-10-08T16:10:01.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6cea48700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff6c806e9a0 0x7ff6c8140280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6cea48700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c806b610 con 0x7ff6c80b1dc0 2023-10-08T16:10:01.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6cea48700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c80afc70 con 0x7ff6c80ab960 2023-10-08T16:10:01.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6cea48700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c80b0060 con 0x7ff6c806e9a0 2023-10-08T16:10:01.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6cda46700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff6c80b1dc0 0x7ff6c806e290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50422/0 (socket says 172.21.15.133:50422) 2023-10-08T16:10:01.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6cda46700 1 -- 172.21.15.133:0/4225511783 learned_addr learned my addr 172.21.15.133:0/4225511783 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:10:01.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6ce247700 1 --2- 172.21.15.133:0/4225511783 >> v2:172.21.15.190:3300/0 conn(0x7ff6c806e9a0 0x7ff6c8140280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6cca44700 1 -- 172.21.15.133:0/4225511783 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4282540607 0 0) 0x7ff6c806b610 con 0x7ff6c80b1dc0 2023-10-08T16:10:01.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6cca44700 1 -- 172.21.15.133:0/4225511783 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6b0003570 con 0x7ff6c80b1dc0 2023-10-08T16:10:01.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6cca44700 1 -- 172.21.15.133:0/4225511783 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2031271828 0 0) 0x7ff6b0003570 con 0x7ff6c80b1dc0 2023-10-08T16:10:01.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6cca44700 1 -- 172.21.15.133:0/4225511783 >> v2:172.21.15.190:3300/0 conn(0x7ff6c806e9a0 msgr2=0x7ff6c8140280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:01.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6cca44700 1 --2- 172.21.15.133:0/4225511783 >> v2:172.21.15.190:3300/0 conn(0x7ff6c806e9a0 0x7ff6c8140280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6cca44700 1 -- 172.21.15.133:0/4225511783 >> v1:172.21.15.190:6789/0 conn(0x7ff6c80ab960 legacy=0x7ff6c8148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6cca44700 1 -- 172.21.15.133:0/4225511783 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c80b0340 con 0x7ff6c80b1dc0 2023-10-08T16:10:01.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6cca44700 1 -- 172.21.15.133:0/4225511783 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2883817959 0 0) 0x7ff6bc001490 con 0x7ff6c80b1dc0 2023-10-08T16:10:01.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6ce247700 1 --2- 172.21.15.133:0/4225511783 >> v2:172.21.15.190:3300/0 conn(0x7ff6c806e9a0 0x7ff6c8140280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:01.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6cca44700 1 -- 172.21.15.133:0/4225511783 >> v1:172.21.15.133:6789/0 conn(0x7ff6c80b1dc0 legacy=0x7ff6c806e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6cca44700 1 --2- 172.21.15.133:0/4225511783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6b0003a60 0x7ff6b0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6cca44700 1 --2- 172.21.15.133:0/4225511783 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6b0004810 0x7ff6b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6cca44700 1 --2- 172.21.15.133:0/4225511783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6b00052e0 0x7ff6b000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6cca44700 1 -- 172.21.15.133:0/4225511783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c80b0060 con 0x7ff6b00052e0 2023-10-08T16:10:01.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6cca44700 1 -- 172.21.15.133:0/4225511783 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b000c2a0 con 0x7ff6b0003a60 2023-10-08T16:10:01.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6cca44700 1 -- 172.21.15.133:0/4225511783 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b000c460 con 0x7ff6b0004810 2023-10-08T16:10:01.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6ce247700 1 --2- 172.21.15.133:0/4225511783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6b00052e0 0x7ff6b000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6cda46700 1 --2- 172.21.15.133:0/4225511783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6b0003a60 0x7ff6b0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6cd245700 1 --2- 172.21.15.133:0/4225511783 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6b0004810 0x7ff6b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6ce247700 1 -- 172.21.15.133:0/4225511783 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6b0004810 msgr2=0x7ff6b0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:01.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6ce247700 1 --2- 172.21.15.133:0/4225511783 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6b0004810 0x7ff6b0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6ce247700 1 -- 172.21.15.133:0/4225511783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6b0003a60 msgr2=0x7ff6b0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:01.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6ce247700 1 --2- 172.21.15.133:0/4225511783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6b0003a60 0x7ff6b0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6ce247700 1 -- 172.21.15.133:0/4225511783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b0003570 con 0x7ff6b00052e0 2023-10-08T16:10:01.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6ce247700 1 -- 172.21.15.133:0/4225511783 reap_dead start 2023-10-08T16:10:01.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6ce247700 1 --2- 172.21.15.133:0/4225511783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6b00052e0 0x7ff6b000ba60 secure :-1 s=READY pgs=4407 cs=0 l=1 rev1=1 crypto rx=0x7ff6c806ee00 tx=0x7ff6c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd43856f42cf700f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:01.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6cca44700 1 -- 172.21.15.133:0/4225511783 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c0009740 con 0x7ff6b00052e0 2023-10-08T16:10:01.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6cca44700 1 -- 172.21.15.133:0/4225511783 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c000e920 con 0x7ff6b00052e0 2023-10-08T16:10:01.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.212+0000 7ff6cca44700 1 -- 172.21.15.133:0/4225511783 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c000ece0 con 0x7ff6b00052e0 2023-10-08T16:10:01.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.216+0000 7ff6cea48700 1 -- 172.21.15.133:0/4225511783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6b00052e0 msgr2=0x7ff6b000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.216+0000 7ff6cea48700 1 --2- 172.21.15.133:0/4225511783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6b00052e0 0x7ff6b000ba60 secure :-1 s=READY pgs=4407 cs=0 l=1 rev1=1 crypto rx=0x7ff6c806ee00 tx=0x7ff6c00091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.216+0000 7ff6cea48700 1 -- 172.21.15.133:0/4225511783 shutdown_connections 2023-10-08T16:10:01.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.216+0000 7ff6cea48700 1 --2- 172.21.15.133:0/4225511783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6b00052e0 0x7ff6b000ba60 unknown :-1 s=CLOSED pgs=4407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.216+0000 7ff6cea48700 1 -- 172.21.15.133:0/4225511783 >> 172.21.15.133:0/4225511783 conn(0x7ff6c8063670 msgr2=0x7ff6c80b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:01.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.216+0000 7ff6cea48700 1 -- 172.21.15.133:0/4225511783 shutdown_connections 2023-10-08T16:10:01.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.216+0000 7ff6cea48700 1 -- 172.21.15.133:0/4225511783 wait complete. 2023-10-08T16:10:01.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.216+0000 7ff6cea48700 1 Processor -- start 2023-10-08T16:10:01.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.216+0000 7ff6cea48700 1 -- start start 2023-10-08T16:10:01.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.216+0000 7ff6cea48700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6b00052e0 0x7ff6c8138c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.216+0000 7ff6cea48700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6c8153180 0x7ff6c81505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.220+0000 7ff6cea48700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6c813bbd0 0x7ff6c813c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.220+0000 7ff6cea48700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c813dcd0 con 0x7ff6c8153180 2023-10-08T16:10:01.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.220+0000 7ff6cea48700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c814fbc0 con 0x7ff6b00052e0 2023-10-08T16:10:01.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.220+0000 7ff6cea48700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c8150140 con 0x7ff6c813bbd0 2023-10-08T16:10:01.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.220+0000 7ff6cd245700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6c8153180 0x7ff6c81505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.220+0000 7ff6cd245700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6c8153180 0x7ff6c81505d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47984/0 (socket says 172.21.15.133:47984) 2023-10-08T16:10:01.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.220+0000 7ff6cd245700 1 -- 172.21.15.133:0/3614596711 learned_addr learned my addr 172.21.15.133:0/3614596711 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:10:01.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.220+0000 7ff6ce247700 1 --2- 172.21.15.133:0/3614596711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6c813bbd0 0x7ff6c813c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.220+0000 7ff6cda46700 1 --2- 172.21.15.133:0/3614596711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6b00052e0 0x7ff6c8138c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.220+0000 7ff6cd245700 1 -- 172.21.15.133:0/3614596711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6c813bbd0 msgr2=0x7ff6c813c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.220+0000 7ff6cd245700 1 --2- 172.21.15.133:0/3614596711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6c813bbd0 0x7ff6c813c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.220+0000 7ff6cd245700 1 -- 172.21.15.133:0/3614596711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6b00052e0 msgr2=0x7ff6c8138c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.220+0000 7ff6cd245700 1 --2- 172.21.15.133:0/3614596711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6b00052e0 0x7ff6c8138c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.220+0000 7ff6cd245700 1 -- 172.21.15.133:0/3614596711 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c8150b10 con 0x7ff6c8153180 2023-10-08T16:10:01.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.220+0000 7ff6ce247700 1 --2- 172.21.15.133:0/3614596711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6c813bbd0 0x7ff6c813c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:01.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.220+0000 7ff6cd245700 1 --2- 172.21.15.133:0/3614596711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6c8153180 0x7ff6c81505d0 secure :-1 s=READY pgs=4408 cs=0 l=1 rev1=1 crypto rx=0x7ff6b800ebf0 tx=0x7ff6b8001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:01.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.220+0000 7ff6c5ffb700 1 -- 172.21.15.133:0/3614596711 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8006ba0 con 0x7ff6c8153180 2023-10-08T16:10:01.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.220+0000 7ff6c5ffb700 1 -- 172.21.15.133:0/3614596711 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b8006d00 con 0x7ff6c8153180 2023-10-08T16:10:01.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.220+0000 7ff6cea48700 1 -- 172.21.15.133:0/3614596711 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c8141370 con 0x7ff6c8153180 2023-10-08T16:10:01.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.220+0000 7ff6c5ffb700 1 -- 172.21.15.133:0/3614596711 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b800c9b0 con 0x7ff6c8153180 2023-10-08T16:10:01.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.220+0000 7ff6cea48700 1 -- 172.21.15.133:0/3614596711 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c80ab5d0 con 0x7ff6c8153180 2023-10-08T16:10:01.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.220+0000 7ff6cea48700 1 -- 172.21.15.133:0/3614596711 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c81502f0 con 0x7ff6c8153180 2023-10-08T16:10:01.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.224+0000 7ff6c5ffb700 1 -- 172.21.15.133:0/3614596711 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff6b8028430 con 0x7ff6c8153180 2023-10-08T16:10:01.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.224+0000 7ff6c5ffb700 1 --2- 172.21.15.133:0/3614596711 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff6b4060550 0x7ff6b4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.224+0000 7ff6cda46700 1 --2- 172.21.15.133:0/3614596711 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff6b4060550 0x7ff6b4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.224+0000 7ff6c5ffb700 1 -- 172.21.15.133:0/3614596711 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7ff6b807d410 con 0x7ff6c8153180 2023-10-08T16:10:01.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.224+0000 7ff6cda46700 1 --2- 172.21.15.133:0/3614596711 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff6b4060550 0x7ff6b4062a00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc001220 tx=0x7ff6bc001e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:01.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.228+0000 7ff6c5ffb700 1 -- 172.21.15.133:0/3614596711 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff6b804d950 con 0x7ff6c8153180 2023-10-08T16:10:01.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.384+0000 7ff6cea48700 1 -- 172.21.15.133:0/3614596711 --> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff6c8150b10 con 0x7ff6b4060550 2023-10-08T16:10:01.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.400+0000 7ff6c5ffb700 1 -- 172.21.15.133:0/3614596711 <== mgr.4104 v2:172.21.15.133:6832/33362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+291299 (secure 0 0 0) 0x7ff6c8150b10 con 0x7ff6b4060550 2023-10-08T16:10:01.409 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:10:01.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.408+0000 7ff6cea48700 1 -- 172.21.15.133:0/3614596711 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff6b4060550 msgr2=0x7ff6b4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.408+0000 7ff6cea48700 1 --2- 172.21.15.133:0/3614596711 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff6b4060550 0x7ff6b4062a00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc001220 tx=0x7ff6bc001e70 comp rx=0 tx=0).stop 2023-10-08T16:10:01.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.408+0000 7ff6cea48700 1 -- 172.21.15.133:0/3614596711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6c8153180 msgr2=0x7ff6c81505d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.408+0000 7ff6cea48700 1 --2- 172.21.15.133:0/3614596711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6c8153180 0x7ff6c81505d0 secure :-1 s=READY pgs=4408 cs=0 l=1 rev1=1 crypto rx=0x7ff6b800ebf0 tx=0x7ff6b8001640 comp rx=0 tx=0).stop 2023-10-08T16:10:01.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.408+0000 7ff6cea48700 1 -- 172.21.15.133:0/3614596711 shutdown_connections 2023-10-08T16:10:01.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.408+0000 7ff6cea48700 1 --2- 172.21.15.133:0/3614596711 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7ff6b4060550 0x7ff6b4062a00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.408+0000 7ff6cea48700 1 --2- 172.21.15.133:0/3614596711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6c813bbd0 0x7ff6c813c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.408+0000 7ff6cea48700 1 --2- 172.21.15.133:0/3614596711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6c8153180 0x7ff6c81505d0 unknown :-1 s=CLOSED pgs=4408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.408+0000 7ff6cea48700 1 --2- 172.21.15.133:0/3614596711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6b00052e0 0x7ff6c8138c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.408+0000 7ff6cea48700 1 -- 172.21.15.133:0/3614596711 >> 172.21.15.133:0/3614596711 conn(0x7ff6c8063670 msgr2=0x7ff6c806fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:01.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.408+0000 7ff6cea48700 1 -- 172.21.15.133:0/3614596711 shutdown_connections 2023-10-08T16:10:01.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:01.408+0000 7ff6cea48700 1 -- 172.21.15.133:0/3614596711 wait complete. 2023-10-08T16:10:01.413 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-10-08T16:10:01.423 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2023-10-08T16:10:00.955013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":85845472,"num_objects":127,"num_object_clones":21,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":8,"num_read":209,"num_read_kb":442,"num_write":18242,"num_write_kb":96383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56019,"ondisk_log_size":56019,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2622268,"kb_used_data":170236,"kb_used_omap":0,"kb_used_meta":2451968,"kb_avail":752352452,"statfs":{"total":773094113280,"available":770408910848,"internally_reserved":0,"allocated":174321664,"data_stored":172654185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2510815232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004027"},"pg_stats":[{"pgid":"3.3f","version":"28'511","reported_seq":580,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650801+0000","last_change":"2023-10-08T16:08:50.725515+0000","last_active":"2023-10-08T16:09:06.650801+0000","last_peered":"2023-10-08T16:09:06.650801+0000","last_clean":"2023-10-08T16:09:06.650801+0000","last_became_active":"2023-10-08T16:04:17.626468+0000","last_became_peered":"2023-10-08T16:04:17.626468+0000","last_unstale":"2023-10-08T16:09:06.650801+0000","last_undegraded":"2023-10-08T16:09:06.650801+0000","last_fullsized":"2023-10-08T16:09:06.650801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012965628,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"28'502","reported_seq":581,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:30.128019+0000","last_change":"2023-10-08T16:09:30.127903+0000","last_active":"2023-10-08T16:09:30.128019+0000","last_peered":"2023-10-08T16:09:30.128019+0000","last_clean":"2023-10-08T16:09:30.128019+0000","last_became_active":"2023-10-08T16:04:17.623968+0000","last_became_peered":"2023-10-08T16:04:17.623968+0000","last_unstale":"2023-10-08T16:09:30.128019+0000","last_undegraded":"2023-10-08T16:09:30.128019+0000","last_fullsized":"2023-10-08T16:09:30.128019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'502","last_scrub_stamp":"2023-10-08T16:09:30.127492+0000","last_deep_scrub":"28'502","last_deep_scrub_stamp":"2023-10-08T16:09:30.127492+0000","last_clean_scrub_stamp":"2023-10-08T16:09:30.127492+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:10:49.129682+0000","scrub_duration":0.0045437120000000001,"objects_trimmed":0,"snaptrim_duration":0.025754998000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"28'751","reported_seq":829,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:35.484095+0000","last_change":"2023-10-08T16:09:35.483973+0000","last_active":"2023-10-08T16:09:35.484095+0000","last_peered":"2023-10-08T16:09:35.484095+0000","last_clean":"2023-10-08T16:09:35.484095+0000","last_became_active":"2023-10-08T16:04:17.624219+0000","last_became_peered":"2023-10-08T16:04:17.624219+0000","last_unstale":"2023-10-08T16:09:35.484095+0000","last_undegraded":"2023-10-08T16:09:35.484095+0000","last_fullsized":"2023-10-08T16:09:35.484095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'751","last_scrub_stamp":"2023-10-08T16:09:35.483714+0000","last_deep_scrub":"28'751","last_deep_scrub_stamp":"2023-10-08T16:09:35.483714+0000","last_clean_scrub_stamp":"2023-10-08T16:09:35.483714+0000","objects_scrubbed":2,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:53.398487+0000","scrub_duration":0.0086411349999999994,"objects_trimmed":0,"snaptrim_duration":0.046708411999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'447","reported_seq":516,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.648420+0000","last_change":"2023-10-08T16:08:50.726275+0000","last_active":"2023-10-08T16:09:06.648420+0000","last_peered":"2023-10-08T16:09:06.648420+0000","last_clean":"2023-10-08T16:09:06.648420+0000","last_became_active":"2023-10-08T16:04:17.628308+0000","last_became_peered":"2023-10-08T16:04:17.628308+0000","last_unstale":"2023-10-08T16:09:06.648420+0000","last_undegraded":"2023-10-08T16:09:06.648420+0000","last_fullsized":"2023-10-08T16:09:06.648420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019603182,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'456","reported_seq":524,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646272+0000","last_change":"2023-10-08T16:08:50.725181+0000","last_active":"2023-10-08T16:09:06.646272+0000","last_peered":"2023-10-08T16:09:06.646272+0000","last_clean":"2023-10-08T16:09:06.646272+0000","last_became_active":"2023-10-08T16:04:17.625650+0000","last_became_peered":"2023-10-08T16:04:17.625650+0000","last_unstale":"2023-10-08T16:09:06.646272+0000","last_undegraded":"2023-10-08T16:09:06.646272+0000","last_fullsized":"2023-10-08T16:09:06.646272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013008828,"stat_sum":{"num_bytes":4107,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'641","reported_seq":717,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:32.516400+0000","last_change":"2023-10-08T16:09:32.516346+0000","last_active":"2023-10-08T16:09:32.516400+0000","last_peered":"2023-10-08T16:09:32.516400+0000","last_clean":"2023-10-08T16:09:32.516400+0000","last_became_active":"2023-10-08T16:04:59.029141+0000","last_became_peered":"2023-10-08T16:04:59.029141+0000","last_unstale":"2023-10-08T16:09:32.516400+0000","last_undegraded":"2023-10-08T16:09:32.516400+0000","last_fullsized":"2023-10-08T16:09:32.516400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'641","last_scrub_stamp":"2023-10-08T16:09:32.516164+0000","last_deep_scrub":"28'641","last_deep_scrub_stamp":"2023-10-08T16:09:32.516164+0000","last_clean_scrub_stamp":"2023-10-08T16:09:32.516164+0000","objects_scrubbed":3,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:50.430937+0000","scrub_duration":0.011603842,"objects_trimmed":0,"snaptrim_duration":0.010017161,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"28'439","reported_seq":508,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.645653+0000","last_change":"2023-10-08T16:08:50.721969+0000","last_active":"2023-10-08T16:09:06.645653+0000","last_peered":"2023-10-08T16:09:06.645653+0000","last_clean":"2023-10-08T16:09:06.645653+0000","last_became_active":"2023-10-08T16:04:17.631722+0000","last_became_peered":"2023-10-08T16:04:17.631722+0000","last_unstale":"2023-10-08T16:09:06.645653+0000","last_undegraded":"2023-10-08T16:09:06.645653+0000","last_fullsized":"2023-10-08T16:09:06.645653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010482406,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'608","reported_seq":686,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:57.209488+0000","last_change":"2023-10-08T16:09:57.209435+0000","last_active":"2023-10-08T16:09:57.209488+0000","last_peered":"2023-10-08T16:09:57.209488+0000","last_clean":"2023-10-08T16:09:57.209488+0000","last_became_active":"2023-10-08T16:04:17.628987+0000","last_became_peered":"2023-10-08T16:04:17.628987+0000","last_unstale":"2023-10-08T16:09:57.209488+0000","last_undegraded":"2023-10-08T16:09:57.209488+0000","last_fullsized":"2023-10-08T16:09:57.209488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'608","last_scrub_stamp":"2023-10-08T16:09:57.209140+0000","last_deep_scrub":"28'608","last_deep_scrub_stamp":"2023-10-08T16:09:57.209140+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.209140+0000","objects_scrubbed":2,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:44:58.041057+0000","scrub_duration":0.0098542950000000008,"objects_trimmed":0,"snaptrim_duration":0.011543940000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"28'702","reported_seq":771,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650879+0000","last_change":"2023-10-08T16:08:50.727041+0000","last_active":"2023-10-08T16:09:06.650879+0000","last_peered":"2023-10-08T16:09:06.650879+0000","last_clean":"2023-10-08T16:09:06.650879+0000","last_became_active":"2023-10-08T16:04:17.636350+0000","last_became_peered":"2023-10-08T16:04:17.636350+0000","last_unstale":"2023-10-08T16:09:06.650879+0000","last_undegraded":"2023-10-08T16:09:06.650879+0000","last_fullsized":"2023-10-08T16:09:06.650879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014319053,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'949","reported_seq":1038,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:50.476019+0000","last_change":"2023-10-08T16:09:50.475967+0000","last_active":"2023-10-08T16:09:50.476019+0000","last_peered":"2023-10-08T16:09:50.476019+0000","last_clean":"2023-10-08T16:09:50.476019+0000","last_became_active":"2023-10-08T16:04:58.696602+0000","last_became_peered":"2023-10-08T16:04:58.696602+0000","last_unstale":"2023-10-08T16:09:50.476019+0000","last_undegraded":"2023-10-08T16:09:50.476019+0000","last_fullsized":"2023-10-08T16:09:50.476019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'949","last_scrub_stamp":"2023-10-08T16:09:50.475774+0000","last_deep_scrub":"28'949","last_deep_scrub_stamp":"2023-10-08T16:09:50.475774+0000","last_clean_scrub_stamp":"2023-10-08T16:09:50.475774+0000","objects_scrubbed":3,"log_size":949,"log_dups_size":0,"ondisk_log_size":949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:44:51.307691+0000","scrub_duration":0.012602917,"objects_trimmed":0,"snaptrim_duration":0.014587116000000001,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"28'517","reported_seq":596,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:30.599563+0000","last_change":"2023-10-08T16:09:30.599506+0000","last_active":"2023-10-08T16:09:30.599563+0000","last_peered":"2023-10-08T16:09:30.599563+0000","last_clean":"2023-10-08T16:09:30.599563+0000","last_became_active":"2023-10-08T16:04:17.627965+0000","last_became_peered":"2023-10-08T16:04:17.627965+0000","last_unstale":"2023-10-08T16:09:30.599563+0000","last_undegraded":"2023-10-08T16:09:30.599563+0000","last_fullsized":"2023-10-08T16:09:30.599563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'517","last_scrub_stamp":"2023-10-08T16:09:30.599375+0000","last_deep_scrub":"28'517","last_deep_scrub_stamp":"2023-10-08T16:09:30.599375+0000","last_clean_scrub_stamp":"2023-10-08T16:09:30.599375+0000","objects_scrubbed":2,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:41.494405+0000","scrub_duration":0.0091910640000000005,"objects_trimmed":0,"snaptrim_duration":0.012809017000000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'623","reported_seq":702,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:38.311592+0000","last_change":"2023-10-08T16:09:38.311514+0000","last_active":"2023-10-08T16:09:38.311592+0000","last_peered":"2023-10-08T16:09:38.311592+0000","last_clean":"2023-10-08T16:09:38.311592+0000","last_became_active":"2023-10-08T16:04:17.616988+0000","last_became_peered":"2023-10-08T16:04:17.616988+0000","last_unstale":"2023-10-08T16:09:38.311592+0000","last_undegraded":"2023-10-08T16:09:38.311592+0000","last_fullsized":"2023-10-08T16:09:38.311592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'623","last_scrub_stamp":"2023-10-08T16:09:38.311231+0000","last_deep_scrub":"28'623","last_deep_scrub_stamp":"2023-10-08T16:09:38.311231+0000","last_clean_scrub_stamp":"2023-10-08T16:09:38.311231+0000","objects_scrubbed":1,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:47.744886+0000","scrub_duration":0.0086635310000000004,"objects_trimmed":0,"snaptrim_duration":0.010221923000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"28'578","reported_seq":657,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:55.221676+0000","last_change":"2023-10-08T16:09:55.221607+0000","last_active":"2023-10-08T16:09:55.221676+0000","last_peered":"2023-10-08T16:09:55.221676+0000","last_clean":"2023-10-08T16:09:55.221676+0000","last_became_active":"2023-10-08T16:04:17.625529+0000","last_became_peered":"2023-10-08T16:04:17.625529+0000","last_unstale":"2023-10-08T16:09:55.221676+0000","last_undegraded":"2023-10-08T16:09:55.221676+0000","last_fullsized":"2023-10-08T16:09:55.221676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'578","last_scrub_stamp":"2023-10-08T16:09:55.221325+0000","last_deep_scrub":"28'578","last_deep_scrub_stamp":"2023-10-08T16:09:55.221325+0000","last_clean_scrub_stamp":"2023-10-08T16:09:55.221325+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:26.913449+0000","scrub_duration":0.0041477520000000002,"objects_trimmed":0,"snaptrim_duration":0.011264827,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"28'490","reported_seq":569,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:52.501976+0000","last_change":"2023-10-08T16:09:52.501907+0000","last_active":"2023-10-08T16:09:52.501976+0000","last_peered":"2023-10-08T16:09:52.501976+0000","last_clean":"2023-10-08T16:09:52.501976+0000","last_became_active":"2023-10-08T16:04:17.624197+0000","last_became_peered":"2023-10-08T16:04:17.624197+0000","last_unstale":"2023-10-08T16:09:52.501976+0000","last_undegraded":"2023-10-08T16:09:52.501976+0000","last_fullsized":"2023-10-08T16:09:52.501976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'490","last_scrub_stamp":"2023-10-08T16:09:52.501658+0000","last_deep_scrub":"28'490","last_deep_scrub_stamp":"2023-10-08T16:09:52.501658+0000","last_clean_scrub_stamp":"2023-10-08T16:09:52.501658+0000","objects_scrubbed":1,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:14.404964+0000","scrub_duration":0.0083187469999999996,"objects_trimmed":0,"snaptrim_duration":0.037453408000000001,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"28'589","reported_seq":668,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:34.179421+0000","last_change":"2023-10-08T16:09:34.179325+0000","last_active":"2023-10-08T16:09:34.179421+0000","last_peered":"2023-10-08T16:09:34.179421+0000","last_clean":"2023-10-08T16:09:34.179421+0000","last_became_active":"2023-10-08T16:04:17.620391+0000","last_became_peered":"2023-10-08T16:04:17.620391+0000","last_unstale":"2023-10-08T16:09:34.179421+0000","last_undegraded":"2023-10-08T16:09:34.179421+0000","last_fullsized":"2023-10-08T16:09:34.179421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'589","last_scrub_stamp":"2023-10-08T16:09:34.178927+0000","last_deep_scrub":"28'589","last_deep_scrub_stamp":"2023-10-08T16:09:34.178927+0000","last_clean_scrub_stamp":"2023-10-08T16:09:34.178927+0000","objects_scrubbed":3,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:45.073957+0000","scrub_duration":0.011898857000000001,"objects_trimmed":0,"snaptrim_duration":0.029228837000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"28'653","reported_seq":731,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:54.884913+0000","last_change":"2023-10-08T16:09:54.884880+0000","last_active":"2023-10-08T16:09:54.884913+0000","last_peered":"2023-10-08T16:09:54.884913+0000","last_clean":"2023-10-08T16:09:54.884913+0000","last_became_active":"2023-10-08T16:04:17.619843+0000","last_became_peered":"2023-10-08T16:04:17.619843+0000","last_unstale":"2023-10-08T16:09:54.884913+0000","last_undegraded":"2023-10-08T16:09:54.884913+0000","last_fullsized":"2023-10-08T16:09:54.884913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'653","last_scrub_stamp":"2023-10-08T16:09:54.884763+0000","last_deep_scrub":"28'653","last_deep_scrub_stamp":"2023-10-08T16:09:54.884763+0000","last_clean_scrub_stamp":"2023-10-08T16:09:54.884763+0000","objects_scrubbed":3,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:44:55.716680+0000","scrub_duration":0.012931170000000001,"objects_trimmed":0,"snaptrim_duration":0.018851915,"stat_sum":{"num_bytes":4105,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"28'622","reported_seq":701,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:47.835072+0000","last_change":"2023-10-08T16:09:47.834951+0000","last_active":"2023-10-08T16:09:47.835072+0000","last_peered":"2023-10-08T16:09:47.835072+0000","last_clean":"2023-10-08T16:09:47.835072+0000","last_became_active":"2023-10-08T16:04:17.625580+0000","last_became_peered":"2023-10-08T16:04:17.625580+0000","last_unstale":"2023-10-08T16:09:47.835072+0000","last_undegraded":"2023-10-08T16:09:47.835072+0000","last_fullsized":"2023-10-08T16:09:47.835072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'622","last_scrub_stamp":"2023-10-08T16:09:47.834643+0000","last_deep_scrub":"28'622","last_deep_scrub_stamp":"2023-10-08T16:09:47.834643+0000","last_clean_scrub_stamp":"2023-10-08T16:09:47.834643+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:31.816880+0000","scrub_duration":0.0043267050000000001,"objects_trimmed":0,"snaptrim_duration":0.018077737,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"28'592","reported_seq":670,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:31.535573+0000","last_change":"2023-10-08T16:09:31.535491+0000","last_active":"2023-10-08T16:09:31.535573+0000","last_peered":"2023-10-08T16:09:31.535573+0000","last_clean":"2023-10-08T16:09:31.535573+0000","last_became_active":"2023-10-08T16:04:17.627197+0000","last_became_peered":"2023-10-08T16:04:17.627197+0000","last_unstale":"2023-10-08T16:09:31.535573+0000","last_undegraded":"2023-10-08T16:09:31.535573+0000","last_fullsized":"2023-10-08T16:09:31.535573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'592","last_scrub_stamp":"2023-10-08T16:09:31.535221+0000","last_deep_scrub":"28'592","last_deep_scrub_stamp":"2023-10-08T16:09:31.535221+0000","last_clean_scrub_stamp":"2023-10-08T16:09:31.535221+0000","objects_scrubbed":3,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:56:01.556005+0000","scrub_duration":0.011238002,"objects_trimmed":0,"snaptrim_duration":0.0098294880000000008,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"28'596","reported_seq":675,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.806907+0000","last_change":"2023-10-08T16:09:20.806843+0000","last_active":"2023-10-08T16:09:20.806907+0000","last_peered":"2023-10-08T16:09:20.806907+0000","last_clean":"2023-10-08T16:09:20.806907+0000","last_became_active":"2023-10-08T16:04:17.625586+0000","last_became_peered":"2023-10-08T16:04:17.625586+0000","last_unstale":"2023-10-08T16:09:20.806907+0000","last_undegraded":"2023-10-08T16:09:20.806907+0000","last_fullsized":"2023-10-08T16:09:20.806907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'596","last_scrub_stamp":"2023-10-08T16:09:20.806564+0000","last_deep_scrub":"28'596","last_deep_scrub_stamp":"2023-10-08T16:09:20.806564+0000","last_clean_scrub_stamp":"2023-10-08T16:09:20.806564+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:23:55.634452+0000","scrub_duration":0.0041559450000000003,"objects_trimmed":0,"snaptrim_duration":0.014288673999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"28'769","reported_seq":848,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:41.498245+0000","last_change":"2023-10-08T16:09:41.498186+0000","last_active":"2023-10-08T16:09:41.498245+0000","last_peered":"2023-10-08T16:09:41.498245+0000","last_clean":"2023-10-08T16:09:41.498245+0000","last_became_active":"2023-10-08T16:04:17.623200+0000","last_became_peered":"2023-10-08T16:04:17.623200+0000","last_unstale":"2023-10-08T16:09:41.498245+0000","last_undegraded":"2023-10-08T16:09:41.498245+0000","last_fullsized":"2023-10-08T16:09:41.498245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'769","last_scrub_stamp":"2023-10-08T16:09:41.497942+0000","last_deep_scrub":"28'769","last_deep_scrub_stamp":"2023-10-08T16:09:41.497942+0000","last_clean_scrub_stamp":"2023-10-08T16:09:41.497942+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:03.401248+0000","scrub_duration":0.003618137,"objects_trimmed":0,"snaptrim_duration":0.012983668,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"28'728","reported_seq":808,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:41.451273+0000","last_change":"2023-10-08T16:09:41.451236+0000","last_active":"2023-10-08T16:09:41.451273+0000","last_peered":"2023-10-08T16:09:41.451273+0000","last_clean":"2023-10-08T16:09:41.451273+0000","last_became_active":"2023-10-08T16:04:17.623945+0000","last_became_peered":"2023-10-08T16:04:17.623945+0000","last_unstale":"2023-10-08T16:09:41.451273+0000","last_undegraded":"2023-10-08T16:09:41.451273+0000","last_fullsized":"2023-10-08T16:09:41.451273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'728","last_scrub_stamp":"2023-10-08T16:09:41.451100+0000","last_deep_scrub":"28'728","last_deep_scrub_stamp":"2023-10-08T16:09:41.451100+0000","last_clean_scrub_stamp":"2023-10-08T16:09:41.451100+0000","objects_scrubbed":3,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:52.346129+0000","scrub_duration":0.011054777,"objects_trimmed":0,"snaptrim_duration":0.045353759,"stat_sum":{"num_bytes":4128,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"28'829","reported_seq":921,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650139+0000","last_change":"2023-10-08T16:08:50.723672+0000","last_active":"2023-10-08T16:09:06.650139+0000","last_peered":"2023-10-08T16:09:06.650139+0000","last_clean":"2023-10-08T16:09:06.650139+0000","last_became_active":"2023-10-08T16:04:17.623904+0000","last_became_peered":"2023-10-08T16:04:17.623904+0000","last_unstale":"2023-10-08T16:09:06.650139+0000","last_undegraded":"2023-10-08T16:09:06.650139+0000","last_fullsized":"2023-10-08T16:09:06.650139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019052278999999998,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":25,"num_read_kb":20,"num_write":31,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'551","reported_seq":629,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:50.248063+0000","last_change":"2023-10-08T16:09:50.247957+0000","last_active":"2023-10-08T16:09:50.248063+0000","last_peered":"2023-10-08T16:09:50.248063+0000","last_clean":"2023-10-08T16:09:50.248063+0000","last_became_active":"2023-10-08T16:04:17.618549+0000","last_became_peered":"2023-10-08T16:04:17.618549+0000","last_unstale":"2023-10-08T16:09:50.248063+0000","last_undegraded":"2023-10-08T16:09:50.248063+0000","last_fullsized":"2023-10-08T16:09:50.248063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'551","last_scrub_stamp":"2023-10-08T16:09:50.247593+0000","last_deep_scrub":"28'551","last_deep_scrub_stamp":"2023-10-08T16:09:50.247593+0000","last_clean_scrub_stamp":"2023-10-08T16:09:50.247593+0000","objects_scrubbed":2,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:34.229831+0000","scrub_duration":0.010229172,"objects_trimmed":0,"snaptrim_duration":0.011087115999999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'660","reported_seq":738,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:45.814537+0000","last_change":"2023-10-08T16:09:45.814414+0000","last_active":"2023-10-08T16:09:45.814537+0000","last_peered":"2023-10-08T16:09:45.814537+0000","last_clean":"2023-10-08T16:09:45.814537+0000","last_became_active":"2023-10-08T16:04:17.627673+0000","last_became_peered":"2023-10-08T16:04:17.627673+0000","last_unstale":"2023-10-08T16:09:45.814537+0000","last_undegraded":"2023-10-08T16:09:45.814537+0000","last_fullsized":"2023-10-08T16:09:45.814537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'660","last_scrub_stamp":"2023-10-08T16:09:45.814137+0000","last_deep_scrub":"28'660","last_deep_scrub_stamp":"2023-10-08T16:09:45.814137+0000","last_clean_scrub_stamp":"2023-10-08T16:09:45.814137+0000","objects_scrubbed":3,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:07.717443+0000","scrub_duration":0.011989448,"objects_trimmed":0,"snaptrim_duration":0.019445790000000001,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"28'469","reported_seq":548,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:54.253438+0000","last_change":"2023-10-08T16:09:54.253292+0000","last_active":"2023-10-08T16:09:54.253438+0000","last_peered":"2023-10-08T16:09:54.253438+0000","last_clean":"2023-10-08T16:09:54.253438+0000","last_became_active":"2023-10-08T16:04:17.628793+0000","last_became_peered":"2023-10-08T16:04:17.628793+0000","last_unstale":"2023-10-08T16:09:54.253438+0000","last_undegraded":"2023-10-08T16:09:54.253438+0000","last_fullsized":"2023-10-08T16:09:54.253438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'469","last_scrub_stamp":"2023-10-08T16:09:54.253036+0000","last_deep_scrub":"28'469","last_deep_scrub_stamp":"2023-10-08T16:09:54.253036+0000","last_clean_scrub_stamp":"2023-10-08T16:09:54.253036+0000","objects_scrubbed":1,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:41:08.525515+0000","scrub_duration":0.0082754100000000004,"objects_trimmed":0,"snaptrim_duration":0.011350429,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"28'660","reported_seq":739,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:48.513950+0000","last_change":"2023-10-08T16:09:48.513876+0000","last_active":"2023-10-08T16:09:48.513950+0000","last_peered":"2023-10-08T16:09:48.513950+0000","last_clean":"2023-10-08T16:09:48.513950+0000","last_became_active":"2023-10-08T16:04:17.625220+0000","last_became_peered":"2023-10-08T16:04:17.625220+0000","last_unstale":"2023-10-08T16:09:48.513950+0000","last_undegraded":"2023-10-08T16:09:48.513950+0000","last_fullsized":"2023-10-08T16:09:48.513950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'660","last_scrub_stamp":"2023-10-08T16:09:48.513639+0000","last_deep_scrub":"28'660","last_deep_scrub_stamp":"2023-10-08T16:09:48.513639+0000","last_clean_scrub_stamp":"2023-10-08T16:09:48.513639+0000","objects_scrubbed":1,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:20.205763+0000","scrub_duration":0.0082496940000000001,"objects_trimmed":0,"snaptrim_duration":0.013452108000000001,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'351","reported_seq":430,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:32.175421+0000","last_change":"2023-10-08T16:09:32.175337+0000","last_active":"2023-10-08T16:09:32.175421+0000","last_peered":"2023-10-08T16:09:32.175421+0000","last_clean":"2023-10-08T16:09:32.175421+0000","last_became_active":"2023-10-08T16:04:17.629574+0000","last_became_peered":"2023-10-08T16:04:17.629574+0000","last_unstale":"2023-10-08T16:09:32.175421+0000","last_undegraded":"2023-10-08T16:09:32.175421+0000","last_fullsized":"2023-10-08T16:09:32.175421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'351","last_scrub_stamp":"2023-10-08T16:09:32.175035+0000","last_deep_scrub":"28'351","last_deep_scrub_stamp":"2023-10-08T16:09:32.175035+0000","last_clean_scrub_stamp":"2023-10-08T16:09:32.175035+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:49.594680+0000","scrub_duration":0.0040114620000000004,"objects_trimmed":0,"snaptrim_duration":0.024743081,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"28'585","reported_seq":664,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:48.174872+0000","last_change":"2023-10-08T16:09:48.174762+0000","last_active":"2023-10-08T16:09:48.174872+0000","last_peered":"2023-10-08T16:09:48.174872+0000","last_clean":"2023-10-08T16:09:48.174872+0000","last_became_active":"2023-10-08T16:04:17.626420+0000","last_became_peered":"2023-10-08T16:04:17.626420+0000","last_unstale":"2023-10-08T16:09:48.174872+0000","last_undegraded":"2023-10-08T16:09:48.174872+0000","last_fullsized":"2023-10-08T16:09:48.174872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'585","last_scrub_stamp":"2023-10-08T16:09:48.174483+0000","last_deep_scrub":"28'585","last_deep_scrub_stamp":"2023-10-08T16:09:48.174483+0000","last_clean_scrub_stamp":"2023-10-08T16:09:48.174483+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:10.077789+0000","scrub_duration":0.0041598870000000001,"objects_trimmed":0,"snaptrim_duration":0.011442964999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'586","reported_seq":665,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:39.418064+0000","last_change":"2023-10-08T16:09:39.417990+0000","last_active":"2023-10-08T16:09:39.418064+0000","last_peered":"2023-10-08T16:09:39.418064+0000","last_clean":"2023-10-08T16:09:39.418064+0000","last_became_active":"2023-10-08T16:04:17.618207+0000","last_became_peered":"2023-10-08T16:04:17.618207+0000","last_unstale":"2023-10-08T16:09:39.418064+0000","last_undegraded":"2023-10-08T16:09:39.418064+0000","last_fullsized":"2023-10-08T16:09:39.418064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'586","last_scrub_stamp":"2023-10-08T16:09:39.417718+0000","last_deep_scrub":"28'586","last_deep_scrub_stamp":"2023-10-08T16:09:39.417718+0000","last_clean_scrub_stamp":"2023-10-08T16:09:39.417718+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:56.837364+0000","scrub_duration":0.0037683299999999999,"objects_trimmed":0,"snaptrim_duration":0.042752309000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"28'403","reported_seq":482,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:51.836016+0000","last_change":"2023-10-08T16:09:51.835933+0000","last_active":"2023-10-08T16:09:51.836016+0000","last_peered":"2023-10-08T16:09:51.836016+0000","last_clean":"2023-10-08T16:09:51.836016+0000","last_became_active":"2023-10-08T16:04:17.627093+0000","last_became_peered":"2023-10-08T16:04:17.627093+0000","last_unstale":"2023-10-08T16:09:51.836016+0000","last_undegraded":"2023-10-08T16:09:51.836016+0000","last_fullsized":"2023-10-08T16:09:51.836016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'403","last_scrub_stamp":"2023-10-08T16:09:51.835660+0000","last_deep_scrub":"28'403","last_deep_scrub_stamp":"2023-10-08T16:09:51.835660+0000","last_clean_scrub_stamp":"2023-10-08T16:09:51.835660+0000","objects_scrubbed":2,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:41:06.108139+0000","scrub_duration":0.0092781470000000005,"objects_trimmed":0,"snaptrim_duration":0.020438813,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"28'946","reported_seq":1024,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:28.533253+0000","last_change":"2023-10-08T16:09:28.533141+0000","last_active":"2023-10-08T16:09:28.533253+0000","last_peered":"2023-10-08T16:09:28.533253+0000","last_clean":"2023-10-08T16:09:28.533253+0000","last_became_active":"2023-10-08T16:04:17.629049+0000","last_became_peered":"2023-10-08T16:04:17.629049+0000","last_unstale":"2023-10-08T16:09:28.533253+0000","last_undegraded":"2023-10-08T16:09:28.533253+0000","last_fullsized":"2023-10-08T16:09:28.533253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'946","last_scrub_stamp":"2023-10-08T16:09:28.532841+0000","last_deep_scrub":"28'946","last_deep_scrub_stamp":"2023-10-08T16:09:28.532841+0000","last_clean_scrub_stamp":"2023-10-08T16:09:28.532841+0000","objects_scrubbed":5,"log_size":946,"log_dups_size":0,"ondisk_log_size":946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:37.966495+0000","scrub_duration":0.013109762,"objects_trimmed":0,"snaptrim_duration":0.01455822,"stat_sum":{"num_bytes":8206,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"28'746","reported_seq":825,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:47.488412+0000","last_change":"2023-10-08T16:09:47.488342+0000","last_active":"2023-10-08T16:09:47.488412+0000","last_peered":"2023-10-08T16:09:47.488412+0000","last_clean":"2023-10-08T16:09:47.488412+0000","last_became_active":"2023-10-08T16:04:17.632012+0000","last_became_peered":"2023-10-08T16:04:17.632012+0000","last_unstale":"2023-10-08T16:09:47.488412+0000","last_undegraded":"2023-10-08T16:09:47.488412+0000","last_fullsized":"2023-10-08T16:09:47.488412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'746","last_scrub_stamp":"2023-10-08T16:09:47.488070+0000","last_deep_scrub":"28'746","last_deep_scrub_stamp":"2023-10-08T16:09:47.488070+0000","last_clean_scrub_stamp":"2023-10-08T16:09:47.488070+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:41:01.760549+0000","scrub_duration":0.0042972970000000003,"objects_trimmed":0,"snaptrim_duration":0.010590815999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"28'514","reported_seq":593,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:33.210343+0000","last_change":"2023-10-08T16:09:33.210256+0000","last_active":"2023-10-08T16:09:33.210343+0000","last_peered":"2023-10-08T16:09:33.210343+0000","last_clean":"2023-10-08T16:09:33.210343+0000","last_became_active":"2023-10-08T16:04:17.623220+0000","last_became_peered":"2023-10-08T16:04:17.623220+0000","last_unstale":"2023-10-08T16:09:33.210343+0000","last_undegraded":"2023-10-08T16:09:33.210343+0000","last_fullsized":"2023-10-08T16:09:33.210343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'514","last_scrub_stamp":"2023-10-08T16:09:33.209999+0000","last_deep_scrub":"28'514","last_deep_scrub_stamp":"2023-10-08T16:09:33.209999+0000","last_clean_scrub_stamp":"2023-10-08T16:09:33.209999+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:59.313227+0000","scrub_duration":0.0040553860000000002,"objects_trimmed":0,"snaptrim_duration":0.010375987999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'748","reported_seq":777,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:21.543351+0000","last_change":"2023-10-08T16:09:21.543315+0000","last_active":"2023-10-08T16:09:21.543351+0000","last_peered":"2023-10-08T16:09:21.543351+0000","last_clean":"2023-10-08T16:09:21.543351+0000","last_became_active":"2023-10-08T16:04:16.660183+0000","last_became_peered":"2023-10-08T16:04:16.660183+0000","last_unstale":"2023-10-08T16:09:21.543351+0000","last_undegraded":"2023-10-08T16:09:21.543351+0000","last_fullsized":"2023-10-08T16:09:21.543351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'748","last_scrub_stamp":"2023-10-08T16:09:21.543182+0000","last_deep_scrub":"28'748","last_deep_scrub_stamp":"2023-10-08T16:09:21.543182+0000","last_clean_scrub_stamp":"2023-10-08T16:09:21.543182+0000","objects_scrubbed":1,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:24.849342+0000","scrub_duration":0.022119043000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":743,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'638","reported_seq":717,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:36.437028+0000","last_change":"2023-10-08T16:09:36.436892+0000","last_active":"2023-10-08T16:09:36.437028+0000","last_peered":"2023-10-08T16:09:36.437028+0000","last_clean":"2023-10-08T16:09:36.437028+0000","last_became_active":"2023-10-08T16:04:17.620532+0000","last_became_peered":"2023-10-08T16:04:17.620532+0000","last_unstale":"2023-10-08T16:09:36.437028+0000","last_undegraded":"2023-10-08T16:09:36.437028+0000","last_fullsized":"2023-10-08T16:09:36.437028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'638","last_scrub_stamp":"2023-10-08T16:09:36.436578+0000","last_deep_scrub":"28'638","last_deep_scrub_stamp":"2023-10-08T16:09:36.436578+0000","last_clean_scrub_stamp":"2023-10-08T16:09:36.436578+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:34.975714+0000","scrub_duration":0.0046835050000000001,"objects_trimmed":0,"snaptrim_duration":0.042650311000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"28'757","reported_seq":786,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:23.727018+0000","last_change":"2023-10-08T16:09:23.726922+0000","last_active":"2023-10-08T16:09:23.727018+0000","last_peered":"2023-10-08T16:09:23.727018+0000","last_clean":"2023-10-08T16:09:23.727018+0000","last_became_active":"2023-10-08T16:04:16.653936+0000","last_became_peered":"2023-10-08T16:04:16.653936+0000","last_unstale":"2023-10-08T16:09:23.727018+0000","last_undegraded":"2023-10-08T16:09:23.727018+0000","last_fullsized":"2023-10-08T16:09:23.727018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'757","last_scrub_stamp":"2023-10-08T16:09:23.726712+0000","last_deep_scrub":"28'757","last_deep_scrub_stamp":"2023-10-08T16:09:23.726712+0000","last_clean_scrub_stamp":"2023-10-08T16:09:23.726712+0000","objects_scrubbed":1,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:53.747495+0000","scrub_duration":0.024528384,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"28'11","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:25.609965+0000","last_change":"2023-10-08T16:09:25.609898+0000","last_active":"2023-10-08T16:09:25.609965+0000","last_peered":"2023-10-08T16:09:25.609965+0000","last_clean":"2023-10-08T16:09:25.609965+0000","last_became_active":"2023-10-08T16:04:16.656642+0000","last_became_peered":"2023-10-08T16:04:16.656642+0000","last_unstale":"2023-10-08T16:09:25.609965+0000","last_undegraded":"2023-10-08T16:09:25.609965+0000","last_fullsized":"2023-10-08T16:09:25.609965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2023-10-08T16:09:25.609667+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2023-10-08T16:09:25.609667+0000","last_clean_scrub_stamp":"2023-10-08T16:09:25.609667+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:35.043321+0000","scrub_duration":0.004097987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'648","reported_seq":725,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:47.346984+0000","last_change":"2023-10-08T16:09:47.346906+0000","last_active":"2023-10-08T16:09:47.346984+0000","last_peered":"2023-10-08T16:09:47.346984+0000","last_clean":"2023-10-08T16:09:47.346984+0000","last_became_active":"2023-10-08T16:04:59.029346+0000","last_became_peered":"2023-10-08T16:04:59.029346+0000","last_unstale":"2023-10-08T16:09:47.346984+0000","last_undegraded":"2023-10-08T16:09:47.346984+0000","last_fullsized":"2023-10-08T16:09:47.346984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'648","last_scrub_stamp":"2023-10-08T16:09:47.346655+0000","last_deep_scrub":"28'648","last_deep_scrub_stamp":"2023-10-08T16:09:47.346655+0000","last_clean_scrub_stamp":"2023-10-08T16:09:47.346655+0000","objects_scrubbed":1,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:31.328893+0000","scrub_duration":0.0074831120000000001,"objects_trimmed":0,"snaptrim_duration":0.024714613999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'1528","reported_seq":1557,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:27.726484+0000","last_change":"2023-10-08T16:09:27.726436+0000","last_active":"2023-10-08T16:09:27.726484+0000","last_peered":"2023-10-08T16:09:27.726484+0000","last_clean":"2023-10-08T16:09:27.726484+0000","last_became_active":"2023-10-08T16:04:16.651258+0000","last_became_peered":"2023-10-08T16:04:16.651258+0000","last_unstale":"2023-10-08T16:09:27.726484+0000","last_undegraded":"2023-10-08T16:09:27.726484+0000","last_fullsized":"2023-10-08T16:09:27.726484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1528","last_scrub_stamp":"2023-10-08T16:09:27.726254+0000","last_deep_scrub":"28'1528","last_deep_scrub_stamp":"2023-10-08T16:09:27.726254+0000","last_clean_scrub_stamp":"2023-10-08T16:09:27.726254+0000","objects_scrubbed":2,"log_size":1528,"log_dups_size":0,"ondisk_log_size":1528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:45.641026+0000","scrub_duration":0.043874232999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1522,"num_write_kb":8929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"28'757","reported_seq":836,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:45.382828+0000","last_change":"2023-10-08T16:09:45.382718+0000","last_active":"2023-10-08T16:09:45.382828+0000","last_peered":"2023-10-08T16:09:45.382828+0000","last_clean":"2023-10-08T16:09:45.382828+0000","last_became_active":"2023-10-08T16:04:17.629765+0000","last_became_peered":"2023-10-08T16:04:17.629765+0000","last_unstale":"2023-10-08T16:09:45.382828+0000","last_undegraded":"2023-10-08T16:09:45.382828+0000","last_fullsized":"2023-10-08T16:09:45.382828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'757","last_scrub_stamp":"2023-10-08T16:09:45.382402+0000","last_deep_scrub":"28'757","last_deep_scrub_stamp":"2023-10-08T16:09:45.382402+0000","last_clean_scrub_stamp":"2023-10-08T16:09:45.382402+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:07.285707+0000","scrub_duration":0.0038822510000000002,"objects_trimmed":0,"snaptrim_duration":0.026861545000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'13","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:26.641725+0000","last_change":"2023-10-08T16:09:26.641657+0000","last_active":"2023-10-08T16:09:26.641725+0000","last_peered":"2023-10-08T16:09:26.641725+0000","last_clean":"2023-10-08T16:09:26.641725+0000","last_became_active":"2023-10-08T16:04:16.654002+0000","last_became_peered":"2023-10-08T16:04:16.654002+0000","last_unstale":"2023-10-08T16:09:26.641725+0000","last_undegraded":"2023-10-08T16:09:26.641725+0000","last_fullsized":"2023-10-08T16:09:26.641725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2023-10-08T16:09:26.641400+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2023-10-08T16:09:26.641400+0000","last_clean_scrub_stamp":"2023-10-08T16:09:26.641400+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:10:45.643591+0000","scrub_duration":0.0040653290000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"28'597","reported_seq":675,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:52.864482+0000","last_change":"2023-10-08T16:09:52.864379+0000","last_active":"2023-10-08T16:09:52.864482+0000","last_peered":"2023-10-08T16:09:52.864482+0000","last_clean":"2023-10-08T16:09:52.864482+0000","last_became_active":"2023-10-08T16:04:17.624071+0000","last_became_peered":"2023-10-08T16:04:17.624071+0000","last_unstale":"2023-10-08T16:09:52.864482+0000","last_undegraded":"2023-10-08T16:09:52.864482+0000","last_fullsized":"2023-10-08T16:09:52.864482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'597","last_scrub_stamp":"2023-10-08T16:09:52.863956+0000","last_deep_scrub":"28'597","last_deep_scrub_stamp":"2023-10-08T16:09:52.863956+0000","last_clean_scrub_stamp":"2023-10-08T16:09:52.863956+0000","objects_scrubbed":2,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:24.556080+0000","scrub_duration":0.010737066999999999,"objects_trimmed":0,"snaptrim_duration":0.018261580999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"26'15","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:28.703566+0000","last_change":"2023-10-08T16:09:28.703480+0000","last_active":"2023-10-08T16:09:28.703566+0000","last_peered":"2023-10-08T16:09:28.703566+0000","last_clean":"2023-10-08T16:09:28.703566+0000","last_became_active":"2023-10-08T16:04:16.656992+0000","last_became_peered":"2023-10-08T16:04:16.656992+0000","last_unstale":"2023-10-08T16:09:28.703566+0000","last_undegraded":"2023-10-08T16:09:28.703566+0000","last_fullsized":"2023-10-08T16:09:28.703566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'15","last_scrub_stamp":"2023-10-08T16:09:28.703215+0000","last_deep_scrub":"26'15","last_deep_scrub_stamp":"2023-10-08T16:09:28.703215+0000","last_clean_scrub_stamp":"2023-10-08T16:09:28.703215+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:27.242351+0000","scrub_duration":0.003527681,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"28'498","reported_seq":577,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:37.423510+0000","last_change":"2023-10-08T16:09:37.423417+0000","last_active":"2023-10-08T16:09:37.423510+0000","last_peered":"2023-10-08T16:09:37.423510+0000","last_clean":"2023-10-08T16:09:37.423510+0000","last_became_active":"2023-10-08T16:04:17.621862+0000","last_became_peered":"2023-10-08T16:04:17.621862+0000","last_unstale":"2023-10-08T16:09:37.423510+0000","last_undegraded":"2023-10-08T16:09:37.423510+0000","last_fullsized":"2023-10-08T16:09:37.423510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'498","last_scrub_stamp":"2023-10-08T16:09:37.423145+0000","last_deep_scrub":"28'498","last_deep_scrub_stamp":"2023-10-08T16:09:37.423145+0000","last_clean_scrub_stamp":"2023-10-08T16:09:37.423145+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:10:56.425335+0000","scrub_duration":0.0043366359999999996,"objects_trimmed":0,"snaptrim_duration":0.045929303999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"28'56","reported_seq":85,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:28.186088+0000","last_change":"2023-10-08T16:09:28.186016+0000","last_active":"2023-10-08T16:09:28.186088+0000","last_peered":"2023-10-08T16:09:28.186088+0000","last_clean":"2023-10-08T16:09:28.186088+0000","last_became_active":"2023-10-08T16:04:16.656041+0000","last_became_peered":"2023-10-08T16:04:16.656041+0000","last_unstale":"2023-10-08T16:09:28.186088+0000","last_undegraded":"2023-10-08T16:09:28.186088+0000","last_fullsized":"2023-10-08T16:09:28.186088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'56","last_scrub_stamp":"2023-10-08T16:09:28.185753+0000","last_deep_scrub":"28'56","last_deep_scrub_stamp":"2023-10-08T16:09:28.185753+0000","last_clean_scrub_stamp":"2023-10-08T16:09:28.185753+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:46.100526+0000","scrub_duration":0.0085979019999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'579","reported_seq":658,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:34.260199+0000","last_change":"2023-10-08T16:09:34.260069+0000","last_active":"2023-10-08T16:09:34.260199+0000","last_peered":"2023-10-08T16:09:34.260199+0000","last_clean":"2023-10-08T16:09:34.260199+0000","last_became_active":"2023-10-08T16:04:17.620654+0000","last_became_peered":"2023-10-08T16:04:17.620654+0000","last_unstale":"2023-10-08T16:09:34.260199+0000","last_undegraded":"2023-10-08T16:09:34.260199+0000","last_fullsized":"2023-10-08T16:09:34.260199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'579","last_scrub_stamp":"2023-10-08T16:09:34.259764+0000","last_deep_scrub":"28'579","last_deep_scrub_stamp":"2023-10-08T16:09:34.259764+0000","last_clean_scrub_stamp":"2023-10-08T16:09:34.259764+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:20:52.892594+0000","scrub_duration":0.0038350179999999999,"objects_trimmed":0,"snaptrim_duration":0.010626305000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"28'805","reported_seq":834,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:28.611581+0000","last_change":"2023-10-08T16:09:28.611547+0000","last_active":"2023-10-08T16:09:28.611581+0000","last_peered":"2023-10-08T16:09:28.611581+0000","last_clean":"2023-10-08T16:09:28.611581+0000","last_became_active":"2023-10-08T16:04:16.653001+0000","last_became_peered":"2023-10-08T16:04:16.653001+0000","last_unstale":"2023-10-08T16:09:28.611581+0000","last_undegraded":"2023-10-08T16:09:28.611581+0000","last_fullsized":"2023-10-08T16:09:28.611581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'805","last_scrub_stamp":"2023-10-08T16:09:28.611394+0000","last_deep_scrub":"28'805","last_deep_scrub_stamp":"2023-10-08T16:09:28.611394+0000","last_clean_scrub_stamp":"2023-10-08T16:09:28.611394+0000","objects_scrubbed":4,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:46.031039+0000","scrub_duration":0.025885490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194948,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":797,"num_write_kb":4446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"28'522","reported_seq":591,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646775+0000","last_change":"2023-10-08T16:08:50.725788+0000","last_active":"2023-10-08T16:09:06.646775+0000","last_peered":"2023-10-08T16:09:06.646775+0000","last_clean":"2023-10-08T16:09:06.646775+0000","last_became_active":"2023-10-08T16:04:17.631130+0000","last_became_peered":"2023-10-08T16:04:17.631130+0000","last_unstale":"2023-10-08T16:09:06.646775+0000","last_undegraded":"2023-10-08T16:09:06.646775+0000","last_fullsized":"2023-10-08T16:09:06.646775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013318705,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"28'1516","reported_seq":1545,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:19.369792+0000","last_change":"2023-10-08T16:09:19.369726+0000","last_active":"2023-10-08T16:09:19.369792+0000","last_peered":"2023-10-08T16:09:19.369792+0000","last_clean":"2023-10-08T16:09:19.369792+0000","last_became_active":"2023-10-08T16:04:16.660830+0000","last_became_peered":"2023-10-08T16:04:16.660830+0000","last_unstale":"2023-10-08T16:09:19.369792+0000","last_undegraded":"2023-10-08T16:09:19.369792+0000","last_fullsized":"2023-10-08T16:09:19.369792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1516","last_scrub_stamp":"2023-10-08T16:09:19.369511+0000","last_deep_scrub":"28'1516","last_deep_scrub_stamp":"2023-10-08T16:09:19.369511+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.369511+0000","objects_scrubbed":4,"log_size":1516,"log_dups_size":0,"ondisk_log_size":1516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:32:53.363596+0000","scrub_duration":0.042270937000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1505,"num_write_kb":8987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"28'654","reported_seq":733,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:25.411523+0000","last_change":"2023-10-08T16:09:25.411435+0000","last_active":"2023-10-08T16:09:25.411523+0000","last_peered":"2023-10-08T16:09:25.411523+0000","last_clean":"2023-10-08T16:09:25.411523+0000","last_became_active":"2023-10-08T16:04:17.623038+0000","last_became_peered":"2023-10-08T16:04:17.623038+0000","last_unstale":"2023-10-08T16:09:25.411523+0000","last_undegraded":"2023-10-08T16:09:25.411523+0000","last_fullsized":"2023-10-08T16:09:25.411523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'654","last_scrub_stamp":"2023-10-08T16:09:25.411173+0000","last_deep_scrub":"28'654","last_deep_scrub_stamp":"2023-10-08T16:09:25.411173+0000","last_clean_scrub_stamp":"2023-10-08T16:09:25.411173+0000","objects_scrubbed":2,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:28.717332+0000","scrub_duration":0.010251712,"objects_trimmed":0,"snaptrim_duration":0.045488809999999998,"stat_sum":{"num_bytes":4107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"26'14","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:29.695218+0000","last_change":"2023-10-08T16:09:29.695141+0000","last_active":"2023-10-08T16:09:29.695218+0000","last_peered":"2023-10-08T16:09:29.695218+0000","last_clean":"2023-10-08T16:09:29.695218+0000","last_became_active":"2023-10-08T16:04:16.649675+0000","last_became_peered":"2023-10-08T16:04:16.649675+0000","last_unstale":"2023-10-08T16:09:29.695218+0000","last_undegraded":"2023-10-08T16:09:29.695218+0000","last_fullsized":"2023-10-08T16:09:29.695218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'14","last_scrub_stamp":"2023-10-08T16:09:29.694856+0000","last_deep_scrub":"26'14","last_deep_scrub_stamp":"2023-10-08T16:09:29.694856+0000","last_clean_scrub_stamp":"2023-10-08T16:09:29.694856+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:35:23.444046+0000","scrub_duration":0.0044355009999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'966","reported_seq":1045,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:46.764417+0000","last_change":"2023-10-08T16:09:46.764296+0000","last_active":"2023-10-08T16:09:46.764417+0000","last_peered":"2023-10-08T16:09:46.764417+0000","last_clean":"2023-10-08T16:09:46.764417+0000","last_became_active":"2023-10-08T16:04:17.628865+0000","last_became_peered":"2023-10-08T16:04:17.628865+0000","last_unstale":"2023-10-08T16:09:46.764417+0000","last_undegraded":"2023-10-08T16:09:46.764417+0000","last_fullsized":"2023-10-08T16:09:46.764417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'966","last_scrub_stamp":"2023-10-08T16:09:46.764005+0000","last_deep_scrub":"28'966","last_deep_scrub_stamp":"2023-10-08T16:09:46.764005+0000","last_clean_scrub_stamp":"2023-10-08T16:09:46.764005+0000","objects_scrubbed":0,"log_size":966,"log_dups_size":0,"ondisk_log_size":966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:44:47.595922+0000","scrub_duration":0.0036926429999999998,"objects_trimmed":0,"snaptrim_duration":0.013199152,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"27'12","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:24.699933+0000","last_change":"2023-10-08T16:09:24.699855+0000","last_active":"2023-10-08T16:09:24.699933+0000","last_peered":"2023-10-08T16:09:24.699933+0000","last_clean":"2023-10-08T16:09:24.699933+0000","last_became_active":"2023-10-08T16:04:16.653342+0000","last_became_peered":"2023-10-08T16:04:16.653342+0000","last_unstale":"2023-10-08T16:09:24.699933+0000","last_undegraded":"2023-10-08T16:09:24.699933+0000","last_fullsized":"2023-10-08T16:09:24.699933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2023-10-08T16:09:24.699597+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2023-10-08T16:09:24.699597+0000","last_clean_scrub_stamp":"2023-10-08T16:09:24.699597+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:42.614369+0000","scrub_duration":0.003422217,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"28'290","reported_seq":369,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:29.576032+0000","last_change":"2023-10-08T16:09:29.575956+0000","last_active":"2023-10-08T16:09:29.576032+0000","last_peered":"2023-10-08T16:09:29.576032+0000","last_clean":"2023-10-08T16:09:29.576032+0000","last_became_active":"2023-10-08T16:04:17.624454+0000","last_became_peered":"2023-10-08T16:04:17.624454+0000","last_unstale":"2023-10-08T16:09:29.576032+0000","last_undegraded":"2023-10-08T16:09:29.576032+0000","last_fullsized":"2023-10-08T16:09:29.576032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'290","last_scrub_stamp":"2023-10-08T16:09:29.575702+0000","last_deep_scrub":"28'290","last_deep_scrub_stamp":"2023-10-08T16:09:29.575702+0000","last_clean_scrub_stamp":"2023-10-08T16:09:29.575702+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:58.715495+0000","scrub_duration":0.0044317380000000002,"objects_trimmed":0,"snaptrim_duration":0.012620849,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"28'26","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:25.562641+0000","last_change":"2023-10-08T16:09:25.562521+0000","last_active":"2023-10-08T16:09:25.562641+0000","last_peered":"2023-10-08T16:09:25.562641+0000","last_clean":"2023-10-08T16:09:25.562641+0000","last_became_active":"2023-10-08T16:04:16.658886+0000","last_became_peered":"2023-10-08T16:04:16.658886+0000","last_unstale":"2023-10-08T16:09:25.562641+0000","last_undegraded":"2023-10-08T16:09:25.562641+0000","last_fullsized":"2023-10-08T16:09:25.562641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'26","last_scrub_stamp":"2023-10-08T16:09:25.562132+0000","last_deep_scrub":"28'26","last_deep_scrub_stamp":"2023-10-08T16:09:25.562132+0000","last_clean_scrub_stamp":"2023-10-08T16:09:25.562132+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:37:32.665776+0000","scrub_duration":0.011851375000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"28'592","reported_seq":661,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.645533+0000","last_change":"2023-10-08T16:08:50.724877+0000","last_active":"2023-10-08T16:09:06.645533+0000","last_peered":"2023-10-08T16:09:06.645533+0000","last_clean":"2023-10-08T16:09:06.645533+0000","last_became_active":"2023-10-08T16:04:17.628605+0000","last_became_peered":"2023-10-08T16:04:17.628605+0000","last_unstale":"2023-10-08T16:09:06.645533+0000","last_undegraded":"2023-10-08T16:09:06.645533+0000","last_fullsized":"2023-10-08T16:09:06.645533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013094041000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'19","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:29.245466+0000","last_change":"2023-10-08T16:09:29.245405+0000","last_active":"2023-10-08T16:09:29.245466+0000","last_peered":"2023-10-08T16:09:29.245466+0000","last_clean":"2023-10-08T16:09:29.245466+0000","last_became_active":"2023-10-08T16:04:16.660651+0000","last_became_peered":"2023-10-08T16:04:16.660651+0000","last_unstale":"2023-10-08T16:09:29.245466+0000","last_undegraded":"2023-10-08T16:09:29.245466+0000","last_fullsized":"2023-10-08T16:09:29.245466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'19","last_scrub_stamp":"2023-10-08T16:09:29.245108+0000","last_deep_scrub":"28'19","last_deep_scrub_stamp":"2023-10-08T16:09:29.245108+0000","last_clean_scrub_stamp":"2023-10-08T16:09:29.245108+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:33:03.239192+0000","scrub_duration":0.0073818440000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"28'296","reported_seq":375,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:44.799671+0000","last_change":"2023-10-08T16:09:44.799601+0000","last_active":"2023-10-08T16:09:44.799671+0000","last_peered":"2023-10-08T16:09:44.799671+0000","last_clean":"2023-10-08T16:09:44.799671+0000","last_became_active":"2023-10-08T16:04:17.628701+0000","last_became_peered":"2023-10-08T16:04:17.628701+0000","last_unstale":"2023-10-08T16:09:44.799671+0000","last_undegraded":"2023-10-08T16:09:44.799671+0000","last_fullsized":"2023-10-08T16:09:44.799671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'296","last_scrub_stamp":"2023-10-08T16:09:44.799289+0000","last_deep_scrub":"28'296","last_deep_scrub_stamp":"2023-10-08T16:09:44.799289+0000","last_clean_scrub_stamp":"2023-10-08T16:09:44.799289+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:16.491413+0000","scrub_duration":0.0039462280000000004,"objects_trimmed":0,"snaptrim_duration":0.012739413999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'278","reported_seq":307,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:24.541205+0000","last_change":"2023-10-08T16:09:24.541140+0000","last_active":"2023-10-08T16:09:24.541205+0000","last_peered":"2023-10-08T16:09:24.541205+0000","last_clean":"2023-10-08T16:09:24.541205+0000","last_became_active":"2023-10-08T16:04:16.651709+0000","last_became_peered":"2023-10-08T16:04:16.651709+0000","last_unstale":"2023-10-08T16:09:24.541205+0000","last_undegraded":"2023-10-08T16:09:24.541205+0000","last_fullsized":"2023-10-08T16:09:24.541205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'278","last_scrub_stamp":"2023-10-08T16:09:24.540994+0000","last_deep_scrub":"28'278","last_deep_scrub_stamp":"2023-10-08T16:09:24.540994+0000","last_clean_scrub_stamp":"2023-10-08T16:09:24.540994+0000","objects_scrubbed":2,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:20:43.173823+0000","scrub_duration":0.020437908000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"28'660","reported_seq":728,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.646592+0000","last_change":"2023-10-08T16:08:50.727298+0000","last_active":"2023-10-08T16:09:06.646592+0000","last_peered":"2023-10-08T16:09:06.646592+0000","last_clean":"2023-10-08T16:09:06.646592+0000","last_became_active":"2023-10-08T16:04:17.630908+0000","last_became_peered":"2023-10-08T16:04:17.630908+0000","last_unstale":"2023-10-08T16:09:06.646592+0000","last_undegraded":"2023-10-08T16:09:06.646592+0000","last_fullsized":"2023-10-08T16:09:06.646592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014318363000000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"28'766","reported_seq":795,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:21.169223+0000","last_change":"2023-10-08T16:09:21.169188+0000","last_active":"2023-10-08T16:09:21.169223+0000","last_peered":"2023-10-08T16:09:21.169223+0000","last_clean":"2023-10-08T16:09:21.169223+0000","last_became_active":"2023-10-08T16:04:16.655245+0000","last_became_peered":"2023-10-08T16:04:16.655245+0000","last_unstale":"2023-10-08T16:09:21.169223+0000","last_undegraded":"2023-10-08T16:09:21.169223+0000","last_fullsized":"2023-10-08T16:09:21.169223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'766","last_scrub_stamp":"2023-10-08T16:09:21.169034+0000","last_deep_scrub":"28'766","last_deep_scrub_stamp":"2023-10-08T16:09:21.169034+0000","last_clean_scrub_stamp":"2023-10-08T16:09:21.169034+0000","objects_scrubbed":2,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:37:28.272678+0000","scrub_duration":0.023529600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":759,"num_write_kb":4511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"28'465","reported_seq":544,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:32.759016+0000","last_change":"2023-10-08T16:09:32.758894+0000","last_active":"2023-10-08T16:09:32.759016+0000","last_peered":"2023-10-08T16:09:32.759016+0000","last_clean":"2023-10-08T16:09:32.759016+0000","last_became_active":"2023-10-08T16:04:17.627369+0000","last_became_peered":"2023-10-08T16:04:17.627369+0000","last_unstale":"2023-10-08T16:09:32.759016+0000","last_undegraded":"2023-10-08T16:09:32.759016+0000","last_fullsized":"2023-10-08T16:09:32.759016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'465","last_scrub_stamp":"2023-10-08T16:09:32.758612+0000","last_deep_scrub":"28'465","last_deep_scrub_stamp":"2023-10-08T16:09:32.758612+0000","last_clean_scrub_stamp":"2023-10-08T16:09:32.758612+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:50:17.550433+0000","scrub_duration":0.0040334330000000003,"objects_trimmed":0,"snaptrim_duration":0.020078136999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"28'12","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:23.499905+0000","last_change":"2023-10-08T16:09:23.499833+0000","last_active":"2023-10-08T16:09:23.499905+0000","last_peered":"2023-10-08T16:09:23.499905+0000","last_clean":"2023-10-08T16:09:23.499905+0000","last_became_active":"2023-10-08T16:04:16.654124+0000","last_became_peered":"2023-10-08T16:04:16.654124+0000","last_unstale":"2023-10-08T16:09:23.499905+0000","last_undegraded":"2023-10-08T16:09:23.499905+0000","last_fullsized":"2023-10-08T16:09:23.499905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2023-10-08T16:09:23.499570+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2023-10-08T16:09:23.499570+0000","last_clean_scrub_stamp":"2023-10-08T16:09:23.499570+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:49.602798+0000","scrub_duration":0.0041480989999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'569","reported_seq":646,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:33.468529+0000","last_change":"2023-10-08T16:09:33.468457+0000","last_active":"2023-10-08T16:09:33.468529+0000","last_peered":"2023-10-08T16:09:33.468529+0000","last_clean":"2023-10-08T16:09:33.468529+0000","last_became_active":"2023-10-08T16:04:58.693477+0000","last_became_peered":"2023-10-08T16:04:58.693477+0000","last_unstale":"2023-10-08T16:09:33.468529+0000","last_undegraded":"2023-10-08T16:09:33.468529+0000","last_fullsized":"2023-10-08T16:09:33.468529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'569","last_scrub_stamp":"2023-10-08T16:09:33.468193+0000","last_deep_scrub":"28'569","last_deep_scrub_stamp":"2023-10-08T16:09:33.468193+0000","last_clean_scrub_stamp":"2023-10-08T16:09:33.468193+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:32.007329+0000","scrub_duration":0.0039894070000000004,"objects_trimmed":0,"snaptrim_duration":0.0094988650000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":184,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:22.835688+0000","last_change":"2023-10-08T16:09:22.835644+0000","last_active":"2023-10-08T16:09:22.835688+0000","last_peered":"2023-10-08T16:09:22.835688+0000","last_clean":"2023-10-08T16:09:22.835688+0000","last_became_active":"2023-10-08T16:04:06.368022+0000","last_became_peered":"2023-10-08T16:04:06.368022+0000","last_unstale":"2023-10-08T16:09:22.835688+0000","last_undegraded":"2023-10-08T16:09:22.835688+0000","last_fullsized":"2023-10-08T16:09:22.835688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2023-10-08T16:09:22.835476+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2023-10-08T16:09:22.835476+0000","last_clean_scrub_stamp":"2023-10-08T16:09:22.835476+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:21.374611+0000","scrub_duration":0.013473255999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"28'13","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:22.681945+0000","last_change":"2023-10-08T16:09:22.681883+0000","last_active":"2023-10-08T16:09:22.681945+0000","last_peered":"2023-10-08T16:09:22.681945+0000","last_clean":"2023-10-08T16:09:22.681945+0000","last_became_active":"2023-10-08T16:04:16.646086+0000","last_became_peered":"2023-10-08T16:04:16.646086+0000","last_unstale":"2023-10-08T16:09:22.681945+0000","last_undegraded":"2023-10-08T16:09:22.681945+0000","last_fullsized":"2023-10-08T16:09:22.681945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2023-10-08T16:09:22.681612+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2023-10-08T16:09:22.681612+0000","last_clean_scrub_stamp":"2023-10-08T16:09:22.681612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:32.115267+0000","scrub_duration":0.0043686569999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'510","reported_seq":589,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:35.338576+0000","last_change":"2023-10-08T16:09:35.338451+0000","last_active":"2023-10-08T16:09:35.338576+0000","last_peered":"2023-10-08T16:09:35.338576+0000","last_clean":"2023-10-08T16:09:35.338576+0000","last_became_active":"2023-10-08T16:04:17.629127+0000","last_became_peered":"2023-10-08T16:04:17.629127+0000","last_unstale":"2023-10-08T16:09:35.338576+0000","last_undegraded":"2023-10-08T16:09:35.338576+0000","last_fullsized":"2023-10-08T16:09:35.338576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'510","last_scrub_stamp":"2023-10-08T16:09:35.338140+0000","last_deep_scrub":"28'510","last_deep_scrub_stamp":"2023-10-08T16:09:35.338140+0000","last_clean_scrub_stamp":"2023-10-08T16:09:35.338140+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:50:20.129961+0000","scrub_duration":0.0040502020000000001,"objects_trimmed":0,"snaptrim_duration":0.011169416999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"28'1506","reported_seq":1535,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:25.858697+0000","last_change":"2023-10-08T16:09:25.858543+0000","last_active":"2023-10-08T16:09:25.858697+0000","last_peered":"2023-10-08T16:09:25.858697+0000","last_clean":"2023-10-08T16:09:25.858697+0000","last_became_active":"2023-10-08T16:04:16.661186+0000","last_became_peered":"2023-10-08T16:04:16.661186+0000","last_unstale":"2023-10-08T16:09:25.858697+0000","last_undegraded":"2023-10-08T16:09:25.858697+0000","last_fullsized":"2023-10-08T16:09:25.858697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1506","last_scrub_stamp":"2023-10-08T16:09:25.858210+0000","last_deep_scrub":"28'1506","last_deep_scrub_stamp":"2023-10-08T16:09:25.858210+0000","last_clean_scrub_stamp":"2023-10-08T16:09:25.858210+0000","objects_scrubbed":2,"log_size":1506,"log_dups_size":0,"ondisk_log_size":1506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:43.277855+0000","scrub_duration":0.039533828999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1499,"num_write_kb":8970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"28'493","reported_seq":572,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:34.511897+0000","last_change":"2023-10-08T16:09:34.511828+0000","last_active":"2023-10-08T16:09:34.511897+0000","last_peered":"2023-10-08T16:09:34.511897+0000","last_clean":"2023-10-08T16:09:34.511897+0000","last_became_active":"2023-10-08T16:04:17.615671+0000","last_became_peered":"2023-10-08T16:04:17.615671+0000","last_unstale":"2023-10-08T16:09:34.511897+0000","last_undegraded":"2023-10-08T16:09:34.511897+0000","last_fullsized":"2023-10-08T16:09:34.511897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'493","last_scrub_stamp":"2023-10-08T16:09:34.511546+0000","last_deep_scrub":"28'493","last_deep_scrub_stamp":"2023-10-08T16:09:34.511546+0000","last_clean_scrub_stamp":"2023-10-08T16:09:34.511546+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:56:04.532329+0000","scrub_duration":0.0042317580000000004,"objects_trimmed":0,"snaptrim_duration":0.043805617999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"28'75","reported_seq":166,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.438844+0000","last_change":"2023-10-08T16:09:20.438777+0000","last_active":"2023-10-08T16:09:20.438844+0000","last_peered":"2023-10-08T16:09:20.438844+0000","last_clean":"2023-10-08T16:09:20.438844+0000","last_became_active":"2023-10-08T16:04:16.654359+0000","last_became_peered":"2023-10-08T16:04:16.654359+0000","last_unstale":"2023-10-08T16:09:20.438844+0000","last_undegraded":"2023-10-08T16:09:20.438844+0000","last_fullsized":"2023-10-08T16:09:20.438844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-10-08T16:09:20.438516+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-10-08T16:09:20.438516+0000","last_clean_scrub_stamp":"2023-10-08T16:09:20.438516+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:18.855971+0000","scrub_duration":0.0049952249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":279988,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":321,"num_write":71,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'389","reported_seq":467,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:33.195937+0000","last_change":"2023-10-08T16:09:33.195879+0000","last_active":"2023-10-08T16:09:33.195937+0000","last_peered":"2023-10-08T16:09:33.195937+0000","last_clean":"2023-10-08T16:09:33.195937+0000","last_became_active":"2023-10-08T16:04:17.624876+0000","last_became_peered":"2023-10-08T16:04:17.624876+0000","last_unstale":"2023-10-08T16:09:33.195937+0000","last_undegraded":"2023-10-08T16:09:33.195937+0000","last_fullsized":"2023-10-08T16:09:33.195937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'389","last_scrub_stamp":"2023-10-08T16:09:33.195676+0000","last_deep_scrub":"28'389","last_deep_scrub_stamp":"2023-10-08T16:09:33.195676+0000","last_clean_scrub_stamp":"2023-10-08T16:09:33.195676+0000","objects_scrubbed":3,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:13:02.335470+0000","scrub_duration":0.010915272,"objects_trimmed":0,"snaptrim_duration":0.024289327999999999,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"28'1401","reported_seq":1430,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:26.761613+0000","last_change":"2023-10-08T16:09:26.761563+0000","last_active":"2023-10-08T16:09:26.761613+0000","last_peered":"2023-10-08T16:09:26.761613+0000","last_clean":"2023-10-08T16:09:26.761613+0000","last_became_active":"2023-10-08T16:04:16.654454+0000","last_became_peered":"2023-10-08T16:04:16.654454+0000","last_unstale":"2023-10-08T16:09:26.761613+0000","last_undegraded":"2023-10-08T16:09:26.761613+0000","last_fullsized":"2023-10-08T16:09:26.761613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1401","last_scrub_stamp":"2023-10-08T16:09:26.761369+0000","last_deep_scrub":"28'1401","last_deep_scrub_stamp":"2023-10-08T16:09:26.761369+0000","last_clean_scrub_stamp":"2023-10-08T16:09:26.761369+0000","objects_scrubbed":2,"log_size":1401,"log_dups_size":0,"ondisk_log_size":1401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:31.493587+0000","scrub_duration":0.039489099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1390,"num_write_kb":8905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"28'618","reported_seq":697,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:35.224258+0000","last_change":"2023-10-08T16:09:35.224192+0000","last_active":"2023-10-08T16:09:35.224258+0000","last_peered":"2023-10-08T16:09:35.224258+0000","last_clean":"2023-10-08T16:09:35.224258+0000","last_became_active":"2023-10-08T16:04:17.619294+0000","last_became_peered":"2023-10-08T16:04:17.619294+0000","last_unstale":"2023-10-08T16:09:35.224258+0000","last_undegraded":"2023-10-08T16:09:35.224258+0000","last_fullsized":"2023-10-08T16:09:35.224258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'618","last_scrub_stamp":"2023-10-08T16:09:35.223925+0000","last_deep_scrub":"28'618","last_deep_scrub_stamp":"2023-10-08T16:09:35.223925+0000","last_clean_scrub_stamp":"2023-10-08T16:09:35.223925+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:37:42.327569+0000","scrub_duration":0.0042708449999999997,"objects_trimmed":0,"snaptrim_duration":0.011233748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"27'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:24.162687+0000","last_change":"2023-10-08T16:09:24.162557+0000","last_active":"2023-10-08T16:09:24.162687+0000","last_peered":"2023-10-08T16:09:24.162687+0000","last_clean":"2023-10-08T16:09:24.162687+0000","last_became_active":"2023-10-08T16:04:16.661756+0000","last_became_peered":"2023-10-08T16:04:16.661756+0000","last_unstale":"2023-10-08T16:09:24.162687+0000","last_undegraded":"2023-10-08T16:09:24.162687+0000","last_fullsized":"2023-10-08T16:09:24.162687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-10-08T16:09:24.162263+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-10-08T16:09:24.162263+0000","last_clean_scrub_stamp":"2023-10-08T16:09:24.162263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:33.595918+0000","scrub_duration":0.0046575389999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"28'515","reported_seq":594,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:31.715455+0000","last_change":"2023-10-08T16:09:31.715390+0000","last_active":"2023-10-08T16:09:31.715455+0000","last_peered":"2023-10-08T16:09:31.715455+0000","last_clean":"2023-10-08T16:09:31.715455+0000","last_became_active":"2023-10-08T16:04:17.616348+0000","last_became_peered":"2023-10-08T16:04:17.616348+0000","last_unstale":"2023-10-08T16:09:31.715455+0000","last_undegraded":"2023-10-08T16:09:31.715455+0000","last_fullsized":"2023-10-08T16:09:31.715455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'515","last_scrub_stamp":"2023-10-08T16:09:31.715159+0000","last_deep_scrub":"28'515","last_deep_scrub_stamp":"2023-10-08T16:09:31.715159+0000","last_clean_scrub_stamp":"2023-10-08T16:09:31.715159+0000","objects_scrubbed":2,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:49.134804+0000","scrub_duration":0.0093125989999999995,"objects_trimmed":0,"snaptrim_duration":0.016977602000000001,"stat_sum":{"num_bytes":4107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"26'21","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:26.813271+0000","last_change":"2023-10-08T16:09:26.813177+0000","last_active":"2023-10-08T16:09:26.813271+0000","last_peered":"2023-10-08T16:09:26.813271+0000","last_clean":"2023-10-08T16:09:26.813271+0000","last_became_active":"2023-10-08T16:04:16.662446+0000","last_became_peered":"2023-10-08T16:04:16.662446+0000","last_unstale":"2023-10-08T16:09:26.813271+0000","last_undegraded":"2023-10-08T16:09:26.813271+0000","last_fullsized":"2023-10-08T16:09:26.813271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'21","last_scrub_stamp":"2023-10-08T16:09:26.812910+0000","last_deep_scrub":"26'21","last_deep_scrub_stamp":"2023-10-08T16:09:26.812910+0000","last_clean_scrub_stamp":"2023-10-08T16:09:26.812910+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:55.952703+0000","scrub_duration":0.0040640759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'606","reported_seq":685,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:29.158906+0000","last_change":"2023-10-08T16:09:29.158842+0000","last_active":"2023-10-08T16:09:29.158906+0000","last_peered":"2023-10-08T16:09:29.158906+0000","last_clean":"2023-10-08T16:09:29.158906+0000","last_became_active":"2023-10-08T16:04:17.624319+0000","last_became_peered":"2023-10-08T16:04:17.624319+0000","last_unstale":"2023-10-08T16:09:29.158906+0000","last_undegraded":"2023-10-08T16:09:29.158906+0000","last_fullsized":"2023-10-08T16:09:29.158906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'606","last_scrub_stamp":"2023-10-08T16:09:29.158591+0000","last_deep_scrub":"28'606","last_deep_scrub_stamp":"2023-10-08T16:09:29.158591+0000","last_clean_scrub_stamp":"2023-10-08T16:09:29.158591+0000","objects_scrubbed":2,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:27.697727+0000","scrub_duration":0.0096838069999999991,"objects_trimmed":0,"snaptrim_duration":0.024480915999999998,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"28'47","reported_seq":76,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:19.116634+0000","last_change":"2023-10-08T16:09:19.116588+0000","last_active":"2023-10-08T16:09:19.116634+0000","last_peered":"2023-10-08T16:09:19.116634+0000","last_clean":"2023-10-08T16:09:19.116634+0000","last_became_active":"2023-10-08T16:04:16.660704+0000","last_became_peered":"2023-10-08T16:04:16.660704+0000","last_unstale":"2023-10-08T16:09:19.116634+0000","last_undegraded":"2023-10-08T16:09:19.116634+0000","last_fullsized":"2023-10-08T16:09:19.116634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'47","last_scrub_stamp":"2023-10-08T16:09:19.116491+0000","last_deep_scrub":"28'47","last_deep_scrub_stamp":"2023-10-08T16:09:19.116491+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.116491+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:45.219718+0000","scrub_duration":0.003732735,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"28'626","reported_seq":705,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:31.471750+0000","last_change":"2023-10-08T16:09:31.471628+0000","last_active":"2023-10-08T16:09:31.471750+0000","last_peered":"2023-10-08T16:09:31.471750+0000","last_clean":"2023-10-08T16:09:31.471750+0000","last_became_active":"2023-10-08T16:04:17.631615+0000","last_became_peered":"2023-10-08T16:04:17.631615+0000","last_unstale":"2023-10-08T16:09:31.471750+0000","last_undegraded":"2023-10-08T16:09:31.471750+0000","last_fullsized":"2023-10-08T16:09:31.471750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'626","last_scrub_stamp":"2023-10-08T16:09:31.471310+0000","last_deep_scrub":"28'626","last_deep_scrub_stamp":"2023-10-08T16:09:31.471310+0000","last_clean_scrub_stamp":"2023-10-08T16:09:31.471310+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:30.010445+0000","scrub_duration":0.0043343189999999997,"objects_trimmed":0,"snaptrim_duration":0.011336120999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"28'13","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:25.681310+0000","last_change":"2023-10-08T16:09:25.681241+0000","last_active":"2023-10-08T16:09:25.681310+0000","last_peered":"2023-10-08T16:09:25.681310+0000","last_clean":"2023-10-08T16:09:25.681310+0000","last_became_active":"2023-10-08T16:04:16.659148+0000","last_became_peered":"2023-10-08T16:04:16.659148+0000","last_unstale":"2023-10-08T16:09:25.681310+0000","last_undegraded":"2023-10-08T16:09:25.681310+0000","last_fullsized":"2023-10-08T16:09:25.681310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2023-10-08T16:09:25.680987+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2023-10-08T16:09:25.680987+0000","last_clean_scrub_stamp":"2023-10-08T16:09:25.680987+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:24.220123+0000","scrub_duration":0.0066810940000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'437","reported_seq":517,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:54.420481+0000","last_change":"2023-10-08T16:09:54.420408+0000","last_active":"2023-10-08T16:09:54.420481+0000","last_peered":"2023-10-08T16:09:54.420481+0000","last_clean":"2023-10-08T16:09:54.420481+0000","last_became_active":"2023-10-08T16:04:17.624385+0000","last_became_peered":"2023-10-08T16:04:17.624385+0000","last_unstale":"2023-10-08T16:09:54.420481+0000","last_undegraded":"2023-10-08T16:09:54.420481+0000","last_fullsized":"2023-10-08T16:09:54.420481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'437","last_scrub_stamp":"2023-10-08T16:09:54.420134+0000","last_deep_scrub":"28'437","last_deep_scrub_stamp":"2023-10-08T16:09:54.420134+0000","last_clean_scrub_stamp":"2023-10-08T16:09:54.420134+0000","objects_scrubbed":1,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:38.402372+0000","scrub_duration":0.0077655099999999998,"objects_trimmed":0,"snaptrim_duration":0.044071592,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"28'759","reported_seq":788,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:43.804911+0000","last_change":"2023-10-08T16:09:43.804831+0000","last_active":"2023-10-08T16:09:43.804911+0000","last_peered":"2023-10-08T16:09:43.804911+0000","last_clean":"2023-10-08T16:09:43.804911+0000","last_became_active":"2023-10-08T16:04:16.662327+0000","last_became_peered":"2023-10-08T16:04:16.662327+0000","last_unstale":"2023-10-08T16:09:43.804911+0000","last_undegraded":"2023-10-08T16:09:43.804911+0000","last_fullsized":"2023-10-08T16:09:43.804911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'759","last_scrub_stamp":"2023-10-08T16:09:43.804549+0000","last_deep_scrub":"28'759","last_deep_scrub_stamp":"2023-10-08T16:09:43.804549+0000","last_clean_scrub_stamp":"2023-10-08T16:09:43.804549+0000","objects_scrubbed":1,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:58.077028+0000","scrub_duration":0.025817079,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":753,"num_write_kb":4504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'450","reported_seq":529,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:41.341168+0000","last_change":"2023-10-08T16:09:41.341044+0000","last_active":"2023-10-08T16:09:41.341168+0000","last_peered":"2023-10-08T16:09:41.341168+0000","last_clean":"2023-10-08T16:09:41.341168+0000","last_became_active":"2023-10-08T16:04:17.622898+0000","last_became_peered":"2023-10-08T16:04:17.622898+0000","last_unstale":"2023-10-08T16:09:41.341168+0000","last_undegraded":"2023-10-08T16:09:41.341168+0000","last_fullsized":"2023-10-08T16:09:41.341168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'450","last_scrub_stamp":"2023-10-08T16:09:41.340711+0000","last_deep_scrub":"28'450","last_deep_scrub_stamp":"2023-10-08T16:09:41.340711+0000","last_clean_scrub_stamp":"2023-10-08T16:09:41.340711+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:56:11.361494+0000","scrub_duration":0.0045819090000000003,"objects_trimmed":0,"snaptrim_duration":0.0075401410000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'10","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.131846+0000","last_change":"2023-10-08T16:09:20.131788+0000","last_active":"2023-10-08T16:09:20.131846+0000","last_peered":"2023-10-08T16:09:20.131846+0000","last_clean":"2023-10-08T16:09:20.131846+0000","last_became_active":"2023-10-08T16:04:16.661055+0000","last_became_peered":"2023-10-08T16:04:16.661055+0000","last_unstale":"2023-10-08T16:09:20.131846+0000","last_undegraded":"2023-10-08T16:09:20.131846+0000","last_fullsized":"2023-10-08T16:09:20.131846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2023-10-08T16:09:20.131603+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2023-10-08T16:09:20.131603+0000","last_clean_scrub_stamp":"2023-10-08T16:09:20.131603+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:20:38.764433+0000","scrub_duration":0.0035988970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"28'502","reported_seq":581,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:34.370256+0000","last_change":"2023-10-08T16:09:34.370190+0000","last_active":"2023-10-08T16:09:34.370256+0000","last_peered":"2023-10-08T16:09:34.370256+0000","last_clean":"2023-10-08T16:09:34.370256+0000","last_became_active":"2023-10-08T16:04:17.626991+0000","last_became_peered":"2023-10-08T16:04:17.626991+0000","last_unstale":"2023-10-08T16:09:34.370256+0000","last_undegraded":"2023-10-08T16:09:34.370256+0000","last_fullsized":"2023-10-08T16:09:34.370256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'502","last_scrub_stamp":"2023-10-08T16:09:34.369933+0000","last_deep_scrub":"28'502","last_deep_scrub_stamp":"2023-10-08T16:09:34.369933+0000","last_clean_scrub_stamp":"2023-10-08T16:09:34.369933+0000","objects_scrubbed":1,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:51.789578+0000","scrub_duration":0.0074754299999999999,"objects_trimmed":0,"snaptrim_duration":0.010148346000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'11","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:27.146089+0000","last_change":"2023-10-08T16:09:27.146023+0000","last_active":"2023-10-08T16:09:27.146089+0000","last_peered":"2023-10-08T16:09:27.146089+0000","last_clean":"2023-10-08T16:09:27.146089+0000","last_became_active":"2023-10-08T16:04:16.657299+0000","last_became_peered":"2023-10-08T16:04:16.657299+0000","last_unstale":"2023-10-08T16:09:27.146089+0000","last_undegraded":"2023-10-08T16:09:27.146089+0000","last_fullsized":"2023-10-08T16:09:27.146089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2023-10-08T16:09:27.145765+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2023-10-08T16:09:27.145765+0000","last_clean_scrub_stamp":"2023-10-08T16:09:27.145765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:57.166548+0000","scrub_duration":0.0039273509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"28'602","reported_seq":679,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:32.438112+0000","last_change":"2023-10-08T16:09:32.438015+0000","last_active":"2023-10-08T16:09:32.438112+0000","last_peered":"2023-10-08T16:09:32.438112+0000","last_clean":"2023-10-08T16:09:32.438112+0000","last_became_active":"2023-10-08T16:04:17.620693+0000","last_became_peered":"2023-10-08T16:04:17.620693+0000","last_unstale":"2023-10-08T16:09:32.438112+0000","last_undegraded":"2023-10-08T16:09:32.438112+0000","last_fullsized":"2023-10-08T16:09:32.438112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'602","last_scrub_stamp":"2023-10-08T16:09:32.437705+0000","last_deep_scrub":"28'602","last_deep_scrub_stamp":"2023-10-08T16:09:32.437705+0000","last_clean_scrub_stamp":"2023-10-08T16:09:32.437705+0000","objects_scrubbed":5,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:35:26.186896+0000","scrub_duration":0.016386810000000002,"objects_trimmed":0,"snaptrim_duration":0.011078684,"stat_sum":{"num_bytes":4121,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'99","reported_seq":128,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:23.883532+0000","last_change":"2023-10-08T16:09:23.883485+0000","last_active":"2023-10-08T16:09:23.883532+0000","last_peered":"2023-10-08T16:09:23.883532+0000","last_clean":"2023-10-08T16:09:23.883532+0000","last_became_active":"2023-10-08T16:04:16.663184+0000","last_became_peered":"2023-10-08T16:04:16.663184+0000","last_unstale":"2023-10-08T16:09:23.883532+0000","last_undegraded":"2023-10-08T16:09:23.883532+0000","last_fullsized":"2023-10-08T16:09:23.883532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'99","last_scrub_stamp":"2023-10-08T16:09:23.883297+0000","last_deep_scrub":"28'99","last_deep_scrub_stamp":"2023-10-08T16:09:23.883297+0000","last_clean_scrub_stamp":"2023-10-08T16:09:23.883297+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:10:42.885487+0000","scrub_duration":0.019422511,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":4152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"28'779","reported_seq":858,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:43.468265+0000","last_change":"2023-10-08T16:09:43.468204+0000","last_active":"2023-10-08T16:09:43.468265+0000","last_peered":"2023-10-08T16:09:43.468265+0000","last_clean":"2023-10-08T16:09:43.468265+0000","last_became_active":"2023-10-08T16:04:17.622898+0000","last_became_peered":"2023-10-08T16:04:17.622898+0000","last_unstale":"2023-10-08T16:09:43.468265+0000","last_undegraded":"2023-10-08T16:09:43.468265+0000","last_fullsized":"2023-10-08T16:09:43.468265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'779","last_scrub_stamp":"2023-10-08T16:09:43.467964+0000","last_deep_scrub":"28'779","last_deep_scrub_stamp":"2023-10-08T16:09:43.467964+0000","last_clean_scrub_stamp":"2023-10-08T16:09:43.467964+0000","objects_scrubbed":1,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:27.450202+0000","scrub_duration":0.0079618980000000002,"objects_trimmed":0,"snaptrim_duration":0.012379262,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"28'812","reported_seq":880,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.648807+0000","last_change":"2023-10-08T16:08:50.726432+0000","last_active":"2023-10-08T16:09:06.648807+0000","last_peered":"2023-10-08T16:09:06.648807+0000","last_clean":"2023-10-08T16:09:06.648807+0000","last_became_active":"2023-10-08T16:04:17.617179+0000","last_became_peered":"2023-10-08T16:04:17.617179+0000","last_unstale":"2023-10-08T16:09:06.648807+0000","last_undegraded":"2023-10-08T16:09:06.648807+0000","last_fullsized":"2023-10-08T16:09:06.648807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016893819000000001,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"28'2505","reported_seq":2534,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:27.835009+0000","last_change":"2023-10-08T16:09:27.834959+0000","last_active":"2023-10-08T16:09:27.835009+0000","last_peered":"2023-10-08T16:09:27.835009+0000","last_clean":"2023-10-08T16:09:27.835009+0000","last_became_active":"2023-10-08T16:04:16.661215+0000","last_became_peered":"2023-10-08T16:04:16.661215+0000","last_unstale":"2023-10-08T16:09:27.835009+0000","last_undegraded":"2023-10-08T16:09:27.835009+0000","last_fullsized":"2023-10-08T16:09:27.835009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2505","last_scrub_stamp":"2023-10-08T16:09:27.834807+0000","last_deep_scrub":"28'2505","last_deep_scrub_stamp":"2023-10-08T16:09:27.834807+0000","last_clean_scrub_stamp":"2023-10-08T16:09:27.834807+0000","objects_scrubbed":2,"log_size":2505,"log_dups_size":0,"ondisk_log_size":2505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:38.729836+0000","scrub_duration":0.024538131000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2502,"num_write_kb":5839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'612","reported_seq":680,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.647580+0000","last_change":"2023-10-08T16:08:50.727342+0000","last_active":"2023-10-08T16:09:06.647580+0000","last_peered":"2023-10-08T16:09:06.647580+0000","last_clean":"2023-10-08T16:09:06.647580+0000","last_became_active":"2023-10-08T16:04:17.617216+0000","last_became_peered":"2023-10-08T16:04:17.617216+0000","last_unstale":"2023-10-08T16:09:06.647580+0000","last_undegraded":"2023-10-08T16:09:06.647580+0000","last_fullsized":"2023-10-08T16:09:06.647580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020241687000000001,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1666","reported_seq":1695,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:38.888154+0000","last_change":"2023-10-08T16:09:38.888088+0000","last_active":"2023-10-08T16:09:38.888154+0000","last_peered":"2023-10-08T16:09:38.888154+0000","last_clean":"2023-10-08T16:09:38.888154+0000","last_became_active":"2023-10-08T16:04:16.661224+0000","last_became_peered":"2023-10-08T16:04:16.661224+0000","last_unstale":"2023-10-08T16:09:38.888154+0000","last_undegraded":"2023-10-08T16:09:38.888154+0000","last_fullsized":"2023-10-08T16:09:38.888154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1666","last_scrub_stamp":"2023-10-08T16:09:38.887848+0000","last_deep_scrub":"28'1666","last_deep_scrub_stamp":"2023-10-08T16:09:38.887848+0000","last_clean_scrub_stamp":"2023-10-08T16:09:38.887848+0000","objects_scrubbed":4,"log_size":1666,"log_dups_size":0,"ondisk_log_size":1666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:00.791153+0000","scrub_duration":0.041569068000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9349042,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1651,"num_write_kb":9976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"28'531","reported_seq":610,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:40.436362+0000","last_change":"2023-10-08T16:09:40.436264+0000","last_active":"2023-10-08T16:09:40.436362+0000","last_peered":"2023-10-08T16:09:40.436362+0000","last_clean":"2023-10-08T16:09:40.436362+0000","last_became_active":"2023-10-08T16:04:17.621550+0000","last_became_peered":"2023-10-08T16:04:17.621550+0000","last_unstale":"2023-10-08T16:09:40.436362+0000","last_undegraded":"2023-10-08T16:09:40.436362+0000","last_fullsized":"2023-10-08T16:09:40.436362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'531","last_scrub_stamp":"2023-10-08T16:09:40.435990+0000","last_deep_scrub":"28'531","last_deep_scrub_stamp":"2023-10-08T16:09:40.435990+0000","last_clean_scrub_stamp":"2023-10-08T16:09:40.435990+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:13:09.575783+0000","scrub_duration":0.0041406139999999999,"objects_trimmed":0,"snaptrim_duration":0.046468506999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"28'765","reported_seq":794,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:29.514816+0000","last_change":"2023-10-08T16:09:29.514743+0000","last_active":"2023-10-08T16:09:29.514816+0000","last_peered":"2023-10-08T16:09:29.514816+0000","last_clean":"2023-10-08T16:09:29.514816+0000","last_became_active":"2023-10-08T16:04:16.661907+0000","last_became_peered":"2023-10-08T16:04:16.661907+0000","last_unstale":"2023-10-08T16:09:29.514816+0000","last_undegraded":"2023-10-08T16:09:29.514816+0000","last_fullsized":"2023-10-08T16:09:29.514816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'765","last_scrub_stamp":"2023-10-08T16:09:29.514581+0000","last_deep_scrub":"28'765","last_deep_scrub_stamp":"2023-10-08T16:09:29.514581+0000","last_clean_scrub_stamp":"2023-10-08T16:09:29.514581+0000","objects_scrubbed":1,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:59.535364+0000","scrub_duration":0.024557628000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":4591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"28'526","reported_seq":605,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:30.490508+0000","last_change":"2023-10-08T16:09:30.490432+0000","last_active":"2023-10-08T16:09:30.490508+0000","last_peered":"2023-10-08T16:09:30.490508+0000","last_clean":"2023-10-08T16:09:30.490508+0000","last_became_active":"2023-10-08T16:04:17.627562+0000","last_became_peered":"2023-10-08T16:04:17.627562+0000","last_unstale":"2023-10-08T16:09:30.490508+0000","last_undegraded":"2023-10-08T16:09:30.490508+0000","last_fullsized":"2023-10-08T16:09:30.490508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'526","last_scrub_stamp":"2023-10-08T16:09:30.490173+0000","last_deep_scrub":"28'526","last_deep_scrub_stamp":"2023-10-08T16:09:30.490173+0000","last_clean_scrub_stamp":"2023-10-08T16:09:30.490173+0000","objects_scrubbed":2,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:48.404946+0000","scrub_duration":0.0091133989999999995,"objects_trimmed":0,"snaptrim_duration":0.011393438000000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"28'2624","reported_seq":2653,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:23.416533+0000","last_change":"2023-10-08T16:09:23.416452+0000","last_active":"2023-10-08T16:09:23.416533+0000","last_peered":"2023-10-08T16:09:23.416533+0000","last_clean":"2023-10-08T16:09:23.416533+0000","last_became_active":"2023-10-08T16:04:16.662714+0000","last_became_peered":"2023-10-08T16:04:16.662714+0000","last_unstale":"2023-10-08T16:09:23.416533+0000","last_undegraded":"2023-10-08T16:09:23.416533+0000","last_fullsized":"2023-10-08T16:09:23.416533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2624","last_scrub_stamp":"2023-10-08T16:09:23.416303+0000","last_deep_scrub":"28'2624","last_deep_scrub_stamp":"2023-10-08T16:09:23.416303+0000","last_clean_scrub_stamp":"2023-10-08T16:09:23.416303+0000","objects_scrubbed":3,"log_size":2624,"log_dups_size":0,"ondisk_log_size":2624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:49.519531+0000","scrub_duration":0.026130798,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2619,"num_write_kb":5944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":82,"num_object_clones":21,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":8,"num_read":31,"num_read_kb":21,"num_write":110,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37802,"ondisk_log_size":37802,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":85127916,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":62,"num_read_kb":321,"num_write":17973,"num_write_kb":93770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":170319872,"data_stored":170255832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18098,"ondisk_log_size":18098,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":348312,"kb_used_data":38736,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94023528,"statfs":{"total":96636764160,"available":96280092672,"internally_reserved":0,"allocated":39665664,"data_stored":39453451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.83199999999999996,"15min":0.86199999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.2070000000000001,"5min":1.976,"15min":1.976},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82699999999999996,"15min":0.85999999999999999},"min":{"1min":0.379,"5min":0.314,"15min":0.314},"max":{"1min":1.2150000000000001,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.71999999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.85799999999999998,"15min":0.86799999999999999},"min":{"1min":0.45600000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.837,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.88900000000000001,"15min":0.90900000000000003},"min":{"1min":0.55000000000000004,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.24,"5min":1.54,"15min":1.54},"last":1.238}]},{"osd":2,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.90300000000000002,"15min":0.90500000000000003},"min":{"1min":0.60899999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.26,"5min":1.478,"15min":1.478},"last":1.121},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.89000000000000001,"15min":0.92200000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.415,"5min":1.948,"15min":1.948},"last":0.89700000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96599999999999997,"15min":0.97899999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.008,"5min":1.014,"15min":1.048},"min":{"1min":0.70599999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3360000000000001,"5min":1.552,"15min":1.552},"last":1.3089999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.97899999999999998,"15min":1},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.5600000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.204},{"interface":"front","average":{"1min":1.056,"5min":1.0609999999999999,"15min":1.083},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.268}]},{"osd":5,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.0249999999999999,"15min":1.0569999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6479999999999999,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0920000000000001,"15min":1.1220000000000001},"min":{"1min":0.52600000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.4990000000000001,"5min":1.726,"15min":1.726},"last":0.98899999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.161,"15min":1.212},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.6240000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.091},{"interface":"front","average":{"1min":1.149,"5min":1.1739999999999999,"15min":1.1970000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.165}]}]},{"osd":6,"up_from":13,"seq":55834574922,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319056,"kb_used_data":17672,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94052784,"statfs":{"total":96636764160,"available":96310050816,"internally_reserved":0,"allocated":18096128,"data_stored":17891613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.77100000000000002,"15min":0.76700000000000002},"min":{"1min":0.45400000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":3.8290000000000002,"5min":3.8290000000000002,"15min":3.8290000000000002},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.999,"5min":0.83399999999999996,"15min":0.748},"min":{"1min":0.48999999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":3.8519999999999999,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":1.125}]},{"osd":1,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.91000000000000003,"15min":0.91200000000000003},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3740000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.085},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.94799999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86799999999999999,"15min":0.84999999999999998},"min":{"1min":0.60299999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1830000000000001,"5min":1.25,"15min":1.25},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.90600000000000003,"15min":0.91500000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.24,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.181}]},{"osd":3,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.92200000000000004,"15min":0.85999999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.4199999999999999,"5min":2.173,"15min":2.173},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.998,"15min":0.96199999999999997},"min":{"1min":0.58099999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2350000000000001,"5min":1.381,"15min":1.381},"last":0.83299999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.96999999999999997,"15min":0.998},"min":{"1min":0.55600000000000005,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.373,"5min":1.413,"15min":1.413},"last":0.871},{"interface":"front","average":{"1min":1.01,"5min":1.0489999999999999,"15min":1.022},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.383,"5min":2.25,"15min":2.25},"last":0.90400000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0820000000000001,"15min":1.04},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.319,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.319,"5min":1.3080000000000001,"15min":1.2030000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":6.0439999999999996,"5min":17.428999999999998,"15min":17.428999999999998},"last":1.0529999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:09:13 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.1579999999999999,"15min":1.1020000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":6.0229999999999997,"5min":6.0229999999999997,"15min":6.0229999999999997},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.224,"15min":1.202},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":3.706,"5min":3.706,"15min":3.706},"last":1.1559999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":330424,"kb_used_data":20848,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94041416,"statfs":{"total":96636764160,"available":96298409984,"internally_reserved":0,"allocated":21348352,"data_stored":21141337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.80000000000000004,"15min":0.876},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.024,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.81100000000000005,"15min":0.81899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":4.2839999999999998,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.82399999999999995}]},{"osd":1,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":0.86699999999999999,"15min":0.83999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":4.399,"5min":4.399,"15min":4.399},"last":1.046},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.89200000000000002,"15min":0.89500000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":4.5149999999999997,"5min":4.5149999999999997,"15min":4.5149999999999997},"last":0.91700000000000004}]},{"osd":2,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.85499999999999998,"15min":0.89400000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.089,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.90200000000000002,"15min":0.89800000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.98299999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":0.98999999999999999,"15min":1.0009999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":4.7140000000000004,"5min":4.7140000000000004,"15min":4.7140000000000004},"last":1.115},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.044,"15min":1.0600000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":4.6920000000000002,"5min":4.6920000000000002,"15min":4.6920000000000002},"last":1.131}]},{"osd":4,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":1.014,"15min":1.0449999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.5800000000000001,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.89800000000000002,"5min":1.012,"15min":1.095},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.224,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.1890000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0489999999999999,"15min":1.079},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.876},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.1180000000000001,"15min":1.208},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2390000000000001,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.155}]},{"osd":7,"last update":"Sun Oct 8 16:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.101,"15min":1.2},"min":{"1min":0.61799999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.228,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.069},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.169,"15min":1.1890000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.0940000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":334488,"kb_used_data":29008,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94037352,"statfs":{"total":96636764160,"available":96294248448,"internally_reserved":0,"allocated":29704192,"data_stored":29497190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.80100000000000005,"15min":0.81299999999999994},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.2250000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79700000000000004,"15min":0.78700000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.163,"5min":1.641,"15min":1.641},"last":0.70599999999999996}]},{"osd":1,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.84199999999999997},"min":{"1min":0.36299999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1779999999999999,"5min":1.292,"15min":1.292},"last":0.755},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.89000000000000001,"15min":0.874},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.248,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.0569999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.86199999999999999,"15min":0.873},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1659999999999999,"5min":1.276,"15min":1.276},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.012,"15min":0.96399999999999997},"min":{"1min":0.56200000000000006,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.339,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.79900000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.92200000000000004,"15min":0.96599999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2709999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":1.228},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0389999999999999,"15min":1.091},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2330000000000001,"5min":1.448,"15min":1.448},"last":1.0249999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.0169999999999999,"15min":1.0209999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2629999999999999,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.1000000000000001,"15min":1.075},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.208,"5min":9.8480000000000008,"15min":9.8480000000000008},"last":1.337}]},{"osd":6,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.044,"15min":1.1319999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.248,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.123},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1539999999999999,"15min":1.1699999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3939999999999999,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.155}]},{"osd":7,"last update":"Sun Oct 8 16:09:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1919999999999999,"15min":1.1699999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.3280000000000001,"5min":8.8290000000000006,"15min":8.8290000000000006},"last":1.385},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1870000000000001,"15min":1.2629999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3859999999999999,"5min":1.71,"15min":1.71},"last":1.2869999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":318408,"kb_used_data":17024,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94053432,"statfs":{"total":96636764160,"available":96310714368,"internally_reserved":0,"allocated":17432576,"data_stored":17223470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65300000000000002,"15min":0.66000000000000003},"min":{"1min":0.52400000000000002,"5min":0.214,"15min":0.214},"max":{"1min":0.89100000000000001,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70299999999999996,"15min":0.71099999999999997},"min":{"1min":0.40999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.026,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":0.84399999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.69999999999999996,"15min":0.65600000000000003},"min":{"1min":0.42399999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1120000000000001,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.85099999999999998,"15min":0.76900000000000002},"min":{"1min":0.45700000000000002,"5min":0.249,"15min":0.249},"max":{"1min":1.3420000000000001,"5min":8.3059999999999992,"15min":8.3059999999999992},"last":1.095}]},{"osd":2,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.1100000000000001,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.052},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.81299999999999994,"15min":0.78500000000000003},"min":{"1min":0.53900000000000003,"5min":0.433,"15min":0.433},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.1719999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.99299999999999999,"15min":1.0309999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.2310000000000001,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.04,"5min":0.997,"15min":1.0049999999999999},"min":{"1min":0.74399999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3919999999999999,"5min":2.202,"15min":2.202},"last":1.4139999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0569999999999999,"15min":1.0820000000000001},"min":{"1min":0.69099999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.4379999999999999,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":1.214},{"interface":"front","average":{"1min":1.012,"5min":1.0760000000000001,"15min":1.099},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.341,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.2989999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0620000000000001,"15min":1.0680000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3220000000000001,"5min":2.113,"15min":2.113},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1299999999999999,"15min":1.1679999999999999},"min":{"1min":0.72999999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.5129999999999999,"5min":3.351,"15min":3.351},"last":1.391}]},{"osd":7,"last update":"Sun Oct 8 16:09:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.1459999999999999,"15min":1.2110000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.353,"5min":2.984,"15min":2.984},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.1799999999999999,"15min":1.141},"min":{"1min":0.69999999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":6.3940000000000001,"5min":6.3940000000000001,"15min":6.3940000000000001},"last":1.482}]}]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314296,"kb_used_data":4720,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94057544,"statfs":{"total":96636764160,"available":96314925056,"internally_reserved":0,"allocated":4833280,"data_stored":4631728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.61399999999999999,"15min":0.63200000000000001},"min":{"1min":0.30299999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.78800000000000003,"5min":1.131,"15min":1.131},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63600000000000001,"15min":0.623},"min":{"1min":0.32200000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.86699999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.84399999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71099999999999997,"15min":0.74399999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0329999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76200000000000001,"15min":0.74399999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0549999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.72899999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73099999999999998,"15min":0.755},"min":{"1min":0.36599999999999999,"5min":0.315,"15min":0.315},"max":{"1min":1.038,"5min":1.454,"15min":1.454},"last":0.874},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.85499999999999998,"15min":0.871},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.169,"5min":1.306,"15min":1.306},"last":0.92200000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.94799999999999995,"15min":1.006},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.212,"5min":1.954,"15min":1.954},"last":1.01},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.98199999999999998,"15min":1.03},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.298,"5min":1.804,"15min":1.804},"last":0.96499999999999997}]},{"osd":5,"last update":"Sun Oct 8 16:09:16 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.93999999999999995,"15min":1.0069999999999999},"min":{"1min":0.56799999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.242,"5min":1.873,"15min":1.873},"last":1.085},{"interface":"front","average":{"1min":1.01,"5min":1.0349999999999999,"15min":1.089},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.288,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.1080000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:09:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.03,"15min":1.079},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.3240000000000001,"5min":1.974,"15min":1.974},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.01,"5min":1.03,"15min":1.0740000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.341,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.3440000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:09:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.091,"15min":1.139},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.3400000000000001,"5min":1.915,"15min":1.915},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.089,"15min":1.151},"min":{"1min":0.70599999999999996,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.3380000000000001,"5min":2.524,"15min":2.524},"last":1.2889999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326288,"kb_used_data":20808,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94045552,"statfs":{"total":96636764160,"available":96302645248,"internally_reserved":0,"allocated":21307392,"data_stored":21108603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60799999999999998,"15min":0.60999999999999999},"min":{"1min":0.39200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.94899999999999995,"5min":1.024,"15min":1.024},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.67400000000000004,"15min":0.65700000000000003},"min":{"1min":0.505,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.91400000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.70199999999999996,"15min":0.65700000000000003},"min":{"1min":0.50900000000000001,"5min":0.373,"15min":0.373},"max":{"1min":1.3460000000000001,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.75800000000000001,"15min":0.76600000000000001},"min":{"1min":0.61199999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0549999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.995}]},{"osd":3,"last update":"Sun Oct 8 16:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.78600000000000003,"15min":0.83499999999999996},"min":{"1min":0.52600000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.0049999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.79400000000000004,"15min":0.77300000000000002},"min":{"1min":0.45000000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.0369999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:09:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.92700000000000005,"15min":0.93799999999999994},"min":{"1min":0.69499999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.752},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0189999999999999,"15min":1.016},"min":{"1min":0.79900000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5700000000000001,"5min":3.5910000000000002,"15min":3.5910000000000002},"last":1.1950000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:09:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0269999999999999,"15min":1.036},"min":{"1min":0.82199999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.472,"5min":3.6280000000000001,"15min":3.6280000000000001},"last":1.244},{"interface":"front","average":{"1min":1.069,"5min":1.0620000000000001,"15min":1.1080000000000001},"min":{"1min":0.77000000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.385,"5min":1.641,"15min":1.641},"last":1.2969999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:09:20 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.0389999999999999,"15min":1.091},"min":{"1min":0.77900000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.27},{"interface":"front","average":{"1min":1.113,"5min":1.1080000000000001,"15min":1.139},"min":{"1min":0.748,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.6339999999999999,"5min":3.657,"15min":3.657},"last":1.1259999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:09:20 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.095,"15min":1.147},"min":{"1min":0.86799999999999999,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.401,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.095,"15min":1.125},"min":{"1min":0.90500000000000003,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.101,"5min":2.101,"15min":2.101},"last":1.22}]}]},{"osd":0,"up_from":13,"seq":55834574921,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":330996,"kb_used_data":21420,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94040844,"statfs":{"total":96636764160,"available":96297824256,"internally_reserved":0,"allocated":21934080,"data_stored":21706793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:09:15 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65800000000000003,"15min":0.64400000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.95799999999999996,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.70599999999999996,"15min":0.69799999999999995},"min":{"1min":0.376,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.3580000000000001,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.72199999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:09:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.70599999999999996},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.1839999999999999,"5min":1.766,"15min":1.766},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.05,"5min":0.83399999999999996,"15min":0.79200000000000004},"min":{"1min":0.437,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":5.9610000000000003,"5min":5.9610000000000003,"15min":5.9610000000000003},"last":0.84299999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:09:15 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.749,"15min":0.76700000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.042,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.83899999999999997,"15min":0.82199999999999995},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.1579999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.89200000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:09:15 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.99399999999999999,"15min":1},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.95399999999999996,"15min":1.008},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3089999999999999,"5min":1.552,"15min":1.552},"last":1.2450000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:09:15 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97399999999999998,"15min":1.008},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.4510000000000001,"5min":1.601,"15min":1.601},"last":1.3400000000000001},{"interface":"front","average":{"1min":0.999,"5min":1.0580000000000001,"15min":1.071},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.407,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.115}]},{"osd":6,"last update":"Sun Oct 8 16:09:15 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.0900000000000001,"15min":1.121},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4970000000000001,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.167},{"interface":"front","average":{"1min":1.333,"5min":1.157,"15min":1.1040000000000001},"min":{"1min":0.67000000000000004,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":5.827,"5min":5.827,"15min":5.827},"last":1.2829999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:09:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.167,"15min":1.159},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.472},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0880000000000001,"15min":1.1140000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.478,"5min":1.51,"15min":1.51},"last":1.393}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20983808,"data_stored":20972130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20979712,"data_stored":20971680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4476928,"data_stored":4474292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17068032,"data_stored":17057848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17747968,"data_stored":17738294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":38715392,"data_stored":38709724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":24687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":16404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":36917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":45103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":16417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":49208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":32800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":32840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:10:01.430 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:10:01.431 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:10:01.431 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:10:01.431 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:10:01.431 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:10:01.432 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:10:01.432 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:10:01.432 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:10:01.433 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:10:01.433 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:10:01.433 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:10:01.434 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-08T16:10:19.961 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:10:19.964 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:10:21.434 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:10:21.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.543+0000 7fb6ff2af700 1 Processor -- start 2023-10-08T16:10:21.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.543+0000 7fb6ff2af700 1 -- start start 2023-10-08T16:10:21.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.543+0000 7fb6ff2af700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6f80ae560 0x7fb6f8143b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:21.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.543+0000 7fb6ff2af700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f80afed0 con 0x7fb6f80ae190 2023-10-08T16:10:21.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.543+0000 7fb6ff2af700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f806b730 con 0x7fb6f8144090 2023-10-08T16:10:21.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.543+0000 7fb6ff2af700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f8144510 con 0x7fb6f80ae560 2023-10-08T16:10:21.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.543+0000 7fb6fc84a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6f80ae560 0x7fb6f8143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:21.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.543+0000 7fb6fc84a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6f80ae560 0x7fb6f8143b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51266/0 (socket says 172.21.15.133:51266) 2023-10-08T16:10:21.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.543+0000 7fb6fc84a700 1 -- 172.21.15.133:0/3004944512 learned_addr learned my addr 172.21.15.133:0/3004944512 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:10:21.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.543+0000 7fb6fc84a700 1 -- 172.21.15.133:0/3004944512 >> v1:172.21.15.190:6789/0 conn(0x7fb6f8144090 legacy=0x7fb6f806e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:21.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.543+0000 7fb6fc84a700 1 -- 172.21.15.133:0/3004944512 >> v1:172.21.15.133:6789/0 conn(0x7fb6f80ae190 legacy=0x7fb6f80b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:21.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.543+0000 7fb6fc84a700 1 -- 172.21.15.133:0/3004944512 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f80af880 con 0x7fb6f80ae560 2023-10-08T16:10:21.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.543+0000 7fb6fc84a700 1 --2- 172.21.15.133:0/3004944512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6f80ae560 0x7fb6f8143b50 secure :-1 s=READY pgs=4410 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4009f20 tx=0x7fb6f4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a38a67071b0a5f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:21.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.543+0000 7fb6effff700 1 -- 172.21.15.133:0/3004944512 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f400e070 con 0x7fb6f80ae560 2023-10-08T16:10:21.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.543+0000 7fb6effff700 1 -- 172.21.15.133:0/3004944512 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f400ba40 con 0x7fb6f80ae560 2023-10-08T16:10:21.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.543+0000 7fb6effff700 1 -- 172.21.15.133:0/3004944512 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f40092e0 con 0x7fb6f80ae560 2023-10-08T16:10:21.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.543+0000 7fb6ff2af700 1 -- 172.21.15.133:0/3004944512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6f80ae560 msgr2=0x7fb6f8143b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:21.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.543+0000 7fb6ff2af700 1 --2- 172.21.15.133:0/3004944512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6f80ae560 0x7fb6f8143b50 secure :-1 s=READY pgs=4410 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4009f20 tx=0x7fb6f4009840 comp rx=0 tx=0).stop 2023-10-08T16:10:21.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.543+0000 7fb6ff2af700 1 -- 172.21.15.133:0/3004944512 shutdown_connections 2023-10-08T16:10:21.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.543+0000 7fb6ff2af700 1 --2- 172.21.15.133:0/3004944512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6f80ae560 0x7fb6f8143b50 unknown :-1 s=CLOSED pgs=4410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.543+0000 7fb6ff2af700 1 -- 172.21.15.133:0/3004944512 >> 172.21.15.133:0/3004944512 conn(0x7fb6f80b4ba0 msgr2=0x7fb6f80b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:21.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.547+0000 7fb6ff2af700 1 -- 172.21.15.133:0/3004944512 shutdown_connections 2023-10-08T16:10:21.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.547+0000 7fb6ff2af700 1 -- 172.21.15.133:0/3004944512 wait complete. 2023-10-08T16:10:21.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.547+0000 7fb6ff2af700 1 Processor -- start 2023-10-08T16:10:21.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.547+0000 7fb6ff2af700 1 -- start start 2023-10-08T16:10:21.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.547+0000 7fb6ff2af700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6f80ae190 0x7fb6f80ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.547+0000 7fb6ff2af700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6f80ae560 0x7fb6f80acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.547+0000 7fb6ff2af700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6f8144090 0x7fb6f8137e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.547+0000 7fb6ff2af700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f8143470 con 0x7fb6f8144090 2023-10-08T16:10:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.547+0000 7fb6ff2af700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f8143b50 con 0x7fb6f80ae190 2023-10-08T16:10:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.547+0000 7fb6ff2af700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f8143190 con 0x7fb6f80ae560 2023-10-08T16:10:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.547+0000 7fb6fd84c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6f8144090 0x7fb6f8137e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.547+0000 7fb6fd84c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6f8144090 0x7fb6f8137e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51274/0 (socket says 172.21.15.133:51274) 2023-10-08T16:10:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.547+0000 7fb6fd84c700 1 -- 172.21.15.133:0/3461536783 learned_addr learned my addr 172.21.15.133:0/3461536783 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:10:21.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.547+0000 7fb6fc84a700 1 --2- 172.21.15.133:0/3461536783 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6f80ae560 0x7fb6f80acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:21.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.547+0000 7fb6fd04b700 1 --2- 172.21.15.133:0/3461536783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6f80ae190 0x7fb6f80ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:21.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.547+0000 7fb6fd84c700 1 -- 172.21.15.133:0/3461536783 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6f80ae560 msgr2=0x7fb6f80acfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:21.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.547+0000 7fb6fd84c700 1 --2- 172.21.15.133:0/3461536783 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6f80ae560 0x7fb6f80acfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.547+0000 7fb6fd84c700 1 -- 172.21.15.133:0/3461536783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6f80ae190 msgr2=0x7fb6f80ac640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:21.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.547+0000 7fb6fd84c700 1 --2- 172.21.15.133:0/3461536783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6f80ae190 0x7fb6f80ac640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.547+0000 7fb6fd84c700 1 -- 172.21.15.133:0/3461536783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f4009ae0 con 0x7fb6f8144090 2023-10-08T16:10:21.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.547+0000 7fb6fd84c700 1 --2- 172.21.15.133:0/3461536783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6f8144090 0x7fb6f8137e70 secure :-1 s=READY pgs=4411 cs=0 l=1 rev1=1 crypto rx=0x7fb6f000c5b0 tx=0x7fb6f0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:21.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.547+0000 7fb6ed7fa700 1 -- 172.21.15.133:0/3461536783 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0011590 con 0x7fb6f8144090 2023-10-08T16:10:21.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.547+0000 7fb6ed7fa700 1 -- 172.21.15.133:0/3461536783 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f0011710 con 0x7fb6f8144090 2023-10-08T16:10:21.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.547+0000 7fb6ff2af700 1 -- 172.21.15.133:0/3461536783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f80ac120 con 0x7fb6f8144090 2023-10-08T16:10:21.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.547+0000 7fb6ed7fa700 1 -- 172.21.15.133:0/3461536783 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0011ad0 con 0x7fb6f8144090 2023-10-08T16:10:21.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.547+0000 7fb6ff2af700 1 -- 172.21.15.133:0/3461536783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f80aa9f0 con 0x7fb6f8144090 2023-10-08T16:10:21.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.551+0000 7fb6ff2af700 1 -- 172.21.15.133:0/3461536783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6f80abf80 con 0x7fb6f8144090 2023-10-08T16:10:21.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.551+0000 7fb6ed7fa700 1 -- 172.21.15.133:0/3461536783 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb6f001c460 con 0x7fb6f8144090 2023-10-08T16:10:21.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.551+0000 7fb6ed7fa700 1 --2- 172.21.15.133:0/3461536783 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb6dc060550 0x7fb6dc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:21.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.551+0000 7fb6ed7fa700 1 -- 172.21.15.133:0/3461536783 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fb6f007c4a0 con 0x7fb6f8144090 2023-10-08T16:10:21.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.551+0000 7fb6fd04b700 1 --2- 172.21.15.133:0/3461536783 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb6dc060550 0x7fb6dc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:21.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.555+0000 7fb6fd04b700 1 --2- 172.21.15.133:0/3461536783 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb6dc060550 0x7fb6dc062a00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80039e0 tx=0x7fb6e8007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:21.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.559+0000 7fb6ed7fa700 1 -- 172.21.15.133:0/3461536783 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb6f80abf80 con 0x7fb6f8144090 2023-10-08T16:10:21.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.715+0000 7fb6ff2af700 1 -- 172.21.15.133:0/3461536783 --> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb6f813e460 con 0x7fb6dc060550 2023-10-08T16:10:21.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.731+0000 7fb6ed7fa700 1 -- 172.21.15.133:0/3461536783 <== mgr.4104 v2:172.21.15.133:6832/33362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+291749 (secure 0 0 0) 0x7fb6f813e460 con 0x7fb6dc060550 2023-10-08T16:10:21.742 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:10:21.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.739+0000 7fb6ff2af700 1 -- 172.21.15.133:0/3461536783 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb6dc060550 msgr2=0x7fb6dc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:21.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.739+0000 7fb6ff2af700 1 --2- 172.21.15.133:0/3461536783 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb6dc060550 0x7fb6dc062a00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80039e0 tx=0x7fb6e8007ec0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.739+0000 7fb6ff2af700 1 -- 172.21.15.133:0/3461536783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6f8144090 msgr2=0x7fb6f8137e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:21.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.739+0000 7fb6ff2af700 1 --2- 172.21.15.133:0/3461536783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6f8144090 0x7fb6f8137e70 secure :-1 s=READY pgs=4411 cs=0 l=1 rev1=1 crypto rx=0x7fb6f000c5b0 tx=0x7fb6f0007f60 comp rx=0 tx=0).stop 2023-10-08T16:10:21.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.739+0000 7fb6ff2af700 1 -- 172.21.15.133:0/3461536783 shutdown_connections 2023-10-08T16:10:21.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.739+0000 7fb6ff2af700 1 --2- 172.21.15.133:0/3461536783 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fb6dc060550 0x7fb6dc062a00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.739+0000 7fb6ff2af700 1 --2- 172.21.15.133:0/3461536783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6f8144090 0x7fb6f8137e70 unknown :-1 s=CLOSED pgs=4411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.739+0000 7fb6ff2af700 1 --2- 172.21.15.133:0/3461536783 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6f80ae560 0x7fb6f80acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.739+0000 7fb6ff2af700 1 --2- 172.21.15.133:0/3461536783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6f80ae190 0x7fb6f80ac640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.739+0000 7fb6ff2af700 1 -- 172.21.15.133:0/3461536783 >> 172.21.15.133:0/3461536783 conn(0x7fb6f80b4ba0 msgr2=0x7fb6f8139fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:21.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.739+0000 7fb6ff2af700 1 -- 172.21.15.133:0/3461536783 shutdown_connections 2023-10-08T16:10:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:21.739+0000 7fb6ff2af700 1 -- 172.21.15.133:0/3461536783 wait complete. 2023-10-08T16:10:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-10-08T16:10:21.756 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":209,"stamp":"2023-10-08T16:10:20.961988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":85845472,"num_objects":127,"num_object_clones":21,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":8,"num_read":209,"num_read_kb":442,"num_write":18242,"num_write_kb":96383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56037,"ondisk_log_size":56037,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2622268,"kb_used_data":170236,"kb_used_omap":0,"kb_used_meta":2451968,"kb_avail":752352452,"statfs":{"total":773094113280,"available":770408910848,"internally_reserved":0,"allocated":174321664,"data_stored":172654185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2510815232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004015"},"pg_stats":[{"pgid":"3.3f","version":"28'511","reported_seq":580,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650801+0000","last_change":"2023-10-08T16:08:50.725515+0000","last_active":"2023-10-08T16:09:06.650801+0000","last_peered":"2023-10-08T16:09:06.650801+0000","last_clean":"2023-10-08T16:09:06.650801+0000","last_became_active":"2023-10-08T16:04:17.626468+0000","last_became_peered":"2023-10-08T16:04:17.626468+0000","last_unstale":"2023-10-08T16:09:06.650801+0000","last_undegraded":"2023-10-08T16:09:06.650801+0000","last_fullsized":"2023-10-08T16:09:06.650801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012965628,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"28'502","reported_seq":581,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:30.128019+0000","last_change":"2023-10-08T16:09:30.127903+0000","last_active":"2023-10-08T16:09:30.128019+0000","last_peered":"2023-10-08T16:09:30.128019+0000","last_clean":"2023-10-08T16:09:30.128019+0000","last_became_active":"2023-10-08T16:04:17.623968+0000","last_became_peered":"2023-10-08T16:04:17.623968+0000","last_unstale":"2023-10-08T16:09:30.128019+0000","last_undegraded":"2023-10-08T16:09:30.128019+0000","last_fullsized":"2023-10-08T16:09:30.128019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'502","last_scrub_stamp":"2023-10-08T16:09:30.127492+0000","last_deep_scrub":"28'502","last_deep_scrub_stamp":"2023-10-08T16:09:30.127492+0000","last_clean_scrub_stamp":"2023-10-08T16:09:30.127492+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:10:49.129682+0000","scrub_duration":0.0045437120000000001,"objects_trimmed":0,"snaptrim_duration":0.025754998000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"28'751","reported_seq":829,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:35.484095+0000","last_change":"2023-10-08T16:09:35.483973+0000","last_active":"2023-10-08T16:09:35.484095+0000","last_peered":"2023-10-08T16:09:35.484095+0000","last_clean":"2023-10-08T16:09:35.484095+0000","last_became_active":"2023-10-08T16:04:17.624219+0000","last_became_peered":"2023-10-08T16:04:17.624219+0000","last_unstale":"2023-10-08T16:09:35.484095+0000","last_undegraded":"2023-10-08T16:09:35.484095+0000","last_fullsized":"2023-10-08T16:09:35.484095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'751","last_scrub_stamp":"2023-10-08T16:09:35.483714+0000","last_deep_scrub":"28'751","last_deep_scrub_stamp":"2023-10-08T16:09:35.483714+0000","last_clean_scrub_stamp":"2023-10-08T16:09:35.483714+0000","objects_scrubbed":2,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:53.398487+0000","scrub_duration":0.0086411349999999994,"objects_trimmed":0,"snaptrim_duration":0.046708411999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'449","reported_seq":528,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:10:14.800639+0000","last_change":"2023-10-08T16:10:14.800565+0000","last_active":"2023-10-08T16:10:14.800639+0000","last_peered":"2023-10-08T16:10:14.800639+0000","last_clean":"2023-10-08T16:10:14.800639+0000","last_became_active":"2023-10-08T16:04:17.628308+0000","last_became_peered":"2023-10-08T16:04:17.628308+0000","last_unstale":"2023-10-08T16:10:14.800639+0000","last_undegraded":"2023-10-08T16:10:14.800639+0000","last_fullsized":"2023-10-08T16:10:14.800639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'449","last_scrub_stamp":"2023-10-08T16:10:14.800314+0000","last_deep_scrub":"28'449","last_deep_scrub_stamp":"2023-10-08T16:10:14.800314+0000","last_clean_scrub_stamp":"2023-10-08T16:10:14.800314+0000","objects_scrubbed":2,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:15.849656+0000","scrub_duration":0.0088619600000000003,"objects_trimmed":0,"snaptrim_duration":0.019603182,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'459","reported_seq":537,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:10:13.887408+0000","last_change":"2023-10-08T16:10:13.887374+0000","last_active":"2023-10-08T16:10:13.887408+0000","last_peered":"2023-10-08T16:10:13.887408+0000","last_clean":"2023-10-08T16:10:13.887408+0000","last_became_active":"2023-10-08T16:04:17.625650+0000","last_became_peered":"2023-10-08T16:04:17.625650+0000","last_unstale":"2023-10-08T16:10:13.887408+0000","last_undegraded":"2023-10-08T16:10:13.887408+0000","last_fullsized":"2023-10-08T16:10:13.887408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'459","last_scrub_stamp":"2023-10-08T16:10:13.887259+0000","last_deep_scrub":"28'459","last_deep_scrub_stamp":"2023-10-08T16:10:13.887259+0000","last_clean_scrub_stamp":"2023-10-08T16:10:13.887259+0000","objects_scrubbed":3,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:38.350036+0000","scrub_duration":0.010932637,"objects_trimmed":0,"snaptrim_duration":0.013008828,"stat_sum":{"num_bytes":4107,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'641","reported_seq":717,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:32.516400+0000","last_change":"2023-10-08T16:09:32.516346+0000","last_active":"2023-10-08T16:09:32.516400+0000","last_peered":"2023-10-08T16:09:32.516400+0000","last_clean":"2023-10-08T16:09:32.516400+0000","last_became_active":"2023-10-08T16:04:59.029141+0000","last_became_peered":"2023-10-08T16:04:59.029141+0000","last_unstale":"2023-10-08T16:09:32.516400+0000","last_undegraded":"2023-10-08T16:09:32.516400+0000","last_fullsized":"2023-10-08T16:09:32.516400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'641","last_scrub_stamp":"2023-10-08T16:09:32.516164+0000","last_deep_scrub":"28'641","last_deep_scrub_stamp":"2023-10-08T16:09:32.516164+0000","last_clean_scrub_stamp":"2023-10-08T16:09:32.516164+0000","objects_scrubbed":3,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:50.430937+0000","scrub_duration":0.011603842,"objects_trimmed":0,"snaptrim_duration":0.010017161,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"28'440","reported_seq":519,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:10:16.840860+0000","last_change":"2023-10-08T16:10:16.840793+0000","last_active":"2023-10-08T16:10:16.840860+0000","last_peered":"2023-10-08T16:10:16.840860+0000","last_clean":"2023-10-08T16:10:16.840860+0000","last_became_active":"2023-10-08T16:04:17.631722+0000","last_became_peered":"2023-10-08T16:04:17.631722+0000","last_unstale":"2023-10-08T16:10:16.840860+0000","last_undegraded":"2023-10-08T16:10:16.840860+0000","last_fullsized":"2023-10-08T16:10:16.840860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'440","last_scrub_stamp":"2023-10-08T16:10:16.840548+0000","last_deep_scrub":"28'440","last_deep_scrub_stamp":"2023-10-08T16:10:16.840548+0000","last_clean_scrub_stamp":"2023-10-08T16:10:16.840548+0000","objects_scrubbed":1,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:36.913300+0000","scrub_duration":0.0086399219999999995,"objects_trimmed":0,"snaptrim_duration":0.010482406,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'608","reported_seq":686,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:57.209488+0000","last_change":"2023-10-08T16:09:57.209435+0000","last_active":"2023-10-08T16:09:57.209488+0000","last_peered":"2023-10-08T16:09:57.209488+0000","last_clean":"2023-10-08T16:09:57.209488+0000","last_became_active":"2023-10-08T16:04:17.628987+0000","last_became_peered":"2023-10-08T16:04:17.628987+0000","last_unstale":"2023-10-08T16:09:57.209488+0000","last_undegraded":"2023-10-08T16:09:57.209488+0000","last_fullsized":"2023-10-08T16:09:57.209488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'608","last_scrub_stamp":"2023-10-08T16:09:57.209140+0000","last_deep_scrub":"28'608","last_deep_scrub_stamp":"2023-10-08T16:09:57.209140+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.209140+0000","objects_scrubbed":2,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:44:58.041057+0000","scrub_duration":0.0098542950000000008,"objects_trimmed":0,"snaptrim_duration":0.011543940000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"28'702","reported_seq":771,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:06.650879+0000","last_change":"2023-10-08T16:08:50.727041+0000","last_active":"2023-10-08T16:09:06.650879+0000","last_peered":"2023-10-08T16:09:06.650879+0000","last_clean":"2023-10-08T16:09:06.650879+0000","last_became_active":"2023-10-08T16:04:17.636350+0000","last_became_peered":"2023-10-08T16:04:17.636350+0000","last_unstale":"2023-10-08T16:09:06.650879+0000","last_undegraded":"2023-10-08T16:09:06.650879+0000","last_fullsized":"2023-10-08T16:09:06.650879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:04:16.621866+0000","last_clean_scrub_stamp":"2023-10-08T16:04:16.621866+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014319053,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'949","reported_seq":1038,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:50.476019+0000","last_change":"2023-10-08T16:09:50.475967+0000","last_active":"2023-10-08T16:09:50.476019+0000","last_peered":"2023-10-08T16:09:50.476019+0000","last_clean":"2023-10-08T16:09:50.476019+0000","last_became_active":"2023-10-08T16:04:58.696602+0000","last_became_peered":"2023-10-08T16:04:58.696602+0000","last_unstale":"2023-10-08T16:09:50.476019+0000","last_undegraded":"2023-10-08T16:09:50.476019+0000","last_fullsized":"2023-10-08T16:09:50.476019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'949","last_scrub_stamp":"2023-10-08T16:09:50.475774+0000","last_deep_scrub":"28'949","last_deep_scrub_stamp":"2023-10-08T16:09:50.475774+0000","last_clean_scrub_stamp":"2023-10-08T16:09:50.475774+0000","objects_scrubbed":3,"log_size":949,"log_dups_size":0,"ondisk_log_size":949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:44:51.307691+0000","scrub_duration":0.012602917,"objects_trimmed":0,"snaptrim_duration":0.014587116000000001,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"28'517","reported_seq":596,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:30.599563+0000","last_change":"2023-10-08T16:09:30.599506+0000","last_active":"2023-10-08T16:09:30.599563+0000","last_peered":"2023-10-08T16:09:30.599563+0000","last_clean":"2023-10-08T16:09:30.599563+0000","last_became_active":"2023-10-08T16:04:17.627965+0000","last_became_peered":"2023-10-08T16:04:17.627965+0000","last_unstale":"2023-10-08T16:09:30.599563+0000","last_undegraded":"2023-10-08T16:09:30.599563+0000","last_fullsized":"2023-10-08T16:09:30.599563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'517","last_scrub_stamp":"2023-10-08T16:09:30.599375+0000","last_deep_scrub":"28'517","last_deep_scrub_stamp":"2023-10-08T16:09:30.599375+0000","last_clean_scrub_stamp":"2023-10-08T16:09:30.599375+0000","objects_scrubbed":2,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:41.494405+0000","scrub_duration":0.0091910640000000005,"objects_trimmed":0,"snaptrim_duration":0.012809017000000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'623","reported_seq":702,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:38.311592+0000","last_change":"2023-10-08T16:09:38.311514+0000","last_active":"2023-10-08T16:09:38.311592+0000","last_peered":"2023-10-08T16:09:38.311592+0000","last_clean":"2023-10-08T16:09:38.311592+0000","last_became_active":"2023-10-08T16:04:17.616988+0000","last_became_peered":"2023-10-08T16:04:17.616988+0000","last_unstale":"2023-10-08T16:09:38.311592+0000","last_undegraded":"2023-10-08T16:09:38.311592+0000","last_fullsized":"2023-10-08T16:09:38.311592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'623","last_scrub_stamp":"2023-10-08T16:09:38.311231+0000","last_deep_scrub":"28'623","last_deep_scrub_stamp":"2023-10-08T16:09:38.311231+0000","last_clean_scrub_stamp":"2023-10-08T16:09:38.311231+0000","objects_scrubbed":1,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:47.744886+0000","scrub_duration":0.0086635310000000004,"objects_trimmed":0,"snaptrim_duration":0.010221923000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"28'578","reported_seq":657,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:55.221676+0000","last_change":"2023-10-08T16:09:55.221607+0000","last_active":"2023-10-08T16:09:55.221676+0000","last_peered":"2023-10-08T16:09:55.221676+0000","last_clean":"2023-10-08T16:09:55.221676+0000","last_became_active":"2023-10-08T16:04:17.625529+0000","last_became_peered":"2023-10-08T16:04:17.625529+0000","last_unstale":"2023-10-08T16:09:55.221676+0000","last_undegraded":"2023-10-08T16:09:55.221676+0000","last_fullsized":"2023-10-08T16:09:55.221676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'578","last_scrub_stamp":"2023-10-08T16:09:55.221325+0000","last_deep_scrub":"28'578","last_deep_scrub_stamp":"2023-10-08T16:09:55.221325+0000","last_clean_scrub_stamp":"2023-10-08T16:09:55.221325+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:26.913449+0000","scrub_duration":0.0041477520000000002,"objects_trimmed":0,"snaptrim_duration":0.011264827,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"28'490","reported_seq":569,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:52.501976+0000","last_change":"2023-10-08T16:09:52.501907+0000","last_active":"2023-10-08T16:09:52.501976+0000","last_peered":"2023-10-08T16:09:52.501976+0000","last_clean":"2023-10-08T16:09:52.501976+0000","last_became_active":"2023-10-08T16:04:17.624197+0000","last_became_peered":"2023-10-08T16:04:17.624197+0000","last_unstale":"2023-10-08T16:09:52.501976+0000","last_undegraded":"2023-10-08T16:09:52.501976+0000","last_fullsized":"2023-10-08T16:09:52.501976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'490","last_scrub_stamp":"2023-10-08T16:09:52.501658+0000","last_deep_scrub":"28'490","last_deep_scrub_stamp":"2023-10-08T16:09:52.501658+0000","last_clean_scrub_stamp":"2023-10-08T16:09:52.501658+0000","objects_scrubbed":1,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:14.404964+0000","scrub_duration":0.0083187469999999996,"objects_trimmed":0,"snaptrim_duration":0.037453408000000001,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"28'589","reported_seq":668,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:34.179421+0000","last_change":"2023-10-08T16:09:34.179325+0000","last_active":"2023-10-08T16:09:34.179421+0000","last_peered":"2023-10-08T16:09:34.179421+0000","last_clean":"2023-10-08T16:09:34.179421+0000","last_became_active":"2023-10-08T16:04:17.620391+0000","last_became_peered":"2023-10-08T16:04:17.620391+0000","last_unstale":"2023-10-08T16:09:34.179421+0000","last_undegraded":"2023-10-08T16:09:34.179421+0000","last_fullsized":"2023-10-08T16:09:34.179421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'589","last_scrub_stamp":"2023-10-08T16:09:34.178927+0000","last_deep_scrub":"28'589","last_deep_scrub_stamp":"2023-10-08T16:09:34.178927+0000","last_clean_scrub_stamp":"2023-10-08T16:09:34.178927+0000","objects_scrubbed":3,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:45.073957+0000","scrub_duration":0.011898857000000001,"objects_trimmed":0,"snaptrim_duration":0.029228837000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"28'653","reported_seq":731,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:54.884913+0000","last_change":"2023-10-08T16:09:54.884880+0000","last_active":"2023-10-08T16:09:54.884913+0000","last_peered":"2023-10-08T16:09:54.884913+0000","last_clean":"2023-10-08T16:09:54.884913+0000","last_became_active":"2023-10-08T16:04:17.619843+0000","last_became_peered":"2023-10-08T16:04:17.619843+0000","last_unstale":"2023-10-08T16:09:54.884913+0000","last_undegraded":"2023-10-08T16:09:54.884913+0000","last_fullsized":"2023-10-08T16:09:54.884913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'653","last_scrub_stamp":"2023-10-08T16:09:54.884763+0000","last_deep_scrub":"28'653","last_deep_scrub_stamp":"2023-10-08T16:09:54.884763+0000","last_clean_scrub_stamp":"2023-10-08T16:09:54.884763+0000","objects_scrubbed":3,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:44:55.716680+0000","scrub_duration":0.012931170000000001,"objects_trimmed":0,"snaptrim_duration":0.018851915,"stat_sum":{"num_bytes":4105,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"28'622","reported_seq":701,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:47.835072+0000","last_change":"2023-10-08T16:09:47.834951+0000","last_active":"2023-10-08T16:09:47.835072+0000","last_peered":"2023-10-08T16:09:47.835072+0000","last_clean":"2023-10-08T16:09:47.835072+0000","last_became_active":"2023-10-08T16:04:17.625580+0000","last_became_peered":"2023-10-08T16:04:17.625580+0000","last_unstale":"2023-10-08T16:09:47.835072+0000","last_undegraded":"2023-10-08T16:09:47.835072+0000","last_fullsized":"2023-10-08T16:09:47.835072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'622","last_scrub_stamp":"2023-10-08T16:09:47.834643+0000","last_deep_scrub":"28'622","last_deep_scrub_stamp":"2023-10-08T16:09:47.834643+0000","last_clean_scrub_stamp":"2023-10-08T16:09:47.834643+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:31.816880+0000","scrub_duration":0.0043267050000000001,"objects_trimmed":0,"snaptrim_duration":0.018077737,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"28'592","reported_seq":670,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:31.535573+0000","last_change":"2023-10-08T16:09:31.535491+0000","last_active":"2023-10-08T16:09:31.535573+0000","last_peered":"2023-10-08T16:09:31.535573+0000","last_clean":"2023-10-08T16:09:31.535573+0000","last_became_active":"2023-10-08T16:04:17.627197+0000","last_became_peered":"2023-10-08T16:04:17.627197+0000","last_unstale":"2023-10-08T16:09:31.535573+0000","last_undegraded":"2023-10-08T16:09:31.535573+0000","last_fullsized":"2023-10-08T16:09:31.535573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'592","last_scrub_stamp":"2023-10-08T16:09:31.535221+0000","last_deep_scrub":"28'592","last_deep_scrub_stamp":"2023-10-08T16:09:31.535221+0000","last_clean_scrub_stamp":"2023-10-08T16:09:31.535221+0000","objects_scrubbed":3,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:56:01.556005+0000","scrub_duration":0.011238002,"objects_trimmed":0,"snaptrim_duration":0.0098294880000000008,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"28'596","reported_seq":675,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.806907+0000","last_change":"2023-10-08T16:09:20.806843+0000","last_active":"2023-10-08T16:09:20.806907+0000","last_peered":"2023-10-08T16:09:20.806907+0000","last_clean":"2023-10-08T16:09:20.806907+0000","last_became_active":"2023-10-08T16:04:17.625586+0000","last_became_peered":"2023-10-08T16:04:17.625586+0000","last_unstale":"2023-10-08T16:09:20.806907+0000","last_undegraded":"2023-10-08T16:09:20.806907+0000","last_fullsized":"2023-10-08T16:09:20.806907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'596","last_scrub_stamp":"2023-10-08T16:09:20.806564+0000","last_deep_scrub":"28'596","last_deep_scrub_stamp":"2023-10-08T16:09:20.806564+0000","last_clean_scrub_stamp":"2023-10-08T16:09:20.806564+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:23:55.634452+0000","scrub_duration":0.0041559450000000003,"objects_trimmed":0,"snaptrim_duration":0.014288673999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"28'769","reported_seq":848,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:41.498245+0000","last_change":"2023-10-08T16:09:41.498186+0000","last_active":"2023-10-08T16:09:41.498245+0000","last_peered":"2023-10-08T16:09:41.498245+0000","last_clean":"2023-10-08T16:09:41.498245+0000","last_became_active":"2023-10-08T16:04:17.623200+0000","last_became_peered":"2023-10-08T16:04:17.623200+0000","last_unstale":"2023-10-08T16:09:41.498245+0000","last_undegraded":"2023-10-08T16:09:41.498245+0000","last_fullsized":"2023-10-08T16:09:41.498245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'769","last_scrub_stamp":"2023-10-08T16:09:41.497942+0000","last_deep_scrub":"28'769","last_deep_scrub_stamp":"2023-10-08T16:09:41.497942+0000","last_clean_scrub_stamp":"2023-10-08T16:09:41.497942+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:03.401248+0000","scrub_duration":0.003618137,"objects_trimmed":0,"snaptrim_duration":0.012983668,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"28'728","reported_seq":808,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:41.451273+0000","last_change":"2023-10-08T16:09:41.451236+0000","last_active":"2023-10-08T16:09:41.451273+0000","last_peered":"2023-10-08T16:09:41.451273+0000","last_clean":"2023-10-08T16:09:41.451273+0000","last_became_active":"2023-10-08T16:04:17.623945+0000","last_became_peered":"2023-10-08T16:04:17.623945+0000","last_unstale":"2023-10-08T16:09:41.451273+0000","last_undegraded":"2023-10-08T16:09:41.451273+0000","last_fullsized":"2023-10-08T16:09:41.451273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'728","last_scrub_stamp":"2023-10-08T16:09:41.451100+0000","last_deep_scrub":"28'728","last_deep_scrub_stamp":"2023-10-08T16:09:41.451100+0000","last_clean_scrub_stamp":"2023-10-08T16:09:41.451100+0000","objects_scrubbed":3,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:52.346129+0000","scrub_duration":0.011054777,"objects_trimmed":0,"snaptrim_duration":0.045353759,"stat_sum":{"num_bytes":4128,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"28'834","reported_seq":936,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:10:11.806510+0000","last_change":"2023-10-08T16:10:11.806472+0000","last_active":"2023-10-08T16:10:11.806510+0000","last_peered":"2023-10-08T16:10:11.806510+0000","last_clean":"2023-10-08T16:10:11.806510+0000","last_became_active":"2023-10-08T16:04:17.623904+0000","last_became_peered":"2023-10-08T16:04:17.623904+0000","last_unstale":"2023-10-08T16:10:11.806510+0000","last_undegraded":"2023-10-08T16:10:11.806510+0000","last_fullsized":"2023-10-08T16:10:11.806510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'834","last_scrub_stamp":"2023-10-08T16:10:11.806315+0000","last_deep_scrub":"28'834","last_deep_scrub_stamp":"2023-10-08T16:10:11.806315+0000","last_clean_scrub_stamp":"2023-10-08T16:10:11.806315+0000","objects_scrubbed":5,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:52.187983+0000","scrub_duration":0.014588156,"objects_trimmed":0,"snaptrim_duration":0.019052278999999998,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":25,"num_read_kb":20,"num_write":31,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'551","reported_seq":629,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:50.248063+0000","last_change":"2023-10-08T16:09:50.247957+0000","last_active":"2023-10-08T16:09:50.248063+0000","last_peered":"2023-10-08T16:09:50.248063+0000","last_clean":"2023-10-08T16:09:50.248063+0000","last_became_active":"2023-10-08T16:04:17.618549+0000","last_became_peered":"2023-10-08T16:04:17.618549+0000","last_unstale":"2023-10-08T16:09:50.248063+0000","last_undegraded":"2023-10-08T16:09:50.248063+0000","last_fullsized":"2023-10-08T16:09:50.248063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'551","last_scrub_stamp":"2023-10-08T16:09:50.247593+0000","last_deep_scrub":"28'551","last_deep_scrub_stamp":"2023-10-08T16:09:50.247593+0000","last_clean_scrub_stamp":"2023-10-08T16:09:50.247593+0000","objects_scrubbed":2,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:34.229831+0000","scrub_duration":0.010229172,"objects_trimmed":0,"snaptrim_duration":0.011087115999999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'660","reported_seq":738,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:45.814537+0000","last_change":"2023-10-08T16:09:45.814414+0000","last_active":"2023-10-08T16:09:45.814537+0000","last_peered":"2023-10-08T16:09:45.814537+0000","last_clean":"2023-10-08T16:09:45.814537+0000","last_became_active":"2023-10-08T16:04:17.627673+0000","last_became_peered":"2023-10-08T16:04:17.627673+0000","last_unstale":"2023-10-08T16:09:45.814537+0000","last_undegraded":"2023-10-08T16:09:45.814537+0000","last_fullsized":"2023-10-08T16:09:45.814537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'660","last_scrub_stamp":"2023-10-08T16:09:45.814137+0000","last_deep_scrub":"28'660","last_deep_scrub_stamp":"2023-10-08T16:09:45.814137+0000","last_clean_scrub_stamp":"2023-10-08T16:09:45.814137+0000","objects_scrubbed":3,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:07.717443+0000","scrub_duration":0.011989448,"objects_trimmed":0,"snaptrim_duration":0.019445790000000001,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"28'469","reported_seq":548,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:54.253438+0000","last_change":"2023-10-08T16:09:54.253292+0000","last_active":"2023-10-08T16:09:54.253438+0000","last_peered":"2023-10-08T16:09:54.253438+0000","last_clean":"2023-10-08T16:09:54.253438+0000","last_became_active":"2023-10-08T16:04:17.628793+0000","last_became_peered":"2023-10-08T16:04:17.628793+0000","last_unstale":"2023-10-08T16:09:54.253438+0000","last_undegraded":"2023-10-08T16:09:54.253438+0000","last_fullsized":"2023-10-08T16:09:54.253438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'469","last_scrub_stamp":"2023-10-08T16:09:54.253036+0000","last_deep_scrub":"28'469","last_deep_scrub_stamp":"2023-10-08T16:09:54.253036+0000","last_clean_scrub_stamp":"2023-10-08T16:09:54.253036+0000","objects_scrubbed":1,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:41:08.525515+0000","scrub_duration":0.0082754100000000004,"objects_trimmed":0,"snaptrim_duration":0.011350429,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"28'660","reported_seq":739,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:48.513950+0000","last_change":"2023-10-08T16:09:48.513876+0000","last_active":"2023-10-08T16:09:48.513950+0000","last_peered":"2023-10-08T16:09:48.513950+0000","last_clean":"2023-10-08T16:09:48.513950+0000","last_became_active":"2023-10-08T16:04:17.625220+0000","last_became_peered":"2023-10-08T16:04:17.625220+0000","last_unstale":"2023-10-08T16:09:48.513950+0000","last_undegraded":"2023-10-08T16:09:48.513950+0000","last_fullsized":"2023-10-08T16:09:48.513950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'660","last_scrub_stamp":"2023-10-08T16:09:48.513639+0000","last_deep_scrub":"28'660","last_deep_scrub_stamp":"2023-10-08T16:09:48.513639+0000","last_clean_scrub_stamp":"2023-10-08T16:09:48.513639+0000","objects_scrubbed":1,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:20.205763+0000","scrub_duration":0.0082496940000000001,"objects_trimmed":0,"snaptrim_duration":0.013452108000000001,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'351","reported_seq":430,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:32.175421+0000","last_change":"2023-10-08T16:09:32.175337+0000","last_active":"2023-10-08T16:09:32.175421+0000","last_peered":"2023-10-08T16:09:32.175421+0000","last_clean":"2023-10-08T16:09:32.175421+0000","last_became_active":"2023-10-08T16:04:17.629574+0000","last_became_peered":"2023-10-08T16:04:17.629574+0000","last_unstale":"2023-10-08T16:09:32.175421+0000","last_undegraded":"2023-10-08T16:09:32.175421+0000","last_fullsized":"2023-10-08T16:09:32.175421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'351","last_scrub_stamp":"2023-10-08T16:09:32.175035+0000","last_deep_scrub":"28'351","last_deep_scrub_stamp":"2023-10-08T16:09:32.175035+0000","last_clean_scrub_stamp":"2023-10-08T16:09:32.175035+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:49.594680+0000","scrub_duration":0.0040114620000000004,"objects_trimmed":0,"snaptrim_duration":0.024743081,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"28'585","reported_seq":664,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:48.174872+0000","last_change":"2023-10-08T16:09:48.174762+0000","last_active":"2023-10-08T16:09:48.174872+0000","last_peered":"2023-10-08T16:09:48.174872+0000","last_clean":"2023-10-08T16:09:48.174872+0000","last_became_active":"2023-10-08T16:04:17.626420+0000","last_became_peered":"2023-10-08T16:04:17.626420+0000","last_unstale":"2023-10-08T16:09:48.174872+0000","last_undegraded":"2023-10-08T16:09:48.174872+0000","last_fullsized":"2023-10-08T16:09:48.174872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'585","last_scrub_stamp":"2023-10-08T16:09:48.174483+0000","last_deep_scrub":"28'585","last_deep_scrub_stamp":"2023-10-08T16:09:48.174483+0000","last_clean_scrub_stamp":"2023-10-08T16:09:48.174483+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:10.077789+0000","scrub_duration":0.0041598870000000001,"objects_trimmed":0,"snaptrim_duration":0.011442964999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'586","reported_seq":665,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:39.418064+0000","last_change":"2023-10-08T16:09:39.417990+0000","last_active":"2023-10-08T16:09:39.418064+0000","last_peered":"2023-10-08T16:09:39.418064+0000","last_clean":"2023-10-08T16:09:39.418064+0000","last_became_active":"2023-10-08T16:04:17.618207+0000","last_became_peered":"2023-10-08T16:04:17.618207+0000","last_unstale":"2023-10-08T16:09:39.418064+0000","last_undegraded":"2023-10-08T16:09:39.418064+0000","last_fullsized":"2023-10-08T16:09:39.418064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'586","last_scrub_stamp":"2023-10-08T16:09:39.417718+0000","last_deep_scrub":"28'586","last_deep_scrub_stamp":"2023-10-08T16:09:39.417718+0000","last_clean_scrub_stamp":"2023-10-08T16:09:39.417718+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:56.837364+0000","scrub_duration":0.0037683299999999999,"objects_trimmed":0,"snaptrim_duration":0.042752309000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"28'403","reported_seq":482,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:51.836016+0000","last_change":"2023-10-08T16:09:51.835933+0000","last_active":"2023-10-08T16:09:51.836016+0000","last_peered":"2023-10-08T16:09:51.836016+0000","last_clean":"2023-10-08T16:09:51.836016+0000","last_became_active":"2023-10-08T16:04:17.627093+0000","last_became_peered":"2023-10-08T16:04:17.627093+0000","last_unstale":"2023-10-08T16:09:51.836016+0000","last_undegraded":"2023-10-08T16:09:51.836016+0000","last_fullsized":"2023-10-08T16:09:51.836016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'403","last_scrub_stamp":"2023-10-08T16:09:51.835660+0000","last_deep_scrub":"28'403","last_deep_scrub_stamp":"2023-10-08T16:09:51.835660+0000","last_clean_scrub_stamp":"2023-10-08T16:09:51.835660+0000","objects_scrubbed":2,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:41:06.108139+0000","scrub_duration":0.0092781470000000005,"objects_trimmed":0,"snaptrim_duration":0.020438813,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"28'946","reported_seq":1024,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:28.533253+0000","last_change":"2023-10-08T16:09:28.533141+0000","last_active":"2023-10-08T16:09:28.533253+0000","last_peered":"2023-10-08T16:09:28.533253+0000","last_clean":"2023-10-08T16:09:28.533253+0000","last_became_active":"2023-10-08T16:04:17.629049+0000","last_became_peered":"2023-10-08T16:04:17.629049+0000","last_unstale":"2023-10-08T16:09:28.533253+0000","last_undegraded":"2023-10-08T16:09:28.533253+0000","last_fullsized":"2023-10-08T16:09:28.533253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'946","last_scrub_stamp":"2023-10-08T16:09:28.532841+0000","last_deep_scrub":"28'946","last_deep_scrub_stamp":"2023-10-08T16:09:28.532841+0000","last_clean_scrub_stamp":"2023-10-08T16:09:28.532841+0000","objects_scrubbed":5,"log_size":946,"log_dups_size":0,"ondisk_log_size":946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:37.966495+0000","scrub_duration":0.013109762,"objects_trimmed":0,"snaptrim_duration":0.01455822,"stat_sum":{"num_bytes":8206,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"28'746","reported_seq":825,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:47.488412+0000","last_change":"2023-10-08T16:09:47.488342+0000","last_active":"2023-10-08T16:09:47.488412+0000","last_peered":"2023-10-08T16:09:47.488412+0000","last_clean":"2023-10-08T16:09:47.488412+0000","last_became_active":"2023-10-08T16:04:17.632012+0000","last_became_peered":"2023-10-08T16:04:17.632012+0000","last_unstale":"2023-10-08T16:09:47.488412+0000","last_undegraded":"2023-10-08T16:09:47.488412+0000","last_fullsized":"2023-10-08T16:09:47.488412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'746","last_scrub_stamp":"2023-10-08T16:09:47.488070+0000","last_deep_scrub":"28'746","last_deep_scrub_stamp":"2023-10-08T16:09:47.488070+0000","last_clean_scrub_stamp":"2023-10-08T16:09:47.488070+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:41:01.760549+0000","scrub_duration":0.0042972970000000003,"objects_trimmed":0,"snaptrim_duration":0.010590815999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"28'514","reported_seq":593,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:33.210343+0000","last_change":"2023-10-08T16:09:33.210256+0000","last_active":"2023-10-08T16:09:33.210343+0000","last_peered":"2023-10-08T16:09:33.210343+0000","last_clean":"2023-10-08T16:09:33.210343+0000","last_became_active":"2023-10-08T16:04:17.623220+0000","last_became_peered":"2023-10-08T16:04:17.623220+0000","last_unstale":"2023-10-08T16:09:33.210343+0000","last_undegraded":"2023-10-08T16:09:33.210343+0000","last_fullsized":"2023-10-08T16:09:33.210343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'514","last_scrub_stamp":"2023-10-08T16:09:33.209999+0000","last_deep_scrub":"28'514","last_deep_scrub_stamp":"2023-10-08T16:09:33.209999+0000","last_clean_scrub_stamp":"2023-10-08T16:09:33.209999+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:59.313227+0000","scrub_duration":0.0040553860000000002,"objects_trimmed":0,"snaptrim_duration":0.010375987999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'748","reported_seq":777,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:21.543351+0000","last_change":"2023-10-08T16:09:21.543315+0000","last_active":"2023-10-08T16:09:21.543351+0000","last_peered":"2023-10-08T16:09:21.543351+0000","last_clean":"2023-10-08T16:09:21.543351+0000","last_became_active":"2023-10-08T16:04:16.660183+0000","last_became_peered":"2023-10-08T16:04:16.660183+0000","last_unstale":"2023-10-08T16:09:21.543351+0000","last_undegraded":"2023-10-08T16:09:21.543351+0000","last_fullsized":"2023-10-08T16:09:21.543351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'748","last_scrub_stamp":"2023-10-08T16:09:21.543182+0000","last_deep_scrub":"28'748","last_deep_scrub_stamp":"2023-10-08T16:09:21.543182+0000","last_clean_scrub_stamp":"2023-10-08T16:09:21.543182+0000","objects_scrubbed":1,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:24.849342+0000","scrub_duration":0.022119043000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":743,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'638","reported_seq":717,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:36.437028+0000","last_change":"2023-10-08T16:09:36.436892+0000","last_active":"2023-10-08T16:09:36.437028+0000","last_peered":"2023-10-08T16:09:36.437028+0000","last_clean":"2023-10-08T16:09:36.437028+0000","last_became_active":"2023-10-08T16:04:17.620532+0000","last_became_peered":"2023-10-08T16:04:17.620532+0000","last_unstale":"2023-10-08T16:09:36.437028+0000","last_undegraded":"2023-10-08T16:09:36.437028+0000","last_fullsized":"2023-10-08T16:09:36.437028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'638","last_scrub_stamp":"2023-10-08T16:09:36.436578+0000","last_deep_scrub":"28'638","last_deep_scrub_stamp":"2023-10-08T16:09:36.436578+0000","last_clean_scrub_stamp":"2023-10-08T16:09:36.436578+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:34.975714+0000","scrub_duration":0.0046835050000000001,"objects_trimmed":0,"snaptrim_duration":0.042650311000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"28'757","reported_seq":786,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:23.727018+0000","last_change":"2023-10-08T16:09:23.726922+0000","last_active":"2023-10-08T16:09:23.727018+0000","last_peered":"2023-10-08T16:09:23.727018+0000","last_clean":"2023-10-08T16:09:23.727018+0000","last_became_active":"2023-10-08T16:04:16.653936+0000","last_became_peered":"2023-10-08T16:04:16.653936+0000","last_unstale":"2023-10-08T16:09:23.727018+0000","last_undegraded":"2023-10-08T16:09:23.727018+0000","last_fullsized":"2023-10-08T16:09:23.727018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'757","last_scrub_stamp":"2023-10-08T16:09:23.726712+0000","last_deep_scrub":"28'757","last_deep_scrub_stamp":"2023-10-08T16:09:23.726712+0000","last_clean_scrub_stamp":"2023-10-08T16:09:23.726712+0000","objects_scrubbed":1,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:53.747495+0000","scrub_duration":0.024528384,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"28'11","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:25.609965+0000","last_change":"2023-10-08T16:09:25.609898+0000","last_active":"2023-10-08T16:09:25.609965+0000","last_peered":"2023-10-08T16:09:25.609965+0000","last_clean":"2023-10-08T16:09:25.609965+0000","last_became_active":"2023-10-08T16:04:16.656642+0000","last_became_peered":"2023-10-08T16:04:16.656642+0000","last_unstale":"2023-10-08T16:09:25.609965+0000","last_undegraded":"2023-10-08T16:09:25.609965+0000","last_fullsized":"2023-10-08T16:09:25.609965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2023-10-08T16:09:25.609667+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2023-10-08T16:09:25.609667+0000","last_clean_scrub_stamp":"2023-10-08T16:09:25.609667+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:35.043321+0000","scrub_duration":0.004097987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'648","reported_seq":725,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:47.346984+0000","last_change":"2023-10-08T16:09:47.346906+0000","last_active":"2023-10-08T16:09:47.346984+0000","last_peered":"2023-10-08T16:09:47.346984+0000","last_clean":"2023-10-08T16:09:47.346984+0000","last_became_active":"2023-10-08T16:04:59.029346+0000","last_became_peered":"2023-10-08T16:04:59.029346+0000","last_unstale":"2023-10-08T16:09:47.346984+0000","last_undegraded":"2023-10-08T16:09:47.346984+0000","last_fullsized":"2023-10-08T16:09:47.346984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'648","last_scrub_stamp":"2023-10-08T16:09:47.346655+0000","last_deep_scrub":"28'648","last_deep_scrub_stamp":"2023-10-08T16:09:47.346655+0000","last_clean_scrub_stamp":"2023-10-08T16:09:47.346655+0000","objects_scrubbed":1,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:31.328893+0000","scrub_duration":0.0074831120000000001,"objects_trimmed":0,"snaptrim_duration":0.024714613999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'1528","reported_seq":1557,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:27.726484+0000","last_change":"2023-10-08T16:09:27.726436+0000","last_active":"2023-10-08T16:09:27.726484+0000","last_peered":"2023-10-08T16:09:27.726484+0000","last_clean":"2023-10-08T16:09:27.726484+0000","last_became_active":"2023-10-08T16:04:16.651258+0000","last_became_peered":"2023-10-08T16:04:16.651258+0000","last_unstale":"2023-10-08T16:09:27.726484+0000","last_undegraded":"2023-10-08T16:09:27.726484+0000","last_fullsized":"2023-10-08T16:09:27.726484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1528","last_scrub_stamp":"2023-10-08T16:09:27.726254+0000","last_deep_scrub":"28'1528","last_deep_scrub_stamp":"2023-10-08T16:09:27.726254+0000","last_clean_scrub_stamp":"2023-10-08T16:09:27.726254+0000","objects_scrubbed":2,"log_size":1528,"log_dups_size":0,"ondisk_log_size":1528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:45.641026+0000","scrub_duration":0.043874232999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1522,"num_write_kb":8929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"28'757","reported_seq":836,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:45.382828+0000","last_change":"2023-10-08T16:09:45.382718+0000","last_active":"2023-10-08T16:09:45.382828+0000","last_peered":"2023-10-08T16:09:45.382828+0000","last_clean":"2023-10-08T16:09:45.382828+0000","last_became_active":"2023-10-08T16:04:17.629765+0000","last_became_peered":"2023-10-08T16:04:17.629765+0000","last_unstale":"2023-10-08T16:09:45.382828+0000","last_undegraded":"2023-10-08T16:09:45.382828+0000","last_fullsized":"2023-10-08T16:09:45.382828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'757","last_scrub_stamp":"2023-10-08T16:09:45.382402+0000","last_deep_scrub":"28'757","last_deep_scrub_stamp":"2023-10-08T16:09:45.382402+0000","last_clean_scrub_stamp":"2023-10-08T16:09:45.382402+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:07.285707+0000","scrub_duration":0.0038822510000000002,"objects_trimmed":0,"snaptrim_duration":0.026861545000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'13","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:26.641725+0000","last_change":"2023-10-08T16:09:26.641657+0000","last_active":"2023-10-08T16:09:26.641725+0000","last_peered":"2023-10-08T16:09:26.641725+0000","last_clean":"2023-10-08T16:09:26.641725+0000","last_became_active":"2023-10-08T16:04:16.654002+0000","last_became_peered":"2023-10-08T16:04:16.654002+0000","last_unstale":"2023-10-08T16:09:26.641725+0000","last_undegraded":"2023-10-08T16:09:26.641725+0000","last_fullsized":"2023-10-08T16:09:26.641725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2023-10-08T16:09:26.641400+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2023-10-08T16:09:26.641400+0000","last_clean_scrub_stamp":"2023-10-08T16:09:26.641400+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:10:45.643591+0000","scrub_duration":0.0040653290000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"28'597","reported_seq":675,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:52.864482+0000","last_change":"2023-10-08T16:09:52.864379+0000","last_active":"2023-10-08T16:09:52.864482+0000","last_peered":"2023-10-08T16:09:52.864482+0000","last_clean":"2023-10-08T16:09:52.864482+0000","last_became_active":"2023-10-08T16:04:17.624071+0000","last_became_peered":"2023-10-08T16:04:17.624071+0000","last_unstale":"2023-10-08T16:09:52.864482+0000","last_undegraded":"2023-10-08T16:09:52.864482+0000","last_fullsized":"2023-10-08T16:09:52.864482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'597","last_scrub_stamp":"2023-10-08T16:09:52.863956+0000","last_deep_scrub":"28'597","last_deep_scrub_stamp":"2023-10-08T16:09:52.863956+0000","last_clean_scrub_stamp":"2023-10-08T16:09:52.863956+0000","objects_scrubbed":2,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:24.556080+0000","scrub_duration":0.010737066999999999,"objects_trimmed":0,"snaptrim_duration":0.018261580999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"26'15","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:28.703566+0000","last_change":"2023-10-08T16:09:28.703480+0000","last_active":"2023-10-08T16:09:28.703566+0000","last_peered":"2023-10-08T16:09:28.703566+0000","last_clean":"2023-10-08T16:09:28.703566+0000","last_became_active":"2023-10-08T16:04:16.656992+0000","last_became_peered":"2023-10-08T16:04:16.656992+0000","last_unstale":"2023-10-08T16:09:28.703566+0000","last_undegraded":"2023-10-08T16:09:28.703566+0000","last_fullsized":"2023-10-08T16:09:28.703566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'15","last_scrub_stamp":"2023-10-08T16:09:28.703215+0000","last_deep_scrub":"26'15","last_deep_scrub_stamp":"2023-10-08T16:09:28.703215+0000","last_clean_scrub_stamp":"2023-10-08T16:09:28.703215+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:27.242351+0000","scrub_duration":0.003527681,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"28'498","reported_seq":577,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:37.423510+0000","last_change":"2023-10-08T16:09:37.423417+0000","last_active":"2023-10-08T16:09:37.423510+0000","last_peered":"2023-10-08T16:09:37.423510+0000","last_clean":"2023-10-08T16:09:37.423510+0000","last_became_active":"2023-10-08T16:04:17.621862+0000","last_became_peered":"2023-10-08T16:04:17.621862+0000","last_unstale":"2023-10-08T16:09:37.423510+0000","last_undegraded":"2023-10-08T16:09:37.423510+0000","last_fullsized":"2023-10-08T16:09:37.423510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'498","last_scrub_stamp":"2023-10-08T16:09:37.423145+0000","last_deep_scrub":"28'498","last_deep_scrub_stamp":"2023-10-08T16:09:37.423145+0000","last_clean_scrub_stamp":"2023-10-08T16:09:37.423145+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:10:56.425335+0000","scrub_duration":0.0043366359999999996,"objects_trimmed":0,"snaptrim_duration":0.045929303999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"28'56","reported_seq":85,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:28.186088+0000","last_change":"2023-10-08T16:09:28.186016+0000","last_active":"2023-10-08T16:09:28.186088+0000","last_peered":"2023-10-08T16:09:28.186088+0000","last_clean":"2023-10-08T16:09:28.186088+0000","last_became_active":"2023-10-08T16:04:16.656041+0000","last_became_peered":"2023-10-08T16:04:16.656041+0000","last_unstale":"2023-10-08T16:09:28.186088+0000","last_undegraded":"2023-10-08T16:09:28.186088+0000","last_fullsized":"2023-10-08T16:09:28.186088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'56","last_scrub_stamp":"2023-10-08T16:09:28.185753+0000","last_deep_scrub":"28'56","last_deep_scrub_stamp":"2023-10-08T16:09:28.185753+0000","last_clean_scrub_stamp":"2023-10-08T16:09:28.185753+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:46.100526+0000","scrub_duration":0.0085979019999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'579","reported_seq":658,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:34.260199+0000","last_change":"2023-10-08T16:09:34.260069+0000","last_active":"2023-10-08T16:09:34.260199+0000","last_peered":"2023-10-08T16:09:34.260199+0000","last_clean":"2023-10-08T16:09:34.260199+0000","last_became_active":"2023-10-08T16:04:17.620654+0000","last_became_peered":"2023-10-08T16:04:17.620654+0000","last_unstale":"2023-10-08T16:09:34.260199+0000","last_undegraded":"2023-10-08T16:09:34.260199+0000","last_fullsized":"2023-10-08T16:09:34.260199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'579","last_scrub_stamp":"2023-10-08T16:09:34.259764+0000","last_deep_scrub":"28'579","last_deep_scrub_stamp":"2023-10-08T16:09:34.259764+0000","last_clean_scrub_stamp":"2023-10-08T16:09:34.259764+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:20:52.892594+0000","scrub_duration":0.0038350179999999999,"objects_trimmed":0,"snaptrim_duration":0.010626305000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"28'805","reported_seq":834,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:28.611581+0000","last_change":"2023-10-08T16:09:28.611547+0000","last_active":"2023-10-08T16:09:28.611581+0000","last_peered":"2023-10-08T16:09:28.611581+0000","last_clean":"2023-10-08T16:09:28.611581+0000","last_became_active":"2023-10-08T16:04:16.653001+0000","last_became_peered":"2023-10-08T16:04:16.653001+0000","last_unstale":"2023-10-08T16:09:28.611581+0000","last_undegraded":"2023-10-08T16:09:28.611581+0000","last_fullsized":"2023-10-08T16:09:28.611581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'805","last_scrub_stamp":"2023-10-08T16:09:28.611394+0000","last_deep_scrub":"28'805","last_deep_scrub_stamp":"2023-10-08T16:09:28.611394+0000","last_clean_scrub_stamp":"2023-10-08T16:09:28.611394+0000","objects_scrubbed":4,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:46.031039+0000","scrub_duration":0.025885490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194948,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":797,"num_write_kb":4446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"28'523","reported_seq":602,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:10:17.801220+0000","last_change":"2023-10-08T16:10:17.801121+0000","last_active":"2023-10-08T16:10:17.801220+0000","last_peered":"2023-10-08T16:10:17.801220+0000","last_clean":"2023-10-08T16:10:17.801220+0000","last_became_active":"2023-10-08T16:04:17.631130+0000","last_became_peered":"2023-10-08T16:04:17.631130+0000","last_unstale":"2023-10-08T16:10:17.801220+0000","last_undegraded":"2023-10-08T16:10:17.801220+0000","last_fullsized":"2023-10-08T16:10:17.801220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'523","last_scrub_stamp":"2023-10-08T16:10:17.800860+0000","last_deep_scrub":"28'523","last_deep_scrub_stamp":"2023-10-08T16:10:17.800860+0000","last_clean_scrub_stamp":"2023-10-08T16:10:17.800860+0000","objects_scrubbed":1,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:26.277062+0000","scrub_duration":0.0092025270000000003,"objects_trimmed":0,"snaptrim_duration":0.013318705,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"28'1516","reported_seq":1545,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:19.369792+0000","last_change":"2023-10-08T16:09:19.369726+0000","last_active":"2023-10-08T16:09:19.369792+0000","last_peered":"2023-10-08T16:09:19.369792+0000","last_clean":"2023-10-08T16:09:19.369792+0000","last_became_active":"2023-10-08T16:04:16.660830+0000","last_became_peered":"2023-10-08T16:04:16.660830+0000","last_unstale":"2023-10-08T16:09:19.369792+0000","last_undegraded":"2023-10-08T16:09:19.369792+0000","last_fullsized":"2023-10-08T16:09:19.369792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1516","last_scrub_stamp":"2023-10-08T16:09:19.369511+0000","last_deep_scrub":"28'1516","last_deep_scrub_stamp":"2023-10-08T16:09:19.369511+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.369511+0000","objects_scrubbed":4,"log_size":1516,"log_dups_size":0,"ondisk_log_size":1516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:32:53.363596+0000","scrub_duration":0.042270937000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1505,"num_write_kb":8987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"28'654","reported_seq":733,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:25.411523+0000","last_change":"2023-10-08T16:09:25.411435+0000","last_active":"2023-10-08T16:09:25.411523+0000","last_peered":"2023-10-08T16:09:25.411523+0000","last_clean":"2023-10-08T16:09:25.411523+0000","last_became_active":"2023-10-08T16:04:17.623038+0000","last_became_peered":"2023-10-08T16:04:17.623038+0000","last_unstale":"2023-10-08T16:09:25.411523+0000","last_undegraded":"2023-10-08T16:09:25.411523+0000","last_fullsized":"2023-10-08T16:09:25.411523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'654","last_scrub_stamp":"2023-10-08T16:09:25.411173+0000","last_deep_scrub":"28'654","last_deep_scrub_stamp":"2023-10-08T16:09:25.411173+0000","last_clean_scrub_stamp":"2023-10-08T16:09:25.411173+0000","objects_scrubbed":2,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:28.717332+0000","scrub_duration":0.010251712,"objects_trimmed":0,"snaptrim_duration":0.045488809999999998,"stat_sum":{"num_bytes":4107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"26'14","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:29.695218+0000","last_change":"2023-10-08T16:09:29.695141+0000","last_active":"2023-10-08T16:09:29.695218+0000","last_peered":"2023-10-08T16:09:29.695218+0000","last_clean":"2023-10-08T16:09:29.695218+0000","last_became_active":"2023-10-08T16:04:16.649675+0000","last_became_peered":"2023-10-08T16:04:16.649675+0000","last_unstale":"2023-10-08T16:09:29.695218+0000","last_undegraded":"2023-10-08T16:09:29.695218+0000","last_fullsized":"2023-10-08T16:09:29.695218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'14","last_scrub_stamp":"2023-10-08T16:09:29.694856+0000","last_deep_scrub":"26'14","last_deep_scrub_stamp":"2023-10-08T16:09:29.694856+0000","last_clean_scrub_stamp":"2023-10-08T16:09:29.694856+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:35:23.444046+0000","scrub_duration":0.0044355009999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'966","reported_seq":1045,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:46.764417+0000","last_change":"2023-10-08T16:09:46.764296+0000","last_active":"2023-10-08T16:09:46.764417+0000","last_peered":"2023-10-08T16:09:46.764417+0000","last_clean":"2023-10-08T16:09:46.764417+0000","last_became_active":"2023-10-08T16:04:17.628865+0000","last_became_peered":"2023-10-08T16:04:17.628865+0000","last_unstale":"2023-10-08T16:09:46.764417+0000","last_undegraded":"2023-10-08T16:09:46.764417+0000","last_fullsized":"2023-10-08T16:09:46.764417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'966","last_scrub_stamp":"2023-10-08T16:09:46.764005+0000","last_deep_scrub":"28'966","last_deep_scrub_stamp":"2023-10-08T16:09:46.764005+0000","last_clean_scrub_stamp":"2023-10-08T16:09:46.764005+0000","objects_scrubbed":0,"log_size":966,"log_dups_size":0,"ondisk_log_size":966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:44:47.595922+0000","scrub_duration":0.0036926429999999998,"objects_trimmed":0,"snaptrim_duration":0.013199152,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"27'12","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:24.699933+0000","last_change":"2023-10-08T16:09:24.699855+0000","last_active":"2023-10-08T16:09:24.699933+0000","last_peered":"2023-10-08T16:09:24.699933+0000","last_clean":"2023-10-08T16:09:24.699933+0000","last_became_active":"2023-10-08T16:04:16.653342+0000","last_became_peered":"2023-10-08T16:04:16.653342+0000","last_unstale":"2023-10-08T16:09:24.699933+0000","last_undegraded":"2023-10-08T16:09:24.699933+0000","last_fullsized":"2023-10-08T16:09:24.699933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2023-10-08T16:09:24.699597+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2023-10-08T16:09:24.699597+0000","last_clean_scrub_stamp":"2023-10-08T16:09:24.699597+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:42.614369+0000","scrub_duration":0.003422217,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"28'290","reported_seq":369,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:29.576032+0000","last_change":"2023-10-08T16:09:29.575956+0000","last_active":"2023-10-08T16:09:29.576032+0000","last_peered":"2023-10-08T16:09:29.576032+0000","last_clean":"2023-10-08T16:09:29.576032+0000","last_became_active":"2023-10-08T16:04:17.624454+0000","last_became_peered":"2023-10-08T16:04:17.624454+0000","last_unstale":"2023-10-08T16:09:29.576032+0000","last_undegraded":"2023-10-08T16:09:29.576032+0000","last_fullsized":"2023-10-08T16:09:29.576032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'290","last_scrub_stamp":"2023-10-08T16:09:29.575702+0000","last_deep_scrub":"28'290","last_deep_scrub_stamp":"2023-10-08T16:09:29.575702+0000","last_clean_scrub_stamp":"2023-10-08T16:09:29.575702+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:58.715495+0000","scrub_duration":0.0044317380000000002,"objects_trimmed":0,"snaptrim_duration":0.012620849,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"28'26","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:25.562641+0000","last_change":"2023-10-08T16:09:25.562521+0000","last_active":"2023-10-08T16:09:25.562641+0000","last_peered":"2023-10-08T16:09:25.562641+0000","last_clean":"2023-10-08T16:09:25.562641+0000","last_became_active":"2023-10-08T16:04:16.658886+0000","last_became_peered":"2023-10-08T16:04:16.658886+0000","last_unstale":"2023-10-08T16:09:25.562641+0000","last_undegraded":"2023-10-08T16:09:25.562641+0000","last_fullsized":"2023-10-08T16:09:25.562641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'26","last_scrub_stamp":"2023-10-08T16:09:25.562132+0000","last_deep_scrub":"28'26","last_deep_scrub_stamp":"2023-10-08T16:09:25.562132+0000","last_clean_scrub_stamp":"2023-10-08T16:09:25.562132+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:37:32.665776+0000","scrub_duration":0.011851375000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"28'592","reported_seq":671,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:10:08.879397+0000","last_change":"2023-10-08T16:10:08.879341+0000","last_active":"2023-10-08T16:10:08.879397+0000","last_peered":"2023-10-08T16:10:08.879397+0000","last_clean":"2023-10-08T16:10:08.879397+0000","last_became_active":"2023-10-08T16:04:17.628605+0000","last_became_peered":"2023-10-08T16:04:17.628605+0000","last_unstale":"2023-10-08T16:10:08.879397+0000","last_undegraded":"2023-10-08T16:10:08.879397+0000","last_fullsized":"2023-10-08T16:10:08.879397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'592","last_scrub_stamp":"2023-10-08T16:10:08.879079+0000","last_deep_scrub":"28'592","last_deep_scrub_stamp":"2023-10-08T16:10:08.879079+0000","last_clean_scrub_stamp":"2023-10-08T16:10:08.879079+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:09.928420+0000","scrub_duration":0.0047537439999999999,"objects_trimmed":0,"snaptrim_duration":0.013094041000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'19","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:29.245466+0000","last_change":"2023-10-08T16:09:29.245405+0000","last_active":"2023-10-08T16:09:29.245466+0000","last_peered":"2023-10-08T16:09:29.245466+0000","last_clean":"2023-10-08T16:09:29.245466+0000","last_became_active":"2023-10-08T16:04:16.660651+0000","last_became_peered":"2023-10-08T16:04:16.660651+0000","last_unstale":"2023-10-08T16:09:29.245466+0000","last_undegraded":"2023-10-08T16:09:29.245466+0000","last_fullsized":"2023-10-08T16:09:29.245466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'19","last_scrub_stamp":"2023-10-08T16:09:29.245108+0000","last_deep_scrub":"28'19","last_deep_scrub_stamp":"2023-10-08T16:09:29.245108+0000","last_clean_scrub_stamp":"2023-10-08T16:09:29.245108+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:33:03.239192+0000","scrub_duration":0.0073818440000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"28'296","reported_seq":375,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:44.799671+0000","last_change":"2023-10-08T16:09:44.799601+0000","last_active":"2023-10-08T16:09:44.799671+0000","last_peered":"2023-10-08T16:09:44.799671+0000","last_clean":"2023-10-08T16:09:44.799671+0000","last_became_active":"2023-10-08T16:04:17.628701+0000","last_became_peered":"2023-10-08T16:04:17.628701+0000","last_unstale":"2023-10-08T16:09:44.799671+0000","last_undegraded":"2023-10-08T16:09:44.799671+0000","last_fullsized":"2023-10-08T16:09:44.799671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'296","last_scrub_stamp":"2023-10-08T16:09:44.799289+0000","last_deep_scrub":"28'296","last_deep_scrub_stamp":"2023-10-08T16:09:44.799289+0000","last_clean_scrub_stamp":"2023-10-08T16:09:44.799289+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:16.491413+0000","scrub_duration":0.0039462280000000004,"objects_trimmed":0,"snaptrim_duration":0.012739413999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'278","reported_seq":307,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:24.541205+0000","last_change":"2023-10-08T16:09:24.541140+0000","last_active":"2023-10-08T16:09:24.541205+0000","last_peered":"2023-10-08T16:09:24.541205+0000","last_clean":"2023-10-08T16:09:24.541205+0000","last_became_active":"2023-10-08T16:04:16.651709+0000","last_became_peered":"2023-10-08T16:04:16.651709+0000","last_unstale":"2023-10-08T16:09:24.541205+0000","last_undegraded":"2023-10-08T16:09:24.541205+0000","last_fullsized":"2023-10-08T16:09:24.541205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'278","last_scrub_stamp":"2023-10-08T16:09:24.540994+0000","last_deep_scrub":"28'278","last_deep_scrub_stamp":"2023-10-08T16:09:24.540994+0000","last_clean_scrub_stamp":"2023-10-08T16:09:24.540994+0000","objects_scrubbed":2,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:20:43.173823+0000","scrub_duration":0.020437908000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"28'662","reported_seq":740,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:10:10.906245+0000","last_change":"2023-10-08T16:10:10.906181+0000","last_active":"2023-10-08T16:10:10.906245+0000","last_peered":"2023-10-08T16:10:10.906245+0000","last_clean":"2023-10-08T16:10:10.906245+0000","last_became_active":"2023-10-08T16:04:17.630908+0000","last_became_peered":"2023-10-08T16:04:17.630908+0000","last_unstale":"2023-10-08T16:10:10.906245+0000","last_undegraded":"2023-10-08T16:10:10.906245+0000","last_fullsized":"2023-10-08T16:10:10.906245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'662","last_scrub_stamp":"2023-10-08T16:10:10.905939+0000","last_deep_scrub":"28'662","last_deep_scrub_stamp":"2023-10-08T16:10:10.905939+0000","last_clean_scrub_stamp":"2023-10-08T16:10:10.905939+0000","objects_scrubbed":2,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:52:06.408074+0000","scrub_duration":0.010987073999999999,"objects_trimmed":0,"snaptrim_duration":0.014318363000000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"28'766","reported_seq":795,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:21.169223+0000","last_change":"2023-10-08T16:09:21.169188+0000","last_active":"2023-10-08T16:09:21.169223+0000","last_peered":"2023-10-08T16:09:21.169223+0000","last_clean":"2023-10-08T16:09:21.169223+0000","last_became_active":"2023-10-08T16:04:16.655245+0000","last_became_peered":"2023-10-08T16:04:16.655245+0000","last_unstale":"2023-10-08T16:09:21.169223+0000","last_undegraded":"2023-10-08T16:09:21.169223+0000","last_fullsized":"2023-10-08T16:09:21.169223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'766","last_scrub_stamp":"2023-10-08T16:09:21.169034+0000","last_deep_scrub":"28'766","last_deep_scrub_stamp":"2023-10-08T16:09:21.169034+0000","last_clean_scrub_stamp":"2023-10-08T16:09:21.169034+0000","objects_scrubbed":2,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:37:28.272678+0000","scrub_duration":0.023529600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":759,"num_write_kb":4511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"28'465","reported_seq":544,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:32.759016+0000","last_change":"2023-10-08T16:09:32.758894+0000","last_active":"2023-10-08T16:09:32.759016+0000","last_peered":"2023-10-08T16:09:32.759016+0000","last_clean":"2023-10-08T16:09:32.759016+0000","last_became_active":"2023-10-08T16:04:17.627369+0000","last_became_peered":"2023-10-08T16:04:17.627369+0000","last_unstale":"2023-10-08T16:09:32.759016+0000","last_undegraded":"2023-10-08T16:09:32.759016+0000","last_fullsized":"2023-10-08T16:09:32.759016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'465","last_scrub_stamp":"2023-10-08T16:09:32.758612+0000","last_deep_scrub":"28'465","last_deep_scrub_stamp":"2023-10-08T16:09:32.758612+0000","last_clean_scrub_stamp":"2023-10-08T16:09:32.758612+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:50:17.550433+0000","scrub_duration":0.0040334330000000003,"objects_trimmed":0,"snaptrim_duration":0.020078136999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"28'12","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:23.499905+0000","last_change":"2023-10-08T16:09:23.499833+0000","last_active":"2023-10-08T16:09:23.499905+0000","last_peered":"2023-10-08T16:09:23.499905+0000","last_clean":"2023-10-08T16:09:23.499905+0000","last_became_active":"2023-10-08T16:04:16.654124+0000","last_became_peered":"2023-10-08T16:04:16.654124+0000","last_unstale":"2023-10-08T16:09:23.499905+0000","last_undegraded":"2023-10-08T16:09:23.499905+0000","last_fullsized":"2023-10-08T16:09:23.499905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2023-10-08T16:09:23.499570+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2023-10-08T16:09:23.499570+0000","last_clean_scrub_stamp":"2023-10-08T16:09:23.499570+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:49.602798+0000","scrub_duration":0.0041480989999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'569","reported_seq":646,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:33.468529+0000","last_change":"2023-10-08T16:09:33.468457+0000","last_active":"2023-10-08T16:09:33.468529+0000","last_peered":"2023-10-08T16:09:33.468529+0000","last_clean":"2023-10-08T16:09:33.468529+0000","last_became_active":"2023-10-08T16:04:58.693477+0000","last_became_peered":"2023-10-08T16:04:58.693477+0000","last_unstale":"2023-10-08T16:09:33.468529+0000","last_undegraded":"2023-10-08T16:09:33.468529+0000","last_fullsized":"2023-10-08T16:09:33.468529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'569","last_scrub_stamp":"2023-10-08T16:09:33.468193+0000","last_deep_scrub":"28'569","last_deep_scrub_stamp":"2023-10-08T16:09:33.468193+0000","last_clean_scrub_stamp":"2023-10-08T16:09:33.468193+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:32.007329+0000","scrub_duration":0.0039894070000000004,"objects_trimmed":0,"snaptrim_duration":0.0094988650000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":184,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:22.835688+0000","last_change":"2023-10-08T16:09:22.835644+0000","last_active":"2023-10-08T16:09:22.835688+0000","last_peered":"2023-10-08T16:09:22.835688+0000","last_clean":"2023-10-08T16:09:22.835688+0000","last_became_active":"2023-10-08T16:04:06.368022+0000","last_became_peered":"2023-10-08T16:04:06.368022+0000","last_unstale":"2023-10-08T16:09:22.835688+0000","last_undegraded":"2023-10-08T16:09:22.835688+0000","last_fullsized":"2023-10-08T16:09:22.835688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2023-10-08T16:09:22.835476+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2023-10-08T16:09:22.835476+0000","last_clean_scrub_stamp":"2023-10-08T16:09:22.835476+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:21.374611+0000","scrub_duration":0.013473255999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"28'13","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:22.681945+0000","last_change":"2023-10-08T16:09:22.681883+0000","last_active":"2023-10-08T16:09:22.681945+0000","last_peered":"2023-10-08T16:09:22.681945+0000","last_clean":"2023-10-08T16:09:22.681945+0000","last_became_active":"2023-10-08T16:04:16.646086+0000","last_became_peered":"2023-10-08T16:04:16.646086+0000","last_unstale":"2023-10-08T16:09:22.681945+0000","last_undegraded":"2023-10-08T16:09:22.681945+0000","last_fullsized":"2023-10-08T16:09:22.681945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2023-10-08T16:09:22.681612+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2023-10-08T16:09:22.681612+0000","last_clean_scrub_stamp":"2023-10-08T16:09:22.681612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:32.115267+0000","scrub_duration":0.0043686569999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'510","reported_seq":589,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:35.338576+0000","last_change":"2023-10-08T16:09:35.338451+0000","last_active":"2023-10-08T16:09:35.338576+0000","last_peered":"2023-10-08T16:09:35.338576+0000","last_clean":"2023-10-08T16:09:35.338576+0000","last_became_active":"2023-10-08T16:04:17.629127+0000","last_became_peered":"2023-10-08T16:04:17.629127+0000","last_unstale":"2023-10-08T16:09:35.338576+0000","last_undegraded":"2023-10-08T16:09:35.338576+0000","last_fullsized":"2023-10-08T16:09:35.338576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'510","last_scrub_stamp":"2023-10-08T16:09:35.338140+0000","last_deep_scrub":"28'510","last_deep_scrub_stamp":"2023-10-08T16:09:35.338140+0000","last_clean_scrub_stamp":"2023-10-08T16:09:35.338140+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:50:20.129961+0000","scrub_duration":0.0040502020000000001,"objects_trimmed":0,"snaptrim_duration":0.011169416999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"28'1506","reported_seq":1535,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:25.858697+0000","last_change":"2023-10-08T16:09:25.858543+0000","last_active":"2023-10-08T16:09:25.858697+0000","last_peered":"2023-10-08T16:09:25.858697+0000","last_clean":"2023-10-08T16:09:25.858697+0000","last_became_active":"2023-10-08T16:04:16.661186+0000","last_became_peered":"2023-10-08T16:04:16.661186+0000","last_unstale":"2023-10-08T16:09:25.858697+0000","last_undegraded":"2023-10-08T16:09:25.858697+0000","last_fullsized":"2023-10-08T16:09:25.858697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1506","last_scrub_stamp":"2023-10-08T16:09:25.858210+0000","last_deep_scrub":"28'1506","last_deep_scrub_stamp":"2023-10-08T16:09:25.858210+0000","last_clean_scrub_stamp":"2023-10-08T16:09:25.858210+0000","objects_scrubbed":2,"log_size":1506,"log_dups_size":0,"ondisk_log_size":1506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:43.277855+0000","scrub_duration":0.039533828999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1499,"num_write_kb":8970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"28'493","reported_seq":572,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:34.511897+0000","last_change":"2023-10-08T16:09:34.511828+0000","last_active":"2023-10-08T16:09:34.511897+0000","last_peered":"2023-10-08T16:09:34.511897+0000","last_clean":"2023-10-08T16:09:34.511897+0000","last_became_active":"2023-10-08T16:04:17.615671+0000","last_became_peered":"2023-10-08T16:04:17.615671+0000","last_unstale":"2023-10-08T16:09:34.511897+0000","last_undegraded":"2023-10-08T16:09:34.511897+0000","last_fullsized":"2023-10-08T16:09:34.511897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'493","last_scrub_stamp":"2023-10-08T16:09:34.511546+0000","last_deep_scrub":"28'493","last_deep_scrub_stamp":"2023-10-08T16:09:34.511546+0000","last_clean_scrub_stamp":"2023-10-08T16:09:34.511546+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:56:04.532329+0000","scrub_duration":0.0042317580000000004,"objects_trimmed":0,"snaptrim_duration":0.043805617999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"28'75","reported_seq":166,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.438844+0000","last_change":"2023-10-08T16:09:20.438777+0000","last_active":"2023-10-08T16:09:20.438844+0000","last_peered":"2023-10-08T16:09:20.438844+0000","last_clean":"2023-10-08T16:09:20.438844+0000","last_became_active":"2023-10-08T16:04:16.654359+0000","last_became_peered":"2023-10-08T16:04:16.654359+0000","last_unstale":"2023-10-08T16:09:20.438844+0000","last_undegraded":"2023-10-08T16:09:20.438844+0000","last_fullsized":"2023-10-08T16:09:20.438844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-10-08T16:09:20.438516+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-10-08T16:09:20.438516+0000","last_clean_scrub_stamp":"2023-10-08T16:09:20.438516+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:18.855971+0000","scrub_duration":0.0049952249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":279988,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":321,"num_write":71,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'389","reported_seq":467,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:33.195937+0000","last_change":"2023-10-08T16:09:33.195879+0000","last_active":"2023-10-08T16:09:33.195937+0000","last_peered":"2023-10-08T16:09:33.195937+0000","last_clean":"2023-10-08T16:09:33.195937+0000","last_became_active":"2023-10-08T16:04:17.624876+0000","last_became_peered":"2023-10-08T16:04:17.624876+0000","last_unstale":"2023-10-08T16:09:33.195937+0000","last_undegraded":"2023-10-08T16:09:33.195937+0000","last_fullsized":"2023-10-08T16:09:33.195937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'389","last_scrub_stamp":"2023-10-08T16:09:33.195676+0000","last_deep_scrub":"28'389","last_deep_scrub_stamp":"2023-10-08T16:09:33.195676+0000","last_clean_scrub_stamp":"2023-10-08T16:09:33.195676+0000","objects_scrubbed":3,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:13:02.335470+0000","scrub_duration":0.010915272,"objects_trimmed":0,"snaptrim_duration":0.024289327999999999,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"28'1401","reported_seq":1430,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:26.761613+0000","last_change":"2023-10-08T16:09:26.761563+0000","last_active":"2023-10-08T16:09:26.761613+0000","last_peered":"2023-10-08T16:09:26.761613+0000","last_clean":"2023-10-08T16:09:26.761613+0000","last_became_active":"2023-10-08T16:04:16.654454+0000","last_became_peered":"2023-10-08T16:04:16.654454+0000","last_unstale":"2023-10-08T16:09:26.761613+0000","last_undegraded":"2023-10-08T16:09:26.761613+0000","last_fullsized":"2023-10-08T16:09:26.761613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1401","last_scrub_stamp":"2023-10-08T16:09:26.761369+0000","last_deep_scrub":"28'1401","last_deep_scrub_stamp":"2023-10-08T16:09:26.761369+0000","last_clean_scrub_stamp":"2023-10-08T16:09:26.761369+0000","objects_scrubbed":2,"log_size":1401,"log_dups_size":0,"ondisk_log_size":1401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:31.493587+0000","scrub_duration":0.039489099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1390,"num_write_kb":8905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"28'618","reported_seq":697,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:35.224258+0000","last_change":"2023-10-08T16:09:35.224192+0000","last_active":"2023-10-08T16:09:35.224258+0000","last_peered":"2023-10-08T16:09:35.224258+0000","last_clean":"2023-10-08T16:09:35.224258+0000","last_became_active":"2023-10-08T16:04:17.619294+0000","last_became_peered":"2023-10-08T16:04:17.619294+0000","last_unstale":"2023-10-08T16:09:35.224258+0000","last_undegraded":"2023-10-08T16:09:35.224258+0000","last_fullsized":"2023-10-08T16:09:35.224258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'618","last_scrub_stamp":"2023-10-08T16:09:35.223925+0000","last_deep_scrub":"28'618","last_deep_scrub_stamp":"2023-10-08T16:09:35.223925+0000","last_clean_scrub_stamp":"2023-10-08T16:09:35.223925+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:37:42.327569+0000","scrub_duration":0.0042708449999999997,"objects_trimmed":0,"snaptrim_duration":0.011233748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"27'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:24.162687+0000","last_change":"2023-10-08T16:09:24.162557+0000","last_active":"2023-10-08T16:09:24.162687+0000","last_peered":"2023-10-08T16:09:24.162687+0000","last_clean":"2023-10-08T16:09:24.162687+0000","last_became_active":"2023-10-08T16:04:16.661756+0000","last_became_peered":"2023-10-08T16:04:16.661756+0000","last_unstale":"2023-10-08T16:09:24.162687+0000","last_undegraded":"2023-10-08T16:09:24.162687+0000","last_fullsized":"2023-10-08T16:09:24.162687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-10-08T16:09:24.162263+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-10-08T16:09:24.162263+0000","last_clean_scrub_stamp":"2023-10-08T16:09:24.162263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:33.595918+0000","scrub_duration":0.0046575389999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"28'515","reported_seq":594,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:31.715455+0000","last_change":"2023-10-08T16:09:31.715390+0000","last_active":"2023-10-08T16:09:31.715455+0000","last_peered":"2023-10-08T16:09:31.715455+0000","last_clean":"2023-10-08T16:09:31.715455+0000","last_became_active":"2023-10-08T16:04:17.616348+0000","last_became_peered":"2023-10-08T16:04:17.616348+0000","last_unstale":"2023-10-08T16:09:31.715455+0000","last_undegraded":"2023-10-08T16:09:31.715455+0000","last_fullsized":"2023-10-08T16:09:31.715455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'515","last_scrub_stamp":"2023-10-08T16:09:31.715159+0000","last_deep_scrub":"28'515","last_deep_scrub_stamp":"2023-10-08T16:09:31.715159+0000","last_clean_scrub_stamp":"2023-10-08T16:09:31.715159+0000","objects_scrubbed":2,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:49.134804+0000","scrub_duration":0.0093125989999999995,"objects_trimmed":0,"snaptrim_duration":0.016977602000000001,"stat_sum":{"num_bytes":4107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"26'21","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:26.813271+0000","last_change":"2023-10-08T16:09:26.813177+0000","last_active":"2023-10-08T16:09:26.813271+0000","last_peered":"2023-10-08T16:09:26.813271+0000","last_clean":"2023-10-08T16:09:26.813271+0000","last_became_active":"2023-10-08T16:04:16.662446+0000","last_became_peered":"2023-10-08T16:04:16.662446+0000","last_unstale":"2023-10-08T16:09:26.813271+0000","last_undegraded":"2023-10-08T16:09:26.813271+0000","last_fullsized":"2023-10-08T16:09:26.813271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'21","last_scrub_stamp":"2023-10-08T16:09:26.812910+0000","last_deep_scrub":"26'21","last_deep_scrub_stamp":"2023-10-08T16:09:26.812910+0000","last_clean_scrub_stamp":"2023-10-08T16:09:26.812910+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:55.952703+0000","scrub_duration":0.0040640759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'606","reported_seq":685,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:29.158906+0000","last_change":"2023-10-08T16:09:29.158842+0000","last_active":"2023-10-08T16:09:29.158906+0000","last_peered":"2023-10-08T16:09:29.158906+0000","last_clean":"2023-10-08T16:09:29.158906+0000","last_became_active":"2023-10-08T16:04:17.624319+0000","last_became_peered":"2023-10-08T16:04:17.624319+0000","last_unstale":"2023-10-08T16:09:29.158906+0000","last_undegraded":"2023-10-08T16:09:29.158906+0000","last_fullsized":"2023-10-08T16:09:29.158906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'606","last_scrub_stamp":"2023-10-08T16:09:29.158591+0000","last_deep_scrub":"28'606","last_deep_scrub_stamp":"2023-10-08T16:09:29.158591+0000","last_clean_scrub_stamp":"2023-10-08T16:09:29.158591+0000","objects_scrubbed":2,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:27.697727+0000","scrub_duration":0.0096838069999999991,"objects_trimmed":0,"snaptrim_duration":0.024480915999999998,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"28'47","reported_seq":76,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:19.116634+0000","last_change":"2023-10-08T16:09:19.116588+0000","last_active":"2023-10-08T16:09:19.116634+0000","last_peered":"2023-10-08T16:09:19.116634+0000","last_clean":"2023-10-08T16:09:19.116634+0000","last_became_active":"2023-10-08T16:04:16.660704+0000","last_became_peered":"2023-10-08T16:04:16.660704+0000","last_unstale":"2023-10-08T16:09:19.116634+0000","last_undegraded":"2023-10-08T16:09:19.116634+0000","last_fullsized":"2023-10-08T16:09:19.116634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'47","last_scrub_stamp":"2023-10-08T16:09:19.116491+0000","last_deep_scrub":"28'47","last_deep_scrub_stamp":"2023-10-08T16:09:19.116491+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.116491+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:45.219718+0000","scrub_duration":0.003732735,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"28'626","reported_seq":705,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:31.471750+0000","last_change":"2023-10-08T16:09:31.471628+0000","last_active":"2023-10-08T16:09:31.471750+0000","last_peered":"2023-10-08T16:09:31.471750+0000","last_clean":"2023-10-08T16:09:31.471750+0000","last_became_active":"2023-10-08T16:04:17.631615+0000","last_became_peered":"2023-10-08T16:04:17.631615+0000","last_unstale":"2023-10-08T16:09:31.471750+0000","last_undegraded":"2023-10-08T16:09:31.471750+0000","last_fullsized":"2023-10-08T16:09:31.471750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'626","last_scrub_stamp":"2023-10-08T16:09:31.471310+0000","last_deep_scrub":"28'626","last_deep_scrub_stamp":"2023-10-08T16:09:31.471310+0000","last_clean_scrub_stamp":"2023-10-08T16:09:31.471310+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:30.010445+0000","scrub_duration":0.0043343189999999997,"objects_trimmed":0,"snaptrim_duration":0.011336120999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"28'13","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:25.681310+0000","last_change":"2023-10-08T16:09:25.681241+0000","last_active":"2023-10-08T16:09:25.681310+0000","last_peered":"2023-10-08T16:09:25.681310+0000","last_clean":"2023-10-08T16:09:25.681310+0000","last_became_active":"2023-10-08T16:04:16.659148+0000","last_became_peered":"2023-10-08T16:04:16.659148+0000","last_unstale":"2023-10-08T16:09:25.681310+0000","last_undegraded":"2023-10-08T16:09:25.681310+0000","last_fullsized":"2023-10-08T16:09:25.681310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2023-10-08T16:09:25.680987+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2023-10-08T16:09:25.680987+0000","last_clean_scrub_stamp":"2023-10-08T16:09:25.680987+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:24.220123+0000","scrub_duration":0.0066810940000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'437","reported_seq":517,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:54.420481+0000","last_change":"2023-10-08T16:09:54.420408+0000","last_active":"2023-10-08T16:09:54.420481+0000","last_peered":"2023-10-08T16:09:54.420481+0000","last_clean":"2023-10-08T16:09:54.420481+0000","last_became_active":"2023-10-08T16:04:17.624385+0000","last_became_peered":"2023-10-08T16:04:17.624385+0000","last_unstale":"2023-10-08T16:09:54.420481+0000","last_undegraded":"2023-10-08T16:09:54.420481+0000","last_fullsized":"2023-10-08T16:09:54.420481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'437","last_scrub_stamp":"2023-10-08T16:09:54.420134+0000","last_deep_scrub":"28'437","last_deep_scrub_stamp":"2023-10-08T16:09:54.420134+0000","last_clean_scrub_stamp":"2023-10-08T16:09:54.420134+0000","objects_scrubbed":1,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:38.402372+0000","scrub_duration":0.0077655099999999998,"objects_trimmed":0,"snaptrim_duration":0.044071592,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"28'759","reported_seq":788,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:43.804911+0000","last_change":"2023-10-08T16:09:43.804831+0000","last_active":"2023-10-08T16:09:43.804911+0000","last_peered":"2023-10-08T16:09:43.804911+0000","last_clean":"2023-10-08T16:09:43.804911+0000","last_became_active":"2023-10-08T16:04:16.662327+0000","last_became_peered":"2023-10-08T16:04:16.662327+0000","last_unstale":"2023-10-08T16:09:43.804911+0000","last_undegraded":"2023-10-08T16:09:43.804911+0000","last_fullsized":"2023-10-08T16:09:43.804911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'759","last_scrub_stamp":"2023-10-08T16:09:43.804549+0000","last_deep_scrub":"28'759","last_deep_scrub_stamp":"2023-10-08T16:09:43.804549+0000","last_clean_scrub_stamp":"2023-10-08T16:09:43.804549+0000","objects_scrubbed":1,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:58.077028+0000","scrub_duration":0.025817079,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":753,"num_write_kb":4504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'450","reported_seq":529,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:41.341168+0000","last_change":"2023-10-08T16:09:41.341044+0000","last_active":"2023-10-08T16:09:41.341168+0000","last_peered":"2023-10-08T16:09:41.341168+0000","last_clean":"2023-10-08T16:09:41.341168+0000","last_became_active":"2023-10-08T16:04:17.622898+0000","last_became_peered":"2023-10-08T16:04:17.622898+0000","last_unstale":"2023-10-08T16:09:41.341168+0000","last_undegraded":"2023-10-08T16:09:41.341168+0000","last_fullsized":"2023-10-08T16:09:41.341168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'450","last_scrub_stamp":"2023-10-08T16:09:41.340711+0000","last_deep_scrub":"28'450","last_deep_scrub_stamp":"2023-10-08T16:09:41.340711+0000","last_clean_scrub_stamp":"2023-10-08T16:09:41.340711+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:56:11.361494+0000","scrub_duration":0.0045819090000000003,"objects_trimmed":0,"snaptrim_duration":0.0075401410000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'10","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.131846+0000","last_change":"2023-10-08T16:09:20.131788+0000","last_active":"2023-10-08T16:09:20.131846+0000","last_peered":"2023-10-08T16:09:20.131846+0000","last_clean":"2023-10-08T16:09:20.131846+0000","last_became_active":"2023-10-08T16:04:16.661055+0000","last_became_peered":"2023-10-08T16:04:16.661055+0000","last_unstale":"2023-10-08T16:09:20.131846+0000","last_undegraded":"2023-10-08T16:09:20.131846+0000","last_fullsized":"2023-10-08T16:09:20.131846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2023-10-08T16:09:20.131603+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2023-10-08T16:09:20.131603+0000","last_clean_scrub_stamp":"2023-10-08T16:09:20.131603+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:20:38.764433+0000","scrub_duration":0.0035988970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"28'502","reported_seq":581,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:34.370256+0000","last_change":"2023-10-08T16:09:34.370190+0000","last_active":"2023-10-08T16:09:34.370256+0000","last_peered":"2023-10-08T16:09:34.370256+0000","last_clean":"2023-10-08T16:09:34.370256+0000","last_became_active":"2023-10-08T16:04:17.626991+0000","last_became_peered":"2023-10-08T16:04:17.626991+0000","last_unstale":"2023-10-08T16:09:34.370256+0000","last_undegraded":"2023-10-08T16:09:34.370256+0000","last_fullsized":"2023-10-08T16:09:34.370256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'502","last_scrub_stamp":"2023-10-08T16:09:34.369933+0000","last_deep_scrub":"28'502","last_deep_scrub_stamp":"2023-10-08T16:09:34.369933+0000","last_clean_scrub_stamp":"2023-10-08T16:09:34.369933+0000","objects_scrubbed":1,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:51.789578+0000","scrub_duration":0.0074754299999999999,"objects_trimmed":0,"snaptrim_duration":0.010148346000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'11","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:27.146089+0000","last_change":"2023-10-08T16:09:27.146023+0000","last_active":"2023-10-08T16:09:27.146089+0000","last_peered":"2023-10-08T16:09:27.146089+0000","last_clean":"2023-10-08T16:09:27.146089+0000","last_became_active":"2023-10-08T16:04:16.657299+0000","last_became_peered":"2023-10-08T16:04:16.657299+0000","last_unstale":"2023-10-08T16:09:27.146089+0000","last_undegraded":"2023-10-08T16:09:27.146089+0000","last_fullsized":"2023-10-08T16:09:27.146089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2023-10-08T16:09:27.145765+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2023-10-08T16:09:27.145765+0000","last_clean_scrub_stamp":"2023-10-08T16:09:27.145765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:57.166548+0000","scrub_duration":0.0039273509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"28'602","reported_seq":679,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:32.438112+0000","last_change":"2023-10-08T16:09:32.438015+0000","last_active":"2023-10-08T16:09:32.438112+0000","last_peered":"2023-10-08T16:09:32.438112+0000","last_clean":"2023-10-08T16:09:32.438112+0000","last_became_active":"2023-10-08T16:04:17.620693+0000","last_became_peered":"2023-10-08T16:04:17.620693+0000","last_unstale":"2023-10-08T16:09:32.438112+0000","last_undegraded":"2023-10-08T16:09:32.438112+0000","last_fullsized":"2023-10-08T16:09:32.438112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'602","last_scrub_stamp":"2023-10-08T16:09:32.437705+0000","last_deep_scrub":"28'602","last_deep_scrub_stamp":"2023-10-08T16:09:32.437705+0000","last_clean_scrub_stamp":"2023-10-08T16:09:32.437705+0000","objects_scrubbed":5,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:35:26.186896+0000","scrub_duration":0.016386810000000002,"objects_trimmed":0,"snaptrim_duration":0.011078684,"stat_sum":{"num_bytes":4121,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'99","reported_seq":128,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:23.883532+0000","last_change":"2023-10-08T16:09:23.883485+0000","last_active":"2023-10-08T16:09:23.883532+0000","last_peered":"2023-10-08T16:09:23.883532+0000","last_clean":"2023-10-08T16:09:23.883532+0000","last_became_active":"2023-10-08T16:04:16.663184+0000","last_became_peered":"2023-10-08T16:04:16.663184+0000","last_unstale":"2023-10-08T16:09:23.883532+0000","last_undegraded":"2023-10-08T16:09:23.883532+0000","last_fullsized":"2023-10-08T16:09:23.883532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'99","last_scrub_stamp":"2023-10-08T16:09:23.883297+0000","last_deep_scrub":"28'99","last_deep_scrub_stamp":"2023-10-08T16:09:23.883297+0000","last_clean_scrub_stamp":"2023-10-08T16:09:23.883297+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:10:42.885487+0000","scrub_duration":0.019422511,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":4152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"28'779","reported_seq":858,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:43.468265+0000","last_change":"2023-10-08T16:09:43.468204+0000","last_active":"2023-10-08T16:09:43.468265+0000","last_peered":"2023-10-08T16:09:43.468265+0000","last_clean":"2023-10-08T16:09:43.468265+0000","last_became_active":"2023-10-08T16:04:17.622898+0000","last_became_peered":"2023-10-08T16:04:17.622898+0000","last_unstale":"2023-10-08T16:09:43.468265+0000","last_undegraded":"2023-10-08T16:09:43.468265+0000","last_fullsized":"2023-10-08T16:09:43.468265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'779","last_scrub_stamp":"2023-10-08T16:09:43.467964+0000","last_deep_scrub":"28'779","last_deep_scrub_stamp":"2023-10-08T16:09:43.467964+0000","last_clean_scrub_stamp":"2023-10-08T16:09:43.467964+0000","objects_scrubbed":1,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:27.450202+0000","scrub_duration":0.0079618980000000002,"objects_trimmed":0,"snaptrim_duration":0.012379262,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"28'814","reported_seq":892,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:10:03.786231+0000","last_change":"2023-10-08T16:10:03.786162+0000","last_active":"2023-10-08T16:10:03.786231+0000","last_peered":"2023-10-08T16:10:03.786231+0000","last_clean":"2023-10-08T16:10:03.786231+0000","last_became_active":"2023-10-08T16:04:17.617179+0000","last_became_peered":"2023-10-08T16:04:17.617179+0000","last_unstale":"2023-10-08T16:10:03.786231+0000","last_undegraded":"2023-10-08T16:10:03.786231+0000","last_fullsized":"2023-10-08T16:10:03.786231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'814","last_scrub_stamp":"2023-10-08T16:10:03.785949+0000","last_deep_scrub":"28'814","last_deep_scrub_stamp":"2023-10-08T16:10:03.785949+0000","last_clean_scrub_stamp":"2023-10-08T16:10:03.785949+0000","objects_scrubbed":2,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:47.418292+0000","scrub_duration":0.01103617,"objects_trimmed":0,"snaptrim_duration":0.016893819000000001,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"28'2505","reported_seq":2534,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:27.835009+0000","last_change":"2023-10-08T16:09:27.834959+0000","last_active":"2023-10-08T16:09:27.835009+0000","last_peered":"2023-10-08T16:09:27.835009+0000","last_clean":"2023-10-08T16:09:27.835009+0000","last_became_active":"2023-10-08T16:04:16.661215+0000","last_became_peered":"2023-10-08T16:04:16.661215+0000","last_unstale":"2023-10-08T16:09:27.835009+0000","last_undegraded":"2023-10-08T16:09:27.835009+0000","last_fullsized":"2023-10-08T16:09:27.835009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2505","last_scrub_stamp":"2023-10-08T16:09:27.834807+0000","last_deep_scrub":"28'2505","last_deep_scrub_stamp":"2023-10-08T16:09:27.834807+0000","last_clean_scrub_stamp":"2023-10-08T16:09:27.834807+0000","objects_scrubbed":2,"log_size":2505,"log_dups_size":0,"ondisk_log_size":2505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:38.729836+0000","scrub_duration":0.024538131000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2502,"num_write_kb":5839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'614","reported_seq":692,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:10:06.763218+0000","last_change":"2023-10-08T16:10:06.763149+0000","last_active":"2023-10-08T16:10:06.763218+0000","last_peered":"2023-10-08T16:10:06.763218+0000","last_clean":"2023-10-08T16:10:06.763218+0000","last_became_active":"2023-10-08T16:04:17.617216+0000","last_became_peered":"2023-10-08T16:04:17.617216+0000","last_unstale":"2023-10-08T16:10:06.763218+0000","last_undegraded":"2023-10-08T16:10:06.763218+0000","last_fullsized":"2023-10-08T16:10:06.763218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'614","last_scrub_stamp":"2023-10-08T16:10:06.762914+0000","last_deep_scrub":"28'614","last_deep_scrub_stamp":"2023-10-08T16:10:06.762914+0000","last_clean_scrub_stamp":"2023-10-08T16:10:06.762914+0000","objects_scrubbed":2,"log_size":614,"log_dups_size":0,"ondisk_log_size":614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:59:29.846169+0000","scrub_duration":0.010087624999999999,"objects_trimmed":0,"snaptrim_duration":0.020241687000000001,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1666","reported_seq":1695,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:38.888154+0000","last_change":"2023-10-08T16:09:38.888088+0000","last_active":"2023-10-08T16:09:38.888154+0000","last_peered":"2023-10-08T16:09:38.888154+0000","last_clean":"2023-10-08T16:09:38.888154+0000","last_became_active":"2023-10-08T16:04:16.661224+0000","last_became_peered":"2023-10-08T16:04:16.661224+0000","last_unstale":"2023-10-08T16:09:38.888154+0000","last_undegraded":"2023-10-08T16:09:38.888154+0000","last_fullsized":"2023-10-08T16:09:38.888154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1666","last_scrub_stamp":"2023-10-08T16:09:38.887848+0000","last_deep_scrub":"28'1666","last_deep_scrub_stamp":"2023-10-08T16:09:38.887848+0000","last_clean_scrub_stamp":"2023-10-08T16:09:38.887848+0000","objects_scrubbed":4,"log_size":1666,"log_dups_size":0,"ondisk_log_size":1666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:00.791153+0000","scrub_duration":0.041569068000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9349042,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1651,"num_write_kb":9976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"28'531","reported_seq":610,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:40.436362+0000","last_change":"2023-10-08T16:09:40.436264+0000","last_active":"2023-10-08T16:09:40.436362+0000","last_peered":"2023-10-08T16:09:40.436362+0000","last_clean":"2023-10-08T16:09:40.436362+0000","last_became_active":"2023-10-08T16:04:17.621550+0000","last_became_peered":"2023-10-08T16:04:17.621550+0000","last_unstale":"2023-10-08T16:09:40.436362+0000","last_undegraded":"2023-10-08T16:09:40.436362+0000","last_fullsized":"2023-10-08T16:09:40.436362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'531","last_scrub_stamp":"2023-10-08T16:09:40.435990+0000","last_deep_scrub":"28'531","last_deep_scrub_stamp":"2023-10-08T16:09:40.435990+0000","last_clean_scrub_stamp":"2023-10-08T16:09:40.435990+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:13:09.575783+0000","scrub_duration":0.0041406139999999999,"objects_trimmed":0,"snaptrim_duration":0.046468506999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"28'765","reported_seq":794,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:29.514816+0000","last_change":"2023-10-08T16:09:29.514743+0000","last_active":"2023-10-08T16:09:29.514816+0000","last_peered":"2023-10-08T16:09:29.514816+0000","last_clean":"2023-10-08T16:09:29.514816+0000","last_became_active":"2023-10-08T16:04:16.661907+0000","last_became_peered":"2023-10-08T16:04:16.661907+0000","last_unstale":"2023-10-08T16:09:29.514816+0000","last_undegraded":"2023-10-08T16:09:29.514816+0000","last_fullsized":"2023-10-08T16:09:29.514816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'765","last_scrub_stamp":"2023-10-08T16:09:29.514581+0000","last_deep_scrub":"28'765","last_deep_scrub_stamp":"2023-10-08T16:09:29.514581+0000","last_clean_scrub_stamp":"2023-10-08T16:09:29.514581+0000","objects_scrubbed":1,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:59.535364+0000","scrub_duration":0.024557628000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":4591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"28'526","reported_seq":605,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:30.490508+0000","last_change":"2023-10-08T16:09:30.490432+0000","last_active":"2023-10-08T16:09:30.490508+0000","last_peered":"2023-10-08T16:09:30.490508+0000","last_clean":"2023-10-08T16:09:30.490508+0000","last_became_active":"2023-10-08T16:04:17.627562+0000","last_became_peered":"2023-10-08T16:04:17.627562+0000","last_unstale":"2023-10-08T16:09:30.490508+0000","last_undegraded":"2023-10-08T16:09:30.490508+0000","last_fullsized":"2023-10-08T16:09:30.490508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'526","last_scrub_stamp":"2023-10-08T16:09:30.490173+0000","last_deep_scrub":"28'526","last_deep_scrub_stamp":"2023-10-08T16:09:30.490173+0000","last_clean_scrub_stamp":"2023-10-08T16:09:30.490173+0000","objects_scrubbed":2,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:48.404946+0000","scrub_duration":0.0091133989999999995,"objects_trimmed":0,"snaptrim_duration":0.011393438000000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"28'2624","reported_seq":2653,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:23.416533+0000","last_change":"2023-10-08T16:09:23.416452+0000","last_active":"2023-10-08T16:09:23.416533+0000","last_peered":"2023-10-08T16:09:23.416533+0000","last_clean":"2023-10-08T16:09:23.416533+0000","last_became_active":"2023-10-08T16:04:16.662714+0000","last_became_peered":"2023-10-08T16:04:16.662714+0000","last_unstale":"2023-10-08T16:09:23.416533+0000","last_undegraded":"2023-10-08T16:09:23.416533+0000","last_fullsized":"2023-10-08T16:09:23.416533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2624","last_scrub_stamp":"2023-10-08T16:09:23.416303+0000","last_deep_scrub":"28'2624","last_deep_scrub_stamp":"2023-10-08T16:09:23.416303+0000","last_clean_scrub_stamp":"2023-10-08T16:09:23.416303+0000","objects_scrubbed":3,"log_size":2624,"log_dups_size":0,"ondisk_log_size":2624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:49.519531+0000","scrub_duration":0.026130798,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2619,"num_write_kb":5944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":82,"num_object_clones":21,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":8,"num_read":31,"num_read_kb":21,"num_write":110,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37820,"ondisk_log_size":37820,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":85127916,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":62,"num_read_kb":321,"num_write":17973,"num_write_kb":93770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":170319872,"data_stored":170255832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18098,"ondisk_log_size":18098,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574925,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":348312,"kb_used_data":38736,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94023528,"statfs":{"total":96636764160,"available":96280092672,"internally_reserved":0,"allocated":39665664,"data_stored":39453451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.83099999999999996,"15min":0.86199999999999999},"min":{"1min":0.64100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.1950000000000001,"5min":1.976,"15min":1.976},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.83299999999999996,"15min":0.86199999999999999},"min":{"1min":0.65800000000000003,"5min":0.314,"15min":0.314},"max":{"1min":1.254,"5min":1.254,"15min":1.5429999999999999},"last":1.044}]},{"osd":1,"last update":"Sun Oct 8 16:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.85799999999999998,"15min":0.86799999999999999},"min":{"1min":0.65500000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.159,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.89600000000000002,"15min":0.91100000000000003},"min":{"1min":0.65000000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.2989999999999999,"5min":1.54,"15min":1.54},"last":0.82299999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.91100000000000003,"15min":0.90800000000000003},"min":{"1min":0.62,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.238,"5min":1.478,"15min":1.478},"last":1.173},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.88300000000000001,"15min":0.91900000000000004},"min":{"1min":0.70499999999999996,"5min":0.44,"15min":0.44},"max":{"1min":1.2869999999999999,"5min":1.415,"15min":1.948},"last":1.1919999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96299999999999997,"15min":0.97799999999999998},"min":{"1min":0.80500000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.2609999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0189999999999999,"15min":1.0489999999999999},"min":{"1min":0.76400000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.375,"5min":1.548,"15min":1.552},"last":0.96399999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.96799999999999997,"15min":0.996},"min":{"1min":0.67300000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.204,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0629999999999999,"15min":1.0840000000000001},"min":{"1min":0.79700000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3300000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.129}]},{"osd":5,"last update":"Sun Oct 8 16:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.024,"15min":1.0569999999999999},"min":{"1min":0.72199999999999998,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.385,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.087,"15min":1.121},"min":{"1min":0.89400000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.3169999999999999,"5min":1.5860000000000001,"15min":1.726},"last":1.3660000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1499999999999999,"15min":1.208},"min":{"1min":0.99099999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4199999999999999,"5min":1.6759999999999999,"15min":2.0339999999999998},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.175,"5min":1.1679999999999999,"15min":1.1950000000000001},"min":{"1min":1.016,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4079999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.2230000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319056,"kb_used_data":17672,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94052784,"statfs":{"total":96636764160,"available":96310050816,"internally_reserved":0,"allocated":18096128,"data_stored":17891613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:19 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.77800000000000002,"15min":0.76900000000000002},"min":{"1min":0.627,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.077,"5min":3.8290000000000002,"15min":3.8290000000000002},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.88300000000000001,"15min":0.76500000000000001},"min":{"1min":0.54200000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.258,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.88200000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:10:19 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.92700000000000005,"15min":0.91700000000000004},"min":{"1min":0.73799999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1930000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.94999999999999996,"15min":0.93799999999999994},"min":{"1min":0.877,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.3129999999999999,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.0289999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:10:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.871,"15min":0.85099999999999998},"min":{"1min":0.622,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2110000000000001,"5min":1.25,"15min":1.25},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.91100000000000003,"15min":0.91700000000000004},"min":{"1min":0.71999999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2010000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.94699999999999995}]},{"osd":3,"last update":"Sun Oct 8 16:10:19 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.94799999999999995,"15min":0.86899999999999999},"min":{"1min":0.71899999999999997,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2370000000000001,"5min":2.173,"15min":2.173},"last":1},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.016,"15min":0.96799999999999997},"min":{"1min":0.72399999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2989999999999999,"5min":1.381,"15min":1.381},"last":1.1719999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:10:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.93400000000000005,"15min":0.98599999999999999},"min":{"1min":0.57699999999999996,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.1950000000000001,"5min":1.413,"15min":1.413},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.026,"5min":1.052,"15min":1.0229999999999999},"min":{"1min":0.71299999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1870000000000001,"5min":2.25,"15min":2.25},"last":1.113}]},{"osd":5,"last update":"Sun Oct 8 16:10:19 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.083,"15min":1.0409999999999999},"min":{"1min":0.71899999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3500000000000001,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.3009999999999999,"15min":1.2010000000000001},"min":{"1min":0.82099999999999995,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.397,"5min":17.428999999999998,"15min":17.428999999999998},"last":1.1559999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:10:19 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.1619999999999999,"15min":1.1040000000000001},"min":{"1min":0.875,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3300000000000001,"5min":6.0229999999999997,"15min":6.0229999999999997},"last":1.2},{"interface":"front","average":{"1min":1.22,"5min":1.2290000000000001,"15min":1.204},"min":{"1min":1.0049999999999999,"5min":0.626,"15min":0.626},"max":{"1min":1.4359999999999999,"5min":3.706,"15min":3.706},"last":1.294}]}]},{"osd":5,"up_from":13,"seq":55834574927,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":330424,"kb_used_data":20848,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94041416,"statfs":{"total":96636764160,"available":96298409984,"internally_reserved":0,"allocated":21348352,"data_stored":21141337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.79200000000000004,"15min":0.873},"min":{"1min":0.63700000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.64700000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.232,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":1.0740000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.875,"15min":0.84299999999999997},"min":{"1min":0.74199999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0840000000000001,"5min":4.399,"15min":4.399},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.90500000000000003,"15min":0.89900000000000002},"min":{"1min":0.70199999999999996,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.3129999999999999,"5min":4.5149999999999997,"15min":4.5149999999999997},"last":1.202}]},{"osd":2,"last update":"Sun Oct 8 16:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.85099999999999998,"15min":0.89300000000000002},"min":{"1min":0.65100000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0660000000000001,"5min":1.286,"15min":1.5760000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.91700000000000004,"15min":0.90300000000000002},"min":{"1min":0.69599999999999995,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.339,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.93000000000000005}]},{"osd":3,"last update":"Sun Oct 8 16:10:15 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.008,"15min":1.0069999999999999},"min":{"1min":0.78000000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.3979999999999999,"5min":4.7140000000000004,"15min":4.7140000000000004},"last":1.006},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.056,"15min":1.0640000000000001},"min":{"1min":0.94599999999999995,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3600000000000001,"5min":4.6920000000000002,"15min":4.6920000000000002},"last":1.3600000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:10:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0089999999999999,"15min":1.0429999999999999},"min":{"1min":0.68000000000000005,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.4690000000000001,"5min":1.5800000000000001,"15min":1.9259999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.109,"5min":1.0069999999999999,"15min":1.093},"min":{"1min":0.85699999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.335,"5min":1.353,"15min":1.7649999999999999},"last":1.2330000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:10:15 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.04,"15min":1.0760000000000001},"min":{"1min":0.81899999999999995,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.45,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.036},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.101,"15min":1.2030000000000001},"min":{"1min":0.82799999999999996,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.542,"5min":1.593,"15min":2.6589999999999998},"last":1.3029999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:10:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.0800000000000001,"15min":1.1930000000000001},"min":{"1min":0.876,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":2.0840000000000001},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1599999999999999,"15min":1.1859999999999999},"min":{"1min":0.92100000000000004,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5009999999999999,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.274}]}]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":334488,"kb_used_data":29008,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94037352,"statfs":{"total":96636764160,"available":96294248448,"internally_reserved":0,"allocated":29704192,"data_stored":29497190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80400000000000005,"15min":0.81399999999999995},"min":{"1min":0.41999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.3100000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.81699999999999995,"15min":0.79400000000000004},"min":{"1min":0.45000000000000001,"5min":0.379,"15min":0.379},"max":{"1min":1.1120000000000001,"5min":1.641,"15min":1.641},"last":0.67900000000000005}]},{"osd":1,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.81799999999999995,"15min":0.84299999999999997},"min":{"1min":0.63500000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.206,"5min":1.2729999999999999,"15min":1.292},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.90700000000000003,"15min":0.879},"min":{"1min":0.70599999999999996,"5min":0.438,"15min":0.438},"max":{"1min":1.224,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.90800000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.874,"15min":0.877},"min":{"1min":0.53400000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.228,"5min":1.276,"15min":1.276},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.0149999999999999,"15min":0.96499999999999997},"min":{"1min":0.55800000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.357,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.028}]},{"osd":3,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.92600000000000005,"15min":0.96699999999999997},"min":{"1min":0.66200000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.228,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0269999999999999,"15min":1.087},"min":{"1min":0.90000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.224,"5min":1.333,"15min":1.448},"last":1.1559999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.99299999999999999,"15min":1.0129999999999999},"min":{"1min":0.58899999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.444,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.071,"15min":1.0649999999999999},"min":{"1min":0.66200000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.337,"5min":9.8480000000000008,"15min":9.8480000000000008},"last":0.95299999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0029999999999999,"15min":1.119},"min":{"1min":0.76400000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.26,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.133,"15min":1.163},"min":{"1min":0.66600000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3999999999999999,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.1080000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.1639999999999999,"15min":1.1599999999999999},"min":{"1min":0.78000000000000003,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.385,"5min":8.8290000000000006,"15min":8.8290000000000006},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.141,"15min":1.248},"min":{"1min":0.70299999999999996,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3100000000000001,"5min":1.6850000000000001,"15min":1.71},"last":1.071}]}]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":318408,"kb_used_data":17024,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94053432,"statfs":{"total":96636764160,"available":96310714368,"internally_reserved":0,"allocated":17432576,"data_stored":17223470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.432,"5min":0.214,"15min":0.214},"max":{"1min":0.98299999999999998,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.72199999999999998,"15min":0.71799999999999997},"min":{"1min":0.72799999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.96799999999999997,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":0.69599999999999995}]},{"osd":1,"last update":"Sun Oct 8 16:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70799999999999996,"15min":0.65900000000000003},"min":{"1min":0.54300000000000004,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97799999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.873,"15min":0.77600000000000002},"min":{"1min":0.55800000000000005,"5min":0.249,"15min":0.249},"max":{"1min":1.095,"5min":8.3059999999999992,"15min":8.3059999999999992},"last":0.81999999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.78000000000000003,"15min":0.77100000000000002},"min":{"1min":0.57599999999999996,"5min":0.312,"15min":0.312},"max":{"1min":1.052,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.83099999999999996,"15min":0.79100000000000004},"min":{"1min":0.65900000000000003,"5min":0.433,"15min":0.433},"max":{"1min":1.29,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.75900000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:10:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":0.98999999999999999,"15min":1.03},"min":{"1min":0.85499999999999998,"5min":0.374,"15min":0.374},"max":{"1min":1.339,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.194},{"interface":"front","average":{"1min":1.085,"5min":1.012,"15min":1.01},"min":{"1min":0.89100000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.468,"5min":2.202,"15min":2.202},"last":0.877}]},{"osd":5,"last update":"Sun Oct 8 16:10:11 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0609999999999999,"15min":1.083},"min":{"1min":0.68400000000000005,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.49,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.121,"5min":1.0780000000000001,"15min":1.1000000000000001},"min":{"1min":0.89200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.421,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.1120000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:10:11 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0680000000000001,"15min":1.0700000000000001},"min":{"1min":0.76600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.5509999999999999,"5min":2.113,"15min":2.113},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.1319999999999999,"15min":1.169},"min":{"1min":0.874,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4019999999999999,"5min":3.351,"15min":3.351},"last":1.012}]},{"osd":7,"last update":"Sun Oct 8 16:10:11 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.139,"15min":1.2090000000000001},"min":{"1min":0.91500000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.5780000000000001,"5min":2.919,"15min":2.984},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.196,"15min":1.1459999999999999},"min":{"1min":0.99299999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.482,"5min":6.3940000000000001,"15min":6.3940000000000001},"last":1.145}]}]},{"osd":2,"up_from":13,"seq":55834574925,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314296,"kb_used_data":4720,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94057544,"statfs":{"total":96636764160,"available":96314925056,"internally_reserved":0,"allocated":4833280,"data_stored":4631728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61399999999999999,"15min":0.63200000000000001},"min":{"1min":0.41999999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.876,"5min":1.131,"15min":1.131},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.66400000000000003,"15min":0.63200000000000001},"min":{"1min":0.46800000000000003,"5min":0.32200000000000001,"15min":0.30199999999999999},"max":{"1min":1.1910000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.2070000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.71199999999999997,"15min":0.74399999999999999},"min":{"1min":0.5,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0169999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.78300000000000003,"15min":0.751},"min":{"1min":0.40200000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.018,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.75600000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.73299999999999998,"15min":0.755},"min":{"1min":0.51500000000000001,"5min":0.315,"15min":0.315},"max":{"1min":1.042,"5min":1.454,"15min":1.454},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.85599999999999998,"15min":0.871},"min":{"1min":0.55300000000000005,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.145,"5min":1.2989999999999999,"15min":1.306},"last":1.014}]},{"osd":4,"last update":"Sun Oct 8 16:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.92900000000000005,"15min":1},"min":{"1min":0.65100000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.3,"5min":1.3560000000000001,"15min":1.954},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.97499999999999998,"15min":1.0269999999999999},"min":{"1min":0.86399999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3999999999999999,"5min":1.4450000000000001,"15min":1.804},"last":0.96899999999999997}]},{"osd":5,"last update":"Sun Oct 8 16:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.92200000000000004,"15min":1.0009999999999999},"min":{"1min":0.73099999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.411,"5min":1.6519999999999999,"15min":1.873},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.022,"15min":1.0840000000000001},"min":{"1min":0.69099999999999995,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.391,"5min":1.391,"15min":1.6779999999999999},"last":1.139}]},{"osd":6,"last update":"Sun Oct 8 16:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.0249999999999999,"15min":1.077},"min":{"1min":0.75700000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.974},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.052,"5min":1.0209999999999999,"15min":1.071},"min":{"1min":0.70199999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":2.4399999999999999},"last":1.0780000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.0940000000000001,"15min":1.1399999999999999},"min":{"1min":0.85599999999999998,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.915},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.081,"15min":1.149},"min":{"1min":0.76800000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":2.524},"last":1.173}]}]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326288,"kb_used_data":20808,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94045552,"statfs":{"total":96636764160,"available":96302645248,"internally_reserved":0,"allocated":21307392,"data_stored":21108603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60799999999999998,"15min":0.60999999999999999},"min":{"1min":0.39200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.94899999999999995,"5min":1.024,"15min":1.024},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.67400000000000004,"15min":0.65700000000000003},"min":{"1min":0.505,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.76100000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.70199999999999996,"15min":0.65700000000000003},"min":{"1min":0.50900000000000001,"5min":0.373,"15min":0.373},"max":{"1min":1.3460000000000001,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.75800000000000001,"15min":0.76600000000000001},"min":{"1min":0.61199999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0549999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.69899999999999995}]},{"osd":3,"last update":"Sun Oct 8 16:09:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.78600000000000003,"15min":0.83499999999999996},"min":{"1min":0.52600000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.0049999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.79400000000000004,"15min":0.77300000000000002},"min":{"1min":0.45000000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.83899999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:09:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.92700000000000005,"15min":0.93799999999999994},"min":{"1min":0.69499999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":1.046},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0189999999999999,"15min":1.016},"min":{"1min":0.79900000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5700000000000001,"5min":3.5910000000000002,"15min":3.5910000000000002},"last":1.095}]},{"osd":5,"last update":"Sun Oct 8 16:09:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0269999999999999,"15min":1.036},"min":{"1min":0.82199999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.472,"5min":3.6280000000000001,"15min":3.6280000000000001},"last":1.165},{"interface":"front","average":{"1min":1.069,"5min":1.0620000000000001,"15min":1.1080000000000001},"min":{"1min":0.77000000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.385,"5min":1.641,"15min":1.641},"last":0.97199999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:09:20 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.0389999999999999,"15min":1.091},"min":{"1min":0.77900000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.1080000000000001,"15min":1.139},"min":{"1min":0.748,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.6339999999999999,"5min":3.657,"15min":3.657},"last":1.2110000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:09:20 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.095,"15min":1.147},"min":{"1min":0.86799999999999999,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.401,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.069},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.095,"15min":1.125},"min":{"1min":0.90500000000000003,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.101,"5min":2.101,"15min":2.101},"last":1.3140000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574925,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":330996,"kb_used_data":21420,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94040844,"statfs":{"total":96636764160,"available":96297824256,"internally_reserved":0,"allocated":21934080,"data_stored":21706793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65500000000000003,"15min":0.64300000000000002},"min":{"1min":0.53800000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.84899999999999998,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":1.2789999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70899999999999996,"15min":0.69899999999999995},"min":{"1min":0.49299999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.88,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.92800000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.73899999999999999,"15min":0.70899999999999996},"min":{"1min":0.51300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.103,"5min":1.766,"15min":1.766},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.83199999999999996,"15min":0.79200000000000004},"min":{"1min":0.56000000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.024,"5min":5.9610000000000003,"15min":5.9610000000000003},"last":1.0900000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.73599999999999999,"15min":0.76300000000000001},"min":{"1min":0.41399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":1.103,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":1.024},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.85299999999999998,"15min":0.82699999999999996},"min":{"1min":0.69099999999999995,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.0740000000000001,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.133}]},{"osd":4,"last update":"Sun Oct 8 16:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.98299999999999998,"15min":0.996},"min":{"1min":0.76700000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.141,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.3360000000000001},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.94599999999999995,"15min":1.0049999999999999},"min":{"1min":0.70799999999999996,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2450000000000001,"5min":1.365,"15min":1.552},"last":1.1739999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.97599999999999998,"15min":1.008},"min":{"1min":0.82899999999999996,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.4019999999999999,"5min":1.4510000000000001,"15min":1.601},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.0600000000000001,"15min":1.0720000000000001},"min":{"1min":0.84099999999999997,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.351,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.476}]},{"osd":6,"last update":"Sun Oct 8 16:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.087,"15min":1.1200000000000001},"min":{"1min":0.80200000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.369,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1619999999999999,"15min":1.1060000000000001},"min":{"1min":0.92100000000000004,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.46,"5min":5.827,"15min":5.827},"last":1.454}]},{"osd":7,"last update":"Sun Oct 8 16:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.1619999999999999,"15min":1.157},"min":{"1min":0.91100000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.472,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.405},{"interface":"front","average":{"1min":1.139,"5min":1.0900000000000001,"15min":1.1140000000000001},"min":{"1min":0.86599999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.393,"5min":1.51,"15min":1.51},"last":1.4279999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20983808,"data_stored":20972130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20979712,"data_stored":20971680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4476928,"data_stored":4474292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17068032,"data_stored":17057848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17747968,"data_stored":17738294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":38715392,"data_stored":38709724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":24687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":16404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":36917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":45103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":16417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":49208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":32800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":32840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:10:21.764 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:10:21.764 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-10-08T16:04:16.621866+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=4, tm_sec=16, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=15, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T16:10:21.765 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-08T16:10:41.767 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:10:41.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72eae77700 1 Processor -- start 2023-10-08T16:10:41.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72eae77700 1 -- start start 2023-10-08T16:10:41.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72eae77700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f72e40ae190 0x7f72e40b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:41.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72eae77700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f72e40ae560 0x7f72e4143b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:41.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72eae77700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e40afed0 con 0x7f72e4144090 2023-10-08T16:10:41.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72eae77700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e406b730 con 0x7f72e40ae560 2023-10-08T16:10:41.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72eae77700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e40b0e20 con 0x7f72e40ae190 2023-10-08T16:10:41.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72e3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f72e40ae560 0x7f72e4143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:41.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72e9414700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f72e4144090 0x7f72e406e280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55076/0 (socket says 172.21.15.133:55076) 2023-10-08T16:10:41.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72e9414700 1 -- 172.21.15.133:0/2954539720 learned_addr learned my addr 172.21.15.133:0/2954539720 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:10:41.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72e8c13700 1 --2- 172.21.15.133:0/2954539720 >> v2:172.21.15.190:3300/0 conn(0x7f72e40ae190 0x7f72e40b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:41.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72e37fe700 1 -- 172.21.15.133:0/2954539720 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656439288 0 0) 0x7f72e40afed0 con 0x7f72e4144090 2023-10-08T16:10:41.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72e37fe700 1 -- 172.21.15.133:0/2954539720 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72d4003570 con 0x7f72e4144090 2023-10-08T16:10:41.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72e3fff700 1 -- 172.21.15.133:0/2954539720 >> v2:172.21.15.190:3300/0 conn(0x7f72e40ae190 msgr2=0x7f72e40b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:41.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72e3fff700 1 --2- 172.21.15.133:0/2954539720 >> v2:172.21.15.190:3300/0 conn(0x7f72e40ae190 0x7f72e40b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72e3fff700 1 -- 172.21.15.133:0/2954539720 >> v1:172.21.15.133:6789/0 conn(0x7f72e4144090 legacy=0x7f72e406e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:41.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72e3fff700 1 -- 172.21.15.133:0/2954539720 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e4144510 con 0x7f72e40ae560 2023-10-08T16:10:41.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72e3fff700 1 --2- 172.21.15.133:0/2954539720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72e40ae560 0x7f72e4143b50 secure :-1 s=READY pgs=4413 cs=0 l=1 rev1=1 crypto rx=0x7f72e406aa50 tx=0x7f72d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11161954bf5a24c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:41.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72e37fe700 1 -- 172.21.15.133:0/2954539720 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d0011630 con 0x7f72e40ae560 2023-10-08T16:10:41.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72e37fe700 1 -- 172.21.15.133:0/2954539720 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d00117b0 con 0x7f72e40ae560 2023-10-08T16:10:41.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72e37fe700 1 -- 172.21.15.133:0/2954539720 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d0011b30 con 0x7f72e40ae560 2023-10-08T16:10:41.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72eae77700 1 -- 172.21.15.133:0/2954539720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72e40ae560 msgr2=0x7f72e4143b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:41.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72eae77700 1 --2- 172.21.15.133:0/2954539720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72e40ae560 0x7f72e4143b50 secure :-1 s=READY pgs=4413 cs=0 l=1 rev1=1 crypto rx=0x7f72e406aa50 tx=0x7f72d00091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72eae77700 1 -- 172.21.15.133:0/2954539720 shutdown_connections 2023-10-08T16:10:41.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72eae77700 1 --2- 172.21.15.133:0/2954539720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72e40ae560 0x7f72e4143b50 unknown :-1 s=CLOSED pgs=4413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72eae77700 1 --2- 172.21.15.133:0/2954539720 >> v2:172.21.15.190:3300/0 conn(0x7f72e40ae190 0x7f72e40b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72eae77700 1 -- 172.21.15.133:0/2954539720 >> 172.21.15.133:0/2954539720 conn(0x7f72e40b4ba0 msgr2=0x7f72e40b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:41.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72eae77700 1 -- 172.21.15.133:0/2954539720 shutdown_connections 2023-10-08T16:10:41.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.879+0000 7f72eae77700 1 -- 172.21.15.133:0/2954539720 wait complete. 2023-10-08T16:10:41.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.883+0000 7f72eae77700 1 Processor -- start 2023-10-08T16:10:41.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.883+0000 7f72eae77700 1 -- start start 2023-10-08T16:10:41.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.883+0000 7f72eae77700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72e40ae190 0x7f72e413b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:41.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.883+0000 7f72eae77700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f72e40ae560 0x7f72e4150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:41.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.883+0000 7f72eae77700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f72e4144090 0x7f72e4140bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:41.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.883+0000 7f72eae77700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e413cfe0 con 0x7f72e40ae190 2023-10-08T16:10:41.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.883+0000 7f72eae77700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e414ff10 con 0x7f72e4144090 2023-10-08T16:10:41.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.883+0000 7f72eae77700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e4150190 con 0x7f72e40ae560 2023-10-08T16:10:41.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.883+0000 7f72e8c13700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72e40ae190 0x7f72e413b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:41.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.883+0000 7f72e8c13700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72e40ae190 0x7f72e413b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34002/0 (socket says 172.21.15.133:34002) 2023-10-08T16:10:41.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.883+0000 7f72e8c13700 1 -- 172.21.15.133:0/1052586425 learned_addr learned my addr 172.21.15.133:0/1052586425 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:10:41.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.883+0000 7f72e3fff700 1 --2- 172.21.15.133:0/1052586425 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f72e40ae560 0x7f72e4150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:41.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.883+0000 7f72e9414700 1 --2- 172.21.15.133:0/1052586425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f72e4144090 0x7f72e4140bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:41.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.883+0000 7f72e8c13700 1 -- 172.21.15.133:0/1052586425 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f72e40ae560 msgr2=0x7f72e4150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:41.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.883+0000 7f72e8c13700 1 --2- 172.21.15.133:0/1052586425 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f72e40ae560 0x7f72e4150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.883+0000 7f72e8c13700 1 -- 172.21.15.133:0/1052586425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f72e4144090 msgr2=0x7f72e4140bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:41.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.883+0000 7f72e8c13700 1 --2- 172.21.15.133:0/1052586425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f72e4144090 0x7f72e4140bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.883+0000 7f72e8c13700 1 -- 172.21.15.133:0/1052586425 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d0009420 con 0x7f72e40ae190 2023-10-08T16:10:41.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.883+0000 7f72e9414700 1 --2- 172.21.15.133:0/1052586425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f72e4144090 0x7f72e4140bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:41.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.883+0000 7f72e8c13700 1 --2- 172.21.15.133:0/1052586425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72e40ae190 0x7f72e413b200 secure :-1 s=READY pgs=4414 cs=0 l=1 rev1=1 crypto rx=0x7f72d800e930 tx=0x7f72d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:41.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.883+0000 7f72e0ff9700 1 -- 172.21.15.133:0/1052586425 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d8009510 con 0x7f72e40ae190 2023-10-08T16:10:41.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.883+0000 7f72e0ff9700 1 -- 172.21.15.133:0/1052586425 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d800c850 con 0x7f72e40ae190 2023-10-08T16:10:41.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.883+0000 7f72e0ff9700 1 -- 172.21.15.133:0/1052586425 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d800cc10 con 0x7f72e40ae190 2023-10-08T16:10:41.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.883+0000 7f72eae77700 1 -- 172.21.15.133:0/1052586425 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e4150470 con 0x7f72e40ae190 2023-10-08T16:10:41.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.883+0000 7f72eae77700 1 -- 172.21.15.133:0/1052586425 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e413ff50 con 0x7f72e40ae190 2023-10-08T16:10:41.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.887+0000 7f72eae77700 1 -- 172.21.15.133:0/1052586425 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e4064810 con 0x7f72e40ae190 2023-10-08T16:10:41.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.887+0000 7f72e0ff9700 1 -- 172.21.15.133:0/1052586425 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f72d8013470 con 0x7f72e40ae190 2023-10-08T16:10:41.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.887+0000 7f72e0ff9700 1 --2- 172.21.15.133:0/1052586425 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f72c8060550 0x7f72c8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:41.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.887+0000 7f72e0ff9700 1 -- 172.21.15.133:0/1052586425 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f72d807c980 con 0x7f72e40ae190 2023-10-08T16:10:41.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.887+0000 7f72e3fff700 1 --2- 172.21.15.133:0/1052586425 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f72c8060550 0x7f72c8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:41.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.887+0000 7f72e3fff700 1 --2- 172.21.15.133:0/1052586425 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f72c8060550 0x7f72c8062a00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f72e406aa50 tx=0x7f72d0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:41.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:41.895+0000 7f72e0ff9700 1 -- 172.21.15.133:0/1052586425 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f72d804cee0 con 0x7f72e40ae190 2023-10-08T16:10:42.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.051+0000 7f72eae77700 1 -- 172.21.15.133:0/1052586425 --> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f72e40af880 con 0x7f72c8060550 2023-10-08T16:10:42.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.071+0000 7f72e0ff9700 1 -- 172.21.15.133:0/1052586425 <== mgr.4104 v2:172.21.15.133:6832/33362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+291932 (secure 0 0 0) 0x7f72e40af880 con 0x7f72c8060550 2023-10-08T16:10:42.080 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:10:42.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.075+0000 7f72eae77700 1 -- 172.21.15.133:0/1052586425 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f72c8060550 msgr2=0x7f72c8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.075+0000 7f72eae77700 1 --2- 172.21.15.133:0/1052586425 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f72c8060550 0x7f72c8062a00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f72e406aa50 tx=0x7f72d0017000 comp rx=0 tx=0).stop 2023-10-08T16:10:42.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.075+0000 7f72eae77700 1 -- 172.21.15.133:0/1052586425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72e40ae190 msgr2=0x7f72e413b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.075+0000 7f72eae77700 1 --2- 172.21.15.133:0/1052586425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72e40ae190 0x7f72e413b200 secure :-1 s=READY pgs=4414 cs=0 l=1 rev1=1 crypto rx=0x7f72d800e930 tx=0x7f72d80091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.075+0000 7f72eae77700 1 -- 172.21.15.133:0/1052586425 shutdown_connections 2023-10-08T16:10:42.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.075+0000 7f72eae77700 1 --2- 172.21.15.133:0/1052586425 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f72c8060550 0x7f72c8062a00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.075+0000 7f72eae77700 1 --2- 172.21.15.133:0/1052586425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f72e4144090 0x7f72e4140bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.075+0000 7f72eae77700 1 --2- 172.21.15.133:0/1052586425 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f72e40ae560 0x7f72e4150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.075+0000 7f72eae77700 1 --2- 172.21.15.133:0/1052586425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72e40ae190 0x7f72e413b200 unknown :-1 s=CLOSED pgs=4414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.075+0000 7f72eae77700 1 -- 172.21.15.133:0/1052586425 >> 172.21.15.133:0/1052586425 conn(0x7f72e40b4ba0 msgr2=0x7f72e40b4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:42.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.075+0000 7f72eae77700 1 -- 172.21.15.133:0/1052586425 shutdown_connections 2023-10-08T16:10:42.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.075+0000 7f72eae77700 1 -- 172.21.15.133:0/1052586425 wait complete. 2023-10-08T16:10:42.084 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-10-08T16:10:42.095 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2023-10-08T16:10:40.968917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":85845472,"num_objects":127,"num_object_clones":21,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":8,"num_read":209,"num_read_kb":442,"num_write":18242,"num_write_kb":96383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56039,"ondisk_log_size":56039,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2622268,"kb_used_data":170236,"kb_used_omap":0,"kb_used_meta":2451968,"kb_avail":752352452,"statfs":{"total":773094113280,"available":770408910848,"internally_reserved":0,"allocated":174321664,"data_stored":172654185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2510815232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003934"},"pg_stats":[{"pgid":"3.3f","version":"28'513","reported_seq":592,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.749859+0000","last_change":"2023-10-08T16:10:29.749794+0000","last_active":"2023-10-08T16:10:29.749859+0000","last_peered":"2023-10-08T16:10:29.749859+0000","last_clean":"2023-10-08T16:10:29.749859+0000","last_became_active":"2023-10-08T16:04:17.626468+0000","last_became_peered":"2023-10-08T16:04:17.626468+0000","last_unstale":"2023-10-08T16:10:29.749859+0000","last_undegraded":"2023-10-08T16:10:29.749859+0000","last_fullsized":"2023-10-08T16:10:29.749859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'513","last_scrub_stamp":"2023-10-08T16:10:29.749538+0000","last_deep_scrub":"28'513","last_deep_scrub_stamp":"2023-10-08T16:10:29.749538+0000","last_clean_scrub_stamp":"2023-10-08T16:10:29.749538+0000","objects_scrubbed":2,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:50:46.404742+0000","scrub_duration":0.010549642,"objects_trimmed":0,"snaptrim_duration":0.012965628,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"28'502","reported_seq":581,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:30.128019+0000","last_change":"2023-10-08T16:09:30.127903+0000","last_active":"2023-10-08T16:09:30.128019+0000","last_peered":"2023-10-08T16:09:30.128019+0000","last_clean":"2023-10-08T16:09:30.128019+0000","last_became_active":"2023-10-08T16:04:17.623968+0000","last_became_peered":"2023-10-08T16:04:17.623968+0000","last_unstale":"2023-10-08T16:09:30.128019+0000","last_undegraded":"2023-10-08T16:09:30.128019+0000","last_fullsized":"2023-10-08T16:09:30.128019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'502","last_scrub_stamp":"2023-10-08T16:09:30.127492+0000","last_deep_scrub":"28'502","last_deep_scrub_stamp":"2023-10-08T16:09:30.127492+0000","last_clean_scrub_stamp":"2023-10-08T16:09:30.127492+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:10:49.129682+0000","scrub_duration":0.0045437120000000001,"objects_trimmed":0,"snaptrim_duration":0.025754998000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"28'751","reported_seq":829,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:35.484095+0000","last_change":"2023-10-08T16:09:35.483973+0000","last_active":"2023-10-08T16:09:35.484095+0000","last_peered":"2023-10-08T16:09:35.484095+0000","last_clean":"2023-10-08T16:09:35.484095+0000","last_became_active":"2023-10-08T16:04:17.624219+0000","last_became_peered":"2023-10-08T16:04:17.624219+0000","last_unstale":"2023-10-08T16:09:35.484095+0000","last_undegraded":"2023-10-08T16:09:35.484095+0000","last_fullsized":"2023-10-08T16:09:35.484095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'751","last_scrub_stamp":"2023-10-08T16:09:35.483714+0000","last_deep_scrub":"28'751","last_deep_scrub_stamp":"2023-10-08T16:09:35.483714+0000","last_clean_scrub_stamp":"2023-10-08T16:09:35.483714+0000","objects_scrubbed":2,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:53.398487+0000","scrub_duration":0.0086411349999999994,"objects_trimmed":0,"snaptrim_duration":0.046708411999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'449","reported_seq":528,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:10:14.800639+0000","last_change":"2023-10-08T16:10:14.800565+0000","last_active":"2023-10-08T16:10:14.800639+0000","last_peered":"2023-10-08T16:10:14.800639+0000","last_clean":"2023-10-08T16:10:14.800639+0000","last_became_active":"2023-10-08T16:04:17.628308+0000","last_became_peered":"2023-10-08T16:04:17.628308+0000","last_unstale":"2023-10-08T16:10:14.800639+0000","last_undegraded":"2023-10-08T16:10:14.800639+0000","last_fullsized":"2023-10-08T16:10:14.800639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'449","last_scrub_stamp":"2023-10-08T16:10:14.800314+0000","last_deep_scrub":"28'449","last_deep_scrub_stamp":"2023-10-08T16:10:14.800314+0000","last_clean_scrub_stamp":"2023-10-08T16:10:14.800314+0000","objects_scrubbed":2,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:15.849656+0000","scrub_duration":0.0088619600000000003,"objects_trimmed":0,"snaptrim_duration":0.019603182,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'459","reported_seq":537,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:10:13.887408+0000","last_change":"2023-10-08T16:10:13.887374+0000","last_active":"2023-10-08T16:10:13.887408+0000","last_peered":"2023-10-08T16:10:13.887408+0000","last_clean":"2023-10-08T16:10:13.887408+0000","last_became_active":"2023-10-08T16:04:17.625650+0000","last_became_peered":"2023-10-08T16:04:17.625650+0000","last_unstale":"2023-10-08T16:10:13.887408+0000","last_undegraded":"2023-10-08T16:10:13.887408+0000","last_fullsized":"2023-10-08T16:10:13.887408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'459","last_scrub_stamp":"2023-10-08T16:10:13.887259+0000","last_deep_scrub":"28'459","last_deep_scrub_stamp":"2023-10-08T16:10:13.887259+0000","last_clean_scrub_stamp":"2023-10-08T16:10:13.887259+0000","objects_scrubbed":3,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:38.350036+0000","scrub_duration":0.010932637,"objects_trimmed":0,"snaptrim_duration":0.013008828,"stat_sum":{"num_bytes":4107,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'641","reported_seq":717,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:32.516400+0000","last_change":"2023-10-08T16:09:32.516346+0000","last_active":"2023-10-08T16:09:32.516400+0000","last_peered":"2023-10-08T16:09:32.516400+0000","last_clean":"2023-10-08T16:09:32.516400+0000","last_became_active":"2023-10-08T16:04:59.029141+0000","last_became_peered":"2023-10-08T16:04:59.029141+0000","last_unstale":"2023-10-08T16:09:32.516400+0000","last_undegraded":"2023-10-08T16:09:32.516400+0000","last_fullsized":"2023-10-08T16:09:32.516400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'641","last_scrub_stamp":"2023-10-08T16:09:32.516164+0000","last_deep_scrub":"28'641","last_deep_scrub_stamp":"2023-10-08T16:09:32.516164+0000","last_clean_scrub_stamp":"2023-10-08T16:09:32.516164+0000","objects_scrubbed":3,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:50.430937+0000","scrub_duration":0.011603842,"objects_trimmed":0,"snaptrim_duration":0.010017161,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"28'440","reported_seq":519,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:10:16.840860+0000","last_change":"2023-10-08T16:10:16.840793+0000","last_active":"2023-10-08T16:10:16.840860+0000","last_peered":"2023-10-08T16:10:16.840860+0000","last_clean":"2023-10-08T16:10:16.840860+0000","last_became_active":"2023-10-08T16:04:17.631722+0000","last_became_peered":"2023-10-08T16:04:17.631722+0000","last_unstale":"2023-10-08T16:10:16.840860+0000","last_undegraded":"2023-10-08T16:10:16.840860+0000","last_fullsized":"2023-10-08T16:10:16.840860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'440","last_scrub_stamp":"2023-10-08T16:10:16.840548+0000","last_deep_scrub":"28'440","last_deep_scrub_stamp":"2023-10-08T16:10:16.840548+0000","last_clean_scrub_stamp":"2023-10-08T16:10:16.840548+0000","objects_scrubbed":1,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:36.913300+0000","scrub_duration":0.0086399219999999995,"objects_trimmed":0,"snaptrim_duration":0.010482406,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'608","reported_seq":686,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:57.209488+0000","last_change":"2023-10-08T16:09:57.209435+0000","last_active":"2023-10-08T16:09:57.209488+0000","last_peered":"2023-10-08T16:09:57.209488+0000","last_clean":"2023-10-08T16:09:57.209488+0000","last_became_active":"2023-10-08T16:04:17.628987+0000","last_became_peered":"2023-10-08T16:04:17.628987+0000","last_unstale":"2023-10-08T16:09:57.209488+0000","last_undegraded":"2023-10-08T16:09:57.209488+0000","last_fullsized":"2023-10-08T16:09:57.209488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'608","last_scrub_stamp":"2023-10-08T16:09:57.209140+0000","last_deep_scrub":"28'608","last_deep_scrub_stamp":"2023-10-08T16:09:57.209140+0000","last_clean_scrub_stamp":"2023-10-08T16:09:57.209140+0000","objects_scrubbed":2,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:44:58.041057+0000","scrub_duration":0.0098542950000000008,"objects_trimmed":0,"snaptrim_duration":0.011543940000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"28'702","reported_seq":781,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:10:22.699029+0000","last_change":"2023-10-08T16:10:22.698918+0000","last_active":"2023-10-08T16:10:22.699029+0000","last_peered":"2023-10-08T16:10:22.699029+0000","last_clean":"2023-10-08T16:10:22.699029+0000","last_became_active":"2023-10-08T16:04:17.636350+0000","last_became_peered":"2023-10-08T16:04:17.636350+0000","last_unstale":"2023-10-08T16:10:22.699029+0000","last_undegraded":"2023-10-08T16:10:22.699029+0000","last_fullsized":"2023-10-08T16:10:22.699029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'702","last_scrub_stamp":"2023-10-08T16:10:22.698489+0000","last_deep_scrub":"28'702","last_deep_scrub_stamp":"2023-10-08T16:10:22.698489+0000","last_clean_scrub_stamp":"2023-10-08T16:10:22.698489+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:55.902838+0000","scrub_duration":0.0041461830000000003,"objects_trimmed":0,"snaptrim_duration":0.014319053,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'949","reported_seq":1038,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:50.476019+0000","last_change":"2023-10-08T16:09:50.475967+0000","last_active":"2023-10-08T16:09:50.476019+0000","last_peered":"2023-10-08T16:09:50.476019+0000","last_clean":"2023-10-08T16:09:50.476019+0000","last_became_active":"2023-10-08T16:04:58.696602+0000","last_became_peered":"2023-10-08T16:04:58.696602+0000","last_unstale":"2023-10-08T16:09:50.476019+0000","last_undegraded":"2023-10-08T16:09:50.476019+0000","last_fullsized":"2023-10-08T16:09:50.476019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'949","last_scrub_stamp":"2023-10-08T16:09:50.475774+0000","last_deep_scrub":"28'949","last_deep_scrub_stamp":"2023-10-08T16:09:50.475774+0000","last_clean_scrub_stamp":"2023-10-08T16:09:50.475774+0000","objects_scrubbed":3,"log_size":949,"log_dups_size":0,"ondisk_log_size":949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:44:51.307691+0000","scrub_duration":0.012602917,"objects_trimmed":0,"snaptrim_duration":0.014587116000000001,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"28'517","reported_seq":596,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:30.599563+0000","last_change":"2023-10-08T16:09:30.599506+0000","last_active":"2023-10-08T16:09:30.599563+0000","last_peered":"2023-10-08T16:09:30.599563+0000","last_clean":"2023-10-08T16:09:30.599563+0000","last_became_active":"2023-10-08T16:04:17.627965+0000","last_became_peered":"2023-10-08T16:04:17.627965+0000","last_unstale":"2023-10-08T16:09:30.599563+0000","last_undegraded":"2023-10-08T16:09:30.599563+0000","last_fullsized":"2023-10-08T16:09:30.599563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'517","last_scrub_stamp":"2023-10-08T16:09:30.599375+0000","last_deep_scrub":"28'517","last_deep_scrub_stamp":"2023-10-08T16:09:30.599375+0000","last_clean_scrub_stamp":"2023-10-08T16:09:30.599375+0000","objects_scrubbed":2,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:41.494405+0000","scrub_duration":0.0091910640000000005,"objects_trimmed":0,"snaptrim_duration":0.012809017000000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'623","reported_seq":702,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:38.311592+0000","last_change":"2023-10-08T16:09:38.311514+0000","last_active":"2023-10-08T16:09:38.311592+0000","last_peered":"2023-10-08T16:09:38.311592+0000","last_clean":"2023-10-08T16:09:38.311592+0000","last_became_active":"2023-10-08T16:04:17.616988+0000","last_became_peered":"2023-10-08T16:04:17.616988+0000","last_unstale":"2023-10-08T16:09:38.311592+0000","last_undegraded":"2023-10-08T16:09:38.311592+0000","last_fullsized":"2023-10-08T16:09:38.311592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'623","last_scrub_stamp":"2023-10-08T16:09:38.311231+0000","last_deep_scrub":"28'623","last_deep_scrub_stamp":"2023-10-08T16:09:38.311231+0000","last_clean_scrub_stamp":"2023-10-08T16:09:38.311231+0000","objects_scrubbed":1,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:47.744886+0000","scrub_duration":0.0086635310000000004,"objects_trimmed":0,"snaptrim_duration":0.010221923000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"28'578","reported_seq":657,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:55.221676+0000","last_change":"2023-10-08T16:09:55.221607+0000","last_active":"2023-10-08T16:09:55.221676+0000","last_peered":"2023-10-08T16:09:55.221676+0000","last_clean":"2023-10-08T16:09:55.221676+0000","last_became_active":"2023-10-08T16:04:17.625529+0000","last_became_peered":"2023-10-08T16:04:17.625529+0000","last_unstale":"2023-10-08T16:09:55.221676+0000","last_undegraded":"2023-10-08T16:09:55.221676+0000","last_fullsized":"2023-10-08T16:09:55.221676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'578","last_scrub_stamp":"2023-10-08T16:09:55.221325+0000","last_deep_scrub":"28'578","last_deep_scrub_stamp":"2023-10-08T16:09:55.221325+0000","last_clean_scrub_stamp":"2023-10-08T16:09:55.221325+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:26.913449+0000","scrub_duration":0.0041477520000000002,"objects_trimmed":0,"snaptrim_duration":0.011264827,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"28'490","reported_seq":569,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:52.501976+0000","last_change":"2023-10-08T16:09:52.501907+0000","last_active":"2023-10-08T16:09:52.501976+0000","last_peered":"2023-10-08T16:09:52.501976+0000","last_clean":"2023-10-08T16:09:52.501976+0000","last_became_active":"2023-10-08T16:04:17.624197+0000","last_became_peered":"2023-10-08T16:04:17.624197+0000","last_unstale":"2023-10-08T16:09:52.501976+0000","last_undegraded":"2023-10-08T16:09:52.501976+0000","last_fullsized":"2023-10-08T16:09:52.501976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'490","last_scrub_stamp":"2023-10-08T16:09:52.501658+0000","last_deep_scrub":"28'490","last_deep_scrub_stamp":"2023-10-08T16:09:52.501658+0000","last_clean_scrub_stamp":"2023-10-08T16:09:52.501658+0000","objects_scrubbed":1,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:14.404964+0000","scrub_duration":0.0083187469999999996,"objects_trimmed":0,"snaptrim_duration":0.037453408000000001,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"28'589","reported_seq":668,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:34.179421+0000","last_change":"2023-10-08T16:09:34.179325+0000","last_active":"2023-10-08T16:09:34.179421+0000","last_peered":"2023-10-08T16:09:34.179421+0000","last_clean":"2023-10-08T16:09:34.179421+0000","last_became_active":"2023-10-08T16:04:17.620391+0000","last_became_peered":"2023-10-08T16:04:17.620391+0000","last_unstale":"2023-10-08T16:09:34.179421+0000","last_undegraded":"2023-10-08T16:09:34.179421+0000","last_fullsized":"2023-10-08T16:09:34.179421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'589","last_scrub_stamp":"2023-10-08T16:09:34.178927+0000","last_deep_scrub":"28'589","last_deep_scrub_stamp":"2023-10-08T16:09:34.178927+0000","last_clean_scrub_stamp":"2023-10-08T16:09:34.178927+0000","objects_scrubbed":3,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:45.073957+0000","scrub_duration":0.011898857000000001,"objects_trimmed":0,"snaptrim_duration":0.029228837000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"28'653","reported_seq":731,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:54.884913+0000","last_change":"2023-10-08T16:09:54.884880+0000","last_active":"2023-10-08T16:09:54.884913+0000","last_peered":"2023-10-08T16:09:54.884913+0000","last_clean":"2023-10-08T16:09:54.884913+0000","last_became_active":"2023-10-08T16:04:17.619843+0000","last_became_peered":"2023-10-08T16:04:17.619843+0000","last_unstale":"2023-10-08T16:09:54.884913+0000","last_undegraded":"2023-10-08T16:09:54.884913+0000","last_fullsized":"2023-10-08T16:09:54.884913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'653","last_scrub_stamp":"2023-10-08T16:09:54.884763+0000","last_deep_scrub":"28'653","last_deep_scrub_stamp":"2023-10-08T16:09:54.884763+0000","last_clean_scrub_stamp":"2023-10-08T16:09:54.884763+0000","objects_scrubbed":3,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:44:55.716680+0000","scrub_duration":0.012931170000000001,"objects_trimmed":0,"snaptrim_duration":0.018851915,"stat_sum":{"num_bytes":4105,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"28'622","reported_seq":701,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:47.835072+0000","last_change":"2023-10-08T16:09:47.834951+0000","last_active":"2023-10-08T16:09:47.835072+0000","last_peered":"2023-10-08T16:09:47.835072+0000","last_clean":"2023-10-08T16:09:47.835072+0000","last_became_active":"2023-10-08T16:04:17.625580+0000","last_became_peered":"2023-10-08T16:04:17.625580+0000","last_unstale":"2023-10-08T16:09:47.835072+0000","last_undegraded":"2023-10-08T16:09:47.835072+0000","last_fullsized":"2023-10-08T16:09:47.835072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'622","last_scrub_stamp":"2023-10-08T16:09:47.834643+0000","last_deep_scrub":"28'622","last_deep_scrub_stamp":"2023-10-08T16:09:47.834643+0000","last_clean_scrub_stamp":"2023-10-08T16:09:47.834643+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:31.816880+0000","scrub_duration":0.0043267050000000001,"objects_trimmed":0,"snaptrim_duration":0.018077737,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"28'592","reported_seq":670,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:31.535573+0000","last_change":"2023-10-08T16:09:31.535491+0000","last_active":"2023-10-08T16:09:31.535573+0000","last_peered":"2023-10-08T16:09:31.535573+0000","last_clean":"2023-10-08T16:09:31.535573+0000","last_became_active":"2023-10-08T16:04:17.627197+0000","last_became_peered":"2023-10-08T16:04:17.627197+0000","last_unstale":"2023-10-08T16:09:31.535573+0000","last_undegraded":"2023-10-08T16:09:31.535573+0000","last_fullsized":"2023-10-08T16:09:31.535573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'592","last_scrub_stamp":"2023-10-08T16:09:31.535221+0000","last_deep_scrub":"28'592","last_deep_scrub_stamp":"2023-10-08T16:09:31.535221+0000","last_clean_scrub_stamp":"2023-10-08T16:09:31.535221+0000","objects_scrubbed":3,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:56:01.556005+0000","scrub_duration":0.011238002,"objects_trimmed":0,"snaptrim_duration":0.0098294880000000008,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"28'596","reported_seq":675,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.806907+0000","last_change":"2023-10-08T16:09:20.806843+0000","last_active":"2023-10-08T16:09:20.806907+0000","last_peered":"2023-10-08T16:09:20.806907+0000","last_clean":"2023-10-08T16:09:20.806907+0000","last_became_active":"2023-10-08T16:04:17.625586+0000","last_became_peered":"2023-10-08T16:04:17.625586+0000","last_unstale":"2023-10-08T16:09:20.806907+0000","last_undegraded":"2023-10-08T16:09:20.806907+0000","last_fullsized":"2023-10-08T16:09:20.806907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'596","last_scrub_stamp":"2023-10-08T16:09:20.806564+0000","last_deep_scrub":"28'596","last_deep_scrub_stamp":"2023-10-08T16:09:20.806564+0000","last_clean_scrub_stamp":"2023-10-08T16:09:20.806564+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:23:55.634452+0000","scrub_duration":0.0041559450000000003,"objects_trimmed":0,"snaptrim_duration":0.014288673999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"28'769","reported_seq":848,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:41.498245+0000","last_change":"2023-10-08T16:09:41.498186+0000","last_active":"2023-10-08T16:09:41.498245+0000","last_peered":"2023-10-08T16:09:41.498245+0000","last_clean":"2023-10-08T16:09:41.498245+0000","last_became_active":"2023-10-08T16:04:17.623200+0000","last_became_peered":"2023-10-08T16:04:17.623200+0000","last_unstale":"2023-10-08T16:09:41.498245+0000","last_undegraded":"2023-10-08T16:09:41.498245+0000","last_fullsized":"2023-10-08T16:09:41.498245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'769","last_scrub_stamp":"2023-10-08T16:09:41.497942+0000","last_deep_scrub":"28'769","last_deep_scrub_stamp":"2023-10-08T16:09:41.497942+0000","last_clean_scrub_stamp":"2023-10-08T16:09:41.497942+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:03.401248+0000","scrub_duration":0.003618137,"objects_trimmed":0,"snaptrim_duration":0.012983668,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"28'728","reported_seq":808,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:41.451273+0000","last_change":"2023-10-08T16:09:41.451236+0000","last_active":"2023-10-08T16:09:41.451273+0000","last_peered":"2023-10-08T16:09:41.451273+0000","last_clean":"2023-10-08T16:09:41.451273+0000","last_became_active":"2023-10-08T16:04:17.623945+0000","last_became_peered":"2023-10-08T16:04:17.623945+0000","last_unstale":"2023-10-08T16:09:41.451273+0000","last_undegraded":"2023-10-08T16:09:41.451273+0000","last_fullsized":"2023-10-08T16:09:41.451273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'728","last_scrub_stamp":"2023-10-08T16:09:41.451100+0000","last_deep_scrub":"28'728","last_deep_scrub_stamp":"2023-10-08T16:09:41.451100+0000","last_clean_scrub_stamp":"2023-10-08T16:09:41.451100+0000","objects_scrubbed":3,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:52.346129+0000","scrub_duration":0.011054777,"objects_trimmed":0,"snaptrim_duration":0.045353759,"stat_sum":{"num_bytes":4128,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"28'834","reported_seq":936,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:10:11.806510+0000","last_change":"2023-10-08T16:10:11.806472+0000","last_active":"2023-10-08T16:10:11.806510+0000","last_peered":"2023-10-08T16:10:11.806510+0000","last_clean":"2023-10-08T16:10:11.806510+0000","last_became_active":"2023-10-08T16:04:17.623904+0000","last_became_peered":"2023-10-08T16:04:17.623904+0000","last_unstale":"2023-10-08T16:10:11.806510+0000","last_undegraded":"2023-10-08T16:10:11.806510+0000","last_fullsized":"2023-10-08T16:10:11.806510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'834","last_scrub_stamp":"2023-10-08T16:10:11.806315+0000","last_deep_scrub":"28'834","last_deep_scrub_stamp":"2023-10-08T16:10:11.806315+0000","last_clean_scrub_stamp":"2023-10-08T16:10:11.806315+0000","objects_scrubbed":5,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:52.187983+0000","scrub_duration":0.014588156,"objects_trimmed":0,"snaptrim_duration":0.019052278999999998,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":25,"num_read_kb":20,"num_write":31,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'551","reported_seq":629,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:50.248063+0000","last_change":"2023-10-08T16:09:50.247957+0000","last_active":"2023-10-08T16:09:50.248063+0000","last_peered":"2023-10-08T16:09:50.248063+0000","last_clean":"2023-10-08T16:09:50.248063+0000","last_became_active":"2023-10-08T16:04:17.618549+0000","last_became_peered":"2023-10-08T16:04:17.618549+0000","last_unstale":"2023-10-08T16:09:50.248063+0000","last_undegraded":"2023-10-08T16:09:50.248063+0000","last_fullsized":"2023-10-08T16:09:50.248063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'551","last_scrub_stamp":"2023-10-08T16:09:50.247593+0000","last_deep_scrub":"28'551","last_deep_scrub_stamp":"2023-10-08T16:09:50.247593+0000","last_clean_scrub_stamp":"2023-10-08T16:09:50.247593+0000","objects_scrubbed":2,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:34.229831+0000","scrub_duration":0.010229172,"objects_trimmed":0,"snaptrim_duration":0.011087115999999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'660","reported_seq":738,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:45.814537+0000","last_change":"2023-10-08T16:09:45.814414+0000","last_active":"2023-10-08T16:09:45.814537+0000","last_peered":"2023-10-08T16:09:45.814537+0000","last_clean":"2023-10-08T16:09:45.814537+0000","last_became_active":"2023-10-08T16:04:17.627673+0000","last_became_peered":"2023-10-08T16:04:17.627673+0000","last_unstale":"2023-10-08T16:09:45.814537+0000","last_undegraded":"2023-10-08T16:09:45.814537+0000","last_fullsized":"2023-10-08T16:09:45.814537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'660","last_scrub_stamp":"2023-10-08T16:09:45.814137+0000","last_deep_scrub":"28'660","last_deep_scrub_stamp":"2023-10-08T16:09:45.814137+0000","last_clean_scrub_stamp":"2023-10-08T16:09:45.814137+0000","objects_scrubbed":3,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:07.717443+0000","scrub_duration":0.011989448,"objects_trimmed":0,"snaptrim_duration":0.019445790000000001,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"28'469","reported_seq":548,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:54.253438+0000","last_change":"2023-10-08T16:09:54.253292+0000","last_active":"2023-10-08T16:09:54.253438+0000","last_peered":"2023-10-08T16:09:54.253438+0000","last_clean":"2023-10-08T16:09:54.253438+0000","last_became_active":"2023-10-08T16:04:17.628793+0000","last_became_peered":"2023-10-08T16:04:17.628793+0000","last_unstale":"2023-10-08T16:09:54.253438+0000","last_undegraded":"2023-10-08T16:09:54.253438+0000","last_fullsized":"2023-10-08T16:09:54.253438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'469","last_scrub_stamp":"2023-10-08T16:09:54.253036+0000","last_deep_scrub":"28'469","last_deep_scrub_stamp":"2023-10-08T16:09:54.253036+0000","last_clean_scrub_stamp":"2023-10-08T16:09:54.253036+0000","objects_scrubbed":1,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:41:08.525515+0000","scrub_duration":0.0082754100000000004,"objects_trimmed":0,"snaptrim_duration":0.011350429,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"28'660","reported_seq":739,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:48.513950+0000","last_change":"2023-10-08T16:09:48.513876+0000","last_active":"2023-10-08T16:09:48.513950+0000","last_peered":"2023-10-08T16:09:48.513950+0000","last_clean":"2023-10-08T16:09:48.513950+0000","last_became_active":"2023-10-08T16:04:17.625220+0000","last_became_peered":"2023-10-08T16:04:17.625220+0000","last_unstale":"2023-10-08T16:09:48.513950+0000","last_undegraded":"2023-10-08T16:09:48.513950+0000","last_fullsized":"2023-10-08T16:09:48.513950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'660","last_scrub_stamp":"2023-10-08T16:09:48.513639+0000","last_deep_scrub":"28'660","last_deep_scrub_stamp":"2023-10-08T16:09:48.513639+0000","last_clean_scrub_stamp":"2023-10-08T16:09:48.513639+0000","objects_scrubbed":1,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:20.205763+0000","scrub_duration":0.0082496940000000001,"objects_trimmed":0,"snaptrim_duration":0.013452108000000001,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'351","reported_seq":430,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:32.175421+0000","last_change":"2023-10-08T16:09:32.175337+0000","last_active":"2023-10-08T16:09:32.175421+0000","last_peered":"2023-10-08T16:09:32.175421+0000","last_clean":"2023-10-08T16:09:32.175421+0000","last_became_active":"2023-10-08T16:04:17.629574+0000","last_became_peered":"2023-10-08T16:04:17.629574+0000","last_unstale":"2023-10-08T16:09:32.175421+0000","last_undegraded":"2023-10-08T16:09:32.175421+0000","last_fullsized":"2023-10-08T16:09:32.175421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'351","last_scrub_stamp":"2023-10-08T16:09:32.175035+0000","last_deep_scrub":"28'351","last_deep_scrub_stamp":"2023-10-08T16:09:32.175035+0000","last_clean_scrub_stamp":"2023-10-08T16:09:32.175035+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:49.594680+0000","scrub_duration":0.0040114620000000004,"objects_trimmed":0,"snaptrim_duration":0.024743081,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"28'585","reported_seq":664,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:48.174872+0000","last_change":"2023-10-08T16:09:48.174762+0000","last_active":"2023-10-08T16:09:48.174872+0000","last_peered":"2023-10-08T16:09:48.174872+0000","last_clean":"2023-10-08T16:09:48.174872+0000","last_became_active":"2023-10-08T16:04:17.626420+0000","last_became_peered":"2023-10-08T16:04:17.626420+0000","last_unstale":"2023-10-08T16:09:48.174872+0000","last_undegraded":"2023-10-08T16:09:48.174872+0000","last_fullsized":"2023-10-08T16:09:48.174872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'585","last_scrub_stamp":"2023-10-08T16:09:48.174483+0000","last_deep_scrub":"28'585","last_deep_scrub_stamp":"2023-10-08T16:09:48.174483+0000","last_clean_scrub_stamp":"2023-10-08T16:09:48.174483+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:10.077789+0000","scrub_duration":0.0041598870000000001,"objects_trimmed":0,"snaptrim_duration":0.011442964999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'586","reported_seq":665,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:39.418064+0000","last_change":"2023-10-08T16:09:39.417990+0000","last_active":"2023-10-08T16:09:39.418064+0000","last_peered":"2023-10-08T16:09:39.418064+0000","last_clean":"2023-10-08T16:09:39.418064+0000","last_became_active":"2023-10-08T16:04:17.618207+0000","last_became_peered":"2023-10-08T16:04:17.618207+0000","last_unstale":"2023-10-08T16:09:39.418064+0000","last_undegraded":"2023-10-08T16:09:39.418064+0000","last_fullsized":"2023-10-08T16:09:39.418064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'586","last_scrub_stamp":"2023-10-08T16:09:39.417718+0000","last_deep_scrub":"28'586","last_deep_scrub_stamp":"2023-10-08T16:09:39.417718+0000","last_clean_scrub_stamp":"2023-10-08T16:09:39.417718+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:56.837364+0000","scrub_duration":0.0037683299999999999,"objects_trimmed":0,"snaptrim_duration":0.042752309000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"28'403","reported_seq":482,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:51.836016+0000","last_change":"2023-10-08T16:09:51.835933+0000","last_active":"2023-10-08T16:09:51.836016+0000","last_peered":"2023-10-08T16:09:51.836016+0000","last_clean":"2023-10-08T16:09:51.836016+0000","last_became_active":"2023-10-08T16:04:17.627093+0000","last_became_peered":"2023-10-08T16:04:17.627093+0000","last_unstale":"2023-10-08T16:09:51.836016+0000","last_undegraded":"2023-10-08T16:09:51.836016+0000","last_fullsized":"2023-10-08T16:09:51.836016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'403","last_scrub_stamp":"2023-10-08T16:09:51.835660+0000","last_deep_scrub":"28'403","last_deep_scrub_stamp":"2023-10-08T16:09:51.835660+0000","last_clean_scrub_stamp":"2023-10-08T16:09:51.835660+0000","objects_scrubbed":2,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:41:06.108139+0000","scrub_duration":0.0092781470000000005,"objects_trimmed":0,"snaptrim_duration":0.020438813,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"28'946","reported_seq":1024,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:28.533253+0000","last_change":"2023-10-08T16:09:28.533141+0000","last_active":"2023-10-08T16:09:28.533253+0000","last_peered":"2023-10-08T16:09:28.533253+0000","last_clean":"2023-10-08T16:09:28.533253+0000","last_became_active":"2023-10-08T16:04:17.629049+0000","last_became_peered":"2023-10-08T16:04:17.629049+0000","last_unstale":"2023-10-08T16:09:28.533253+0000","last_undegraded":"2023-10-08T16:09:28.533253+0000","last_fullsized":"2023-10-08T16:09:28.533253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'946","last_scrub_stamp":"2023-10-08T16:09:28.532841+0000","last_deep_scrub":"28'946","last_deep_scrub_stamp":"2023-10-08T16:09:28.532841+0000","last_clean_scrub_stamp":"2023-10-08T16:09:28.532841+0000","objects_scrubbed":5,"log_size":946,"log_dups_size":0,"ondisk_log_size":946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:37.966495+0000","scrub_duration":0.013109762,"objects_trimmed":0,"snaptrim_duration":0.01455822,"stat_sum":{"num_bytes":8206,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"28'746","reported_seq":825,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:47.488412+0000","last_change":"2023-10-08T16:09:47.488342+0000","last_active":"2023-10-08T16:09:47.488412+0000","last_peered":"2023-10-08T16:09:47.488412+0000","last_clean":"2023-10-08T16:09:47.488412+0000","last_became_active":"2023-10-08T16:04:17.632012+0000","last_became_peered":"2023-10-08T16:04:17.632012+0000","last_unstale":"2023-10-08T16:09:47.488412+0000","last_undegraded":"2023-10-08T16:09:47.488412+0000","last_fullsized":"2023-10-08T16:09:47.488412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'746","last_scrub_stamp":"2023-10-08T16:09:47.488070+0000","last_deep_scrub":"28'746","last_deep_scrub_stamp":"2023-10-08T16:09:47.488070+0000","last_clean_scrub_stamp":"2023-10-08T16:09:47.488070+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:41:01.760549+0000","scrub_duration":0.0042972970000000003,"objects_trimmed":0,"snaptrim_duration":0.010590815999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"28'514","reported_seq":593,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:33.210343+0000","last_change":"2023-10-08T16:09:33.210256+0000","last_active":"2023-10-08T16:09:33.210343+0000","last_peered":"2023-10-08T16:09:33.210343+0000","last_clean":"2023-10-08T16:09:33.210343+0000","last_became_active":"2023-10-08T16:04:17.623220+0000","last_became_peered":"2023-10-08T16:04:17.623220+0000","last_unstale":"2023-10-08T16:09:33.210343+0000","last_undegraded":"2023-10-08T16:09:33.210343+0000","last_fullsized":"2023-10-08T16:09:33.210343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'514","last_scrub_stamp":"2023-10-08T16:09:33.209999+0000","last_deep_scrub":"28'514","last_deep_scrub_stamp":"2023-10-08T16:09:33.209999+0000","last_clean_scrub_stamp":"2023-10-08T16:09:33.209999+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:59.313227+0000","scrub_duration":0.0040553860000000002,"objects_trimmed":0,"snaptrim_duration":0.010375987999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'748","reported_seq":777,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:21.543351+0000","last_change":"2023-10-08T16:09:21.543315+0000","last_active":"2023-10-08T16:09:21.543351+0000","last_peered":"2023-10-08T16:09:21.543351+0000","last_clean":"2023-10-08T16:09:21.543351+0000","last_became_active":"2023-10-08T16:04:16.660183+0000","last_became_peered":"2023-10-08T16:04:16.660183+0000","last_unstale":"2023-10-08T16:09:21.543351+0000","last_undegraded":"2023-10-08T16:09:21.543351+0000","last_fullsized":"2023-10-08T16:09:21.543351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'748","last_scrub_stamp":"2023-10-08T16:09:21.543182+0000","last_deep_scrub":"28'748","last_deep_scrub_stamp":"2023-10-08T16:09:21.543182+0000","last_clean_scrub_stamp":"2023-10-08T16:09:21.543182+0000","objects_scrubbed":1,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:24.849342+0000","scrub_duration":0.022119043000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":743,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'638","reported_seq":717,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:36.437028+0000","last_change":"2023-10-08T16:09:36.436892+0000","last_active":"2023-10-08T16:09:36.437028+0000","last_peered":"2023-10-08T16:09:36.437028+0000","last_clean":"2023-10-08T16:09:36.437028+0000","last_became_active":"2023-10-08T16:04:17.620532+0000","last_became_peered":"2023-10-08T16:04:17.620532+0000","last_unstale":"2023-10-08T16:09:36.437028+0000","last_undegraded":"2023-10-08T16:09:36.437028+0000","last_fullsized":"2023-10-08T16:09:36.437028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'638","last_scrub_stamp":"2023-10-08T16:09:36.436578+0000","last_deep_scrub":"28'638","last_deep_scrub_stamp":"2023-10-08T16:09:36.436578+0000","last_clean_scrub_stamp":"2023-10-08T16:09:36.436578+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:34.975714+0000","scrub_duration":0.0046835050000000001,"objects_trimmed":0,"snaptrim_duration":0.042650311000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"28'757","reported_seq":786,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:23.727018+0000","last_change":"2023-10-08T16:09:23.726922+0000","last_active":"2023-10-08T16:09:23.727018+0000","last_peered":"2023-10-08T16:09:23.727018+0000","last_clean":"2023-10-08T16:09:23.727018+0000","last_became_active":"2023-10-08T16:04:16.653936+0000","last_became_peered":"2023-10-08T16:04:16.653936+0000","last_unstale":"2023-10-08T16:09:23.727018+0000","last_undegraded":"2023-10-08T16:09:23.727018+0000","last_fullsized":"2023-10-08T16:09:23.727018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'757","last_scrub_stamp":"2023-10-08T16:09:23.726712+0000","last_deep_scrub":"28'757","last_deep_scrub_stamp":"2023-10-08T16:09:23.726712+0000","last_clean_scrub_stamp":"2023-10-08T16:09:23.726712+0000","objects_scrubbed":1,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:53.747495+0000","scrub_duration":0.024528384,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"28'11","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:25.609965+0000","last_change":"2023-10-08T16:09:25.609898+0000","last_active":"2023-10-08T16:09:25.609965+0000","last_peered":"2023-10-08T16:09:25.609965+0000","last_clean":"2023-10-08T16:09:25.609965+0000","last_became_active":"2023-10-08T16:04:16.656642+0000","last_became_peered":"2023-10-08T16:04:16.656642+0000","last_unstale":"2023-10-08T16:09:25.609965+0000","last_undegraded":"2023-10-08T16:09:25.609965+0000","last_fullsized":"2023-10-08T16:09:25.609965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2023-10-08T16:09:25.609667+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2023-10-08T16:09:25.609667+0000","last_clean_scrub_stamp":"2023-10-08T16:09:25.609667+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:35.043321+0000","scrub_duration":0.004097987,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'648","reported_seq":725,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:47.346984+0000","last_change":"2023-10-08T16:09:47.346906+0000","last_active":"2023-10-08T16:09:47.346984+0000","last_peered":"2023-10-08T16:09:47.346984+0000","last_clean":"2023-10-08T16:09:47.346984+0000","last_became_active":"2023-10-08T16:04:59.029346+0000","last_became_peered":"2023-10-08T16:04:59.029346+0000","last_unstale":"2023-10-08T16:09:47.346984+0000","last_undegraded":"2023-10-08T16:09:47.346984+0000","last_fullsized":"2023-10-08T16:09:47.346984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'648","last_scrub_stamp":"2023-10-08T16:09:47.346655+0000","last_deep_scrub":"28'648","last_deep_scrub_stamp":"2023-10-08T16:09:47.346655+0000","last_clean_scrub_stamp":"2023-10-08T16:09:47.346655+0000","objects_scrubbed":1,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:31.328893+0000","scrub_duration":0.0074831120000000001,"objects_trimmed":0,"snaptrim_duration":0.024714613999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'1528","reported_seq":1557,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:27.726484+0000","last_change":"2023-10-08T16:09:27.726436+0000","last_active":"2023-10-08T16:09:27.726484+0000","last_peered":"2023-10-08T16:09:27.726484+0000","last_clean":"2023-10-08T16:09:27.726484+0000","last_became_active":"2023-10-08T16:04:16.651258+0000","last_became_peered":"2023-10-08T16:04:16.651258+0000","last_unstale":"2023-10-08T16:09:27.726484+0000","last_undegraded":"2023-10-08T16:09:27.726484+0000","last_fullsized":"2023-10-08T16:09:27.726484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1528","last_scrub_stamp":"2023-10-08T16:09:27.726254+0000","last_deep_scrub":"28'1528","last_deep_scrub_stamp":"2023-10-08T16:09:27.726254+0000","last_clean_scrub_stamp":"2023-10-08T16:09:27.726254+0000","objects_scrubbed":2,"log_size":1528,"log_dups_size":0,"ondisk_log_size":1528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:45.641026+0000","scrub_duration":0.043874232999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1522,"num_write_kb":8929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"28'757","reported_seq":836,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:45.382828+0000","last_change":"2023-10-08T16:09:45.382718+0000","last_active":"2023-10-08T16:09:45.382828+0000","last_peered":"2023-10-08T16:09:45.382828+0000","last_clean":"2023-10-08T16:09:45.382828+0000","last_became_active":"2023-10-08T16:04:17.629765+0000","last_became_peered":"2023-10-08T16:04:17.629765+0000","last_unstale":"2023-10-08T16:09:45.382828+0000","last_undegraded":"2023-10-08T16:09:45.382828+0000","last_fullsized":"2023-10-08T16:09:45.382828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'757","last_scrub_stamp":"2023-10-08T16:09:45.382402+0000","last_deep_scrub":"28'757","last_deep_scrub_stamp":"2023-10-08T16:09:45.382402+0000","last_clean_scrub_stamp":"2023-10-08T16:09:45.382402+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:07.285707+0000","scrub_duration":0.0038822510000000002,"objects_trimmed":0,"snaptrim_duration":0.026861545000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'13","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:26.641725+0000","last_change":"2023-10-08T16:09:26.641657+0000","last_active":"2023-10-08T16:09:26.641725+0000","last_peered":"2023-10-08T16:09:26.641725+0000","last_clean":"2023-10-08T16:09:26.641725+0000","last_became_active":"2023-10-08T16:04:16.654002+0000","last_became_peered":"2023-10-08T16:04:16.654002+0000","last_unstale":"2023-10-08T16:09:26.641725+0000","last_undegraded":"2023-10-08T16:09:26.641725+0000","last_fullsized":"2023-10-08T16:09:26.641725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2023-10-08T16:09:26.641400+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2023-10-08T16:09:26.641400+0000","last_clean_scrub_stamp":"2023-10-08T16:09:26.641400+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:10:45.643591+0000","scrub_duration":0.0040653290000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"28'597","reported_seq":675,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:52.864482+0000","last_change":"2023-10-08T16:09:52.864379+0000","last_active":"2023-10-08T16:09:52.864482+0000","last_peered":"2023-10-08T16:09:52.864482+0000","last_clean":"2023-10-08T16:09:52.864482+0000","last_became_active":"2023-10-08T16:04:17.624071+0000","last_became_peered":"2023-10-08T16:04:17.624071+0000","last_unstale":"2023-10-08T16:09:52.864482+0000","last_undegraded":"2023-10-08T16:09:52.864482+0000","last_fullsized":"2023-10-08T16:09:52.864482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'597","last_scrub_stamp":"2023-10-08T16:09:52.863956+0000","last_deep_scrub":"28'597","last_deep_scrub_stamp":"2023-10-08T16:09:52.863956+0000","last_clean_scrub_stamp":"2023-10-08T16:09:52.863956+0000","objects_scrubbed":2,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:24.556080+0000","scrub_duration":0.010737066999999999,"objects_trimmed":0,"snaptrim_duration":0.018261580999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"26'15","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:28.703566+0000","last_change":"2023-10-08T16:09:28.703480+0000","last_active":"2023-10-08T16:09:28.703566+0000","last_peered":"2023-10-08T16:09:28.703566+0000","last_clean":"2023-10-08T16:09:28.703566+0000","last_became_active":"2023-10-08T16:04:16.656992+0000","last_became_peered":"2023-10-08T16:04:16.656992+0000","last_unstale":"2023-10-08T16:09:28.703566+0000","last_undegraded":"2023-10-08T16:09:28.703566+0000","last_fullsized":"2023-10-08T16:09:28.703566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'15","last_scrub_stamp":"2023-10-08T16:09:28.703215+0000","last_deep_scrub":"26'15","last_deep_scrub_stamp":"2023-10-08T16:09:28.703215+0000","last_clean_scrub_stamp":"2023-10-08T16:09:28.703215+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:27.242351+0000","scrub_duration":0.003527681,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"28'498","reported_seq":577,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:37.423510+0000","last_change":"2023-10-08T16:09:37.423417+0000","last_active":"2023-10-08T16:09:37.423510+0000","last_peered":"2023-10-08T16:09:37.423510+0000","last_clean":"2023-10-08T16:09:37.423510+0000","last_became_active":"2023-10-08T16:04:17.621862+0000","last_became_peered":"2023-10-08T16:04:17.621862+0000","last_unstale":"2023-10-08T16:09:37.423510+0000","last_undegraded":"2023-10-08T16:09:37.423510+0000","last_fullsized":"2023-10-08T16:09:37.423510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'498","last_scrub_stamp":"2023-10-08T16:09:37.423145+0000","last_deep_scrub":"28'498","last_deep_scrub_stamp":"2023-10-08T16:09:37.423145+0000","last_clean_scrub_stamp":"2023-10-08T16:09:37.423145+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:10:56.425335+0000","scrub_duration":0.0043366359999999996,"objects_trimmed":0,"snaptrim_duration":0.045929303999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"28'56","reported_seq":85,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:28.186088+0000","last_change":"2023-10-08T16:09:28.186016+0000","last_active":"2023-10-08T16:09:28.186088+0000","last_peered":"2023-10-08T16:09:28.186088+0000","last_clean":"2023-10-08T16:09:28.186088+0000","last_became_active":"2023-10-08T16:04:16.656041+0000","last_became_peered":"2023-10-08T16:04:16.656041+0000","last_unstale":"2023-10-08T16:09:28.186088+0000","last_undegraded":"2023-10-08T16:09:28.186088+0000","last_fullsized":"2023-10-08T16:09:28.186088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'56","last_scrub_stamp":"2023-10-08T16:09:28.185753+0000","last_deep_scrub":"28'56","last_deep_scrub_stamp":"2023-10-08T16:09:28.185753+0000","last_clean_scrub_stamp":"2023-10-08T16:09:28.185753+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:46.100526+0000","scrub_duration":0.0085979019999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'579","reported_seq":658,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:34.260199+0000","last_change":"2023-10-08T16:09:34.260069+0000","last_active":"2023-10-08T16:09:34.260199+0000","last_peered":"2023-10-08T16:09:34.260199+0000","last_clean":"2023-10-08T16:09:34.260199+0000","last_became_active":"2023-10-08T16:04:17.620654+0000","last_became_peered":"2023-10-08T16:04:17.620654+0000","last_unstale":"2023-10-08T16:09:34.260199+0000","last_undegraded":"2023-10-08T16:09:34.260199+0000","last_fullsized":"2023-10-08T16:09:34.260199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'579","last_scrub_stamp":"2023-10-08T16:09:34.259764+0000","last_deep_scrub":"28'579","last_deep_scrub_stamp":"2023-10-08T16:09:34.259764+0000","last_clean_scrub_stamp":"2023-10-08T16:09:34.259764+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:20:52.892594+0000","scrub_duration":0.0038350179999999999,"objects_trimmed":0,"snaptrim_duration":0.010626305000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"28'805","reported_seq":834,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:28.611581+0000","last_change":"2023-10-08T16:09:28.611547+0000","last_active":"2023-10-08T16:09:28.611581+0000","last_peered":"2023-10-08T16:09:28.611581+0000","last_clean":"2023-10-08T16:09:28.611581+0000","last_became_active":"2023-10-08T16:04:16.653001+0000","last_became_peered":"2023-10-08T16:04:16.653001+0000","last_unstale":"2023-10-08T16:09:28.611581+0000","last_undegraded":"2023-10-08T16:09:28.611581+0000","last_fullsized":"2023-10-08T16:09:28.611581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'805","last_scrub_stamp":"2023-10-08T16:09:28.611394+0000","last_deep_scrub":"28'805","last_deep_scrub_stamp":"2023-10-08T16:09:28.611394+0000","last_clean_scrub_stamp":"2023-10-08T16:09:28.611394+0000","objects_scrubbed":4,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:46.031039+0000","scrub_duration":0.025885490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194948,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":797,"num_write_kb":4446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"28'523","reported_seq":602,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:10:17.801220+0000","last_change":"2023-10-08T16:10:17.801121+0000","last_active":"2023-10-08T16:10:17.801220+0000","last_peered":"2023-10-08T16:10:17.801220+0000","last_clean":"2023-10-08T16:10:17.801220+0000","last_became_active":"2023-10-08T16:04:17.631130+0000","last_became_peered":"2023-10-08T16:04:17.631130+0000","last_unstale":"2023-10-08T16:10:17.801220+0000","last_undegraded":"2023-10-08T16:10:17.801220+0000","last_fullsized":"2023-10-08T16:10:17.801220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'523","last_scrub_stamp":"2023-10-08T16:10:17.800860+0000","last_deep_scrub":"28'523","last_deep_scrub_stamp":"2023-10-08T16:10:17.800860+0000","last_clean_scrub_stamp":"2023-10-08T16:10:17.800860+0000","objects_scrubbed":1,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:26.277062+0000","scrub_duration":0.0092025270000000003,"objects_trimmed":0,"snaptrim_duration":0.013318705,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"28'1516","reported_seq":1545,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:19.369792+0000","last_change":"2023-10-08T16:09:19.369726+0000","last_active":"2023-10-08T16:09:19.369792+0000","last_peered":"2023-10-08T16:09:19.369792+0000","last_clean":"2023-10-08T16:09:19.369792+0000","last_became_active":"2023-10-08T16:04:16.660830+0000","last_became_peered":"2023-10-08T16:04:16.660830+0000","last_unstale":"2023-10-08T16:09:19.369792+0000","last_undegraded":"2023-10-08T16:09:19.369792+0000","last_fullsized":"2023-10-08T16:09:19.369792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1516","last_scrub_stamp":"2023-10-08T16:09:19.369511+0000","last_deep_scrub":"28'1516","last_deep_scrub_stamp":"2023-10-08T16:09:19.369511+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.369511+0000","objects_scrubbed":4,"log_size":1516,"log_dups_size":0,"ondisk_log_size":1516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:32:53.363596+0000","scrub_duration":0.042270937000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1505,"num_write_kb":8987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"28'654","reported_seq":733,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:25.411523+0000","last_change":"2023-10-08T16:09:25.411435+0000","last_active":"2023-10-08T16:09:25.411523+0000","last_peered":"2023-10-08T16:09:25.411523+0000","last_clean":"2023-10-08T16:09:25.411523+0000","last_became_active":"2023-10-08T16:04:17.623038+0000","last_became_peered":"2023-10-08T16:04:17.623038+0000","last_unstale":"2023-10-08T16:09:25.411523+0000","last_undegraded":"2023-10-08T16:09:25.411523+0000","last_fullsized":"2023-10-08T16:09:25.411523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'654","last_scrub_stamp":"2023-10-08T16:09:25.411173+0000","last_deep_scrub":"28'654","last_deep_scrub_stamp":"2023-10-08T16:09:25.411173+0000","last_clean_scrub_stamp":"2023-10-08T16:09:25.411173+0000","objects_scrubbed":2,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:28.717332+0000","scrub_duration":0.010251712,"objects_trimmed":0,"snaptrim_duration":0.045488809999999998,"stat_sum":{"num_bytes":4107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"26'14","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:29.695218+0000","last_change":"2023-10-08T16:09:29.695141+0000","last_active":"2023-10-08T16:09:29.695218+0000","last_peered":"2023-10-08T16:09:29.695218+0000","last_clean":"2023-10-08T16:09:29.695218+0000","last_became_active":"2023-10-08T16:04:16.649675+0000","last_became_peered":"2023-10-08T16:04:16.649675+0000","last_unstale":"2023-10-08T16:09:29.695218+0000","last_undegraded":"2023-10-08T16:09:29.695218+0000","last_fullsized":"2023-10-08T16:09:29.695218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'14","last_scrub_stamp":"2023-10-08T16:09:29.694856+0000","last_deep_scrub":"26'14","last_deep_scrub_stamp":"2023-10-08T16:09:29.694856+0000","last_clean_scrub_stamp":"2023-10-08T16:09:29.694856+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:35:23.444046+0000","scrub_duration":0.0044355009999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'966","reported_seq":1045,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:46.764417+0000","last_change":"2023-10-08T16:09:46.764296+0000","last_active":"2023-10-08T16:09:46.764417+0000","last_peered":"2023-10-08T16:09:46.764417+0000","last_clean":"2023-10-08T16:09:46.764417+0000","last_became_active":"2023-10-08T16:04:17.628865+0000","last_became_peered":"2023-10-08T16:04:17.628865+0000","last_unstale":"2023-10-08T16:09:46.764417+0000","last_undegraded":"2023-10-08T16:09:46.764417+0000","last_fullsized":"2023-10-08T16:09:46.764417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'966","last_scrub_stamp":"2023-10-08T16:09:46.764005+0000","last_deep_scrub":"28'966","last_deep_scrub_stamp":"2023-10-08T16:09:46.764005+0000","last_clean_scrub_stamp":"2023-10-08T16:09:46.764005+0000","objects_scrubbed":0,"log_size":966,"log_dups_size":0,"ondisk_log_size":966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:44:47.595922+0000","scrub_duration":0.0036926429999999998,"objects_trimmed":0,"snaptrim_duration":0.013199152,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"27'12","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:24.699933+0000","last_change":"2023-10-08T16:09:24.699855+0000","last_active":"2023-10-08T16:09:24.699933+0000","last_peered":"2023-10-08T16:09:24.699933+0000","last_clean":"2023-10-08T16:09:24.699933+0000","last_became_active":"2023-10-08T16:04:16.653342+0000","last_became_peered":"2023-10-08T16:04:16.653342+0000","last_unstale":"2023-10-08T16:09:24.699933+0000","last_undegraded":"2023-10-08T16:09:24.699933+0000","last_fullsized":"2023-10-08T16:09:24.699933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2023-10-08T16:09:24.699597+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2023-10-08T16:09:24.699597+0000","last_clean_scrub_stamp":"2023-10-08T16:09:24.699597+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:42.614369+0000","scrub_duration":0.003422217,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"28'290","reported_seq":369,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:29.576032+0000","last_change":"2023-10-08T16:09:29.575956+0000","last_active":"2023-10-08T16:09:29.576032+0000","last_peered":"2023-10-08T16:09:29.576032+0000","last_clean":"2023-10-08T16:09:29.576032+0000","last_became_active":"2023-10-08T16:04:17.624454+0000","last_became_peered":"2023-10-08T16:04:17.624454+0000","last_unstale":"2023-10-08T16:09:29.576032+0000","last_undegraded":"2023-10-08T16:09:29.576032+0000","last_fullsized":"2023-10-08T16:09:29.576032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'290","last_scrub_stamp":"2023-10-08T16:09:29.575702+0000","last_deep_scrub":"28'290","last_deep_scrub_stamp":"2023-10-08T16:09:29.575702+0000","last_clean_scrub_stamp":"2023-10-08T16:09:29.575702+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:58.715495+0000","scrub_duration":0.0044317380000000002,"objects_trimmed":0,"snaptrim_duration":0.012620849,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"28'26","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:25.562641+0000","last_change":"2023-10-08T16:09:25.562521+0000","last_active":"2023-10-08T16:09:25.562641+0000","last_peered":"2023-10-08T16:09:25.562641+0000","last_clean":"2023-10-08T16:09:25.562641+0000","last_became_active":"2023-10-08T16:04:16.658886+0000","last_became_peered":"2023-10-08T16:04:16.658886+0000","last_unstale":"2023-10-08T16:09:25.562641+0000","last_undegraded":"2023-10-08T16:09:25.562641+0000","last_fullsized":"2023-10-08T16:09:25.562641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'26","last_scrub_stamp":"2023-10-08T16:09:25.562132+0000","last_deep_scrub":"28'26","last_deep_scrub_stamp":"2023-10-08T16:09:25.562132+0000","last_clean_scrub_stamp":"2023-10-08T16:09:25.562132+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:37:32.665776+0000","scrub_duration":0.011851375000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"28'592","reported_seq":671,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:10:08.879397+0000","last_change":"2023-10-08T16:10:08.879341+0000","last_active":"2023-10-08T16:10:08.879397+0000","last_peered":"2023-10-08T16:10:08.879397+0000","last_clean":"2023-10-08T16:10:08.879397+0000","last_became_active":"2023-10-08T16:04:17.628605+0000","last_became_peered":"2023-10-08T16:04:17.628605+0000","last_unstale":"2023-10-08T16:10:08.879397+0000","last_undegraded":"2023-10-08T16:10:08.879397+0000","last_fullsized":"2023-10-08T16:10:08.879397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'592","last_scrub_stamp":"2023-10-08T16:10:08.879079+0000","last_deep_scrub":"28'592","last_deep_scrub_stamp":"2023-10-08T16:10:08.879079+0000","last_clean_scrub_stamp":"2023-10-08T16:10:08.879079+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:09.928420+0000","scrub_duration":0.0047537439999999999,"objects_trimmed":0,"snaptrim_duration":0.013094041000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'19","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:29.245466+0000","last_change":"2023-10-08T16:09:29.245405+0000","last_active":"2023-10-08T16:09:29.245466+0000","last_peered":"2023-10-08T16:09:29.245466+0000","last_clean":"2023-10-08T16:09:29.245466+0000","last_became_active":"2023-10-08T16:04:16.660651+0000","last_became_peered":"2023-10-08T16:04:16.660651+0000","last_unstale":"2023-10-08T16:09:29.245466+0000","last_undegraded":"2023-10-08T16:09:29.245466+0000","last_fullsized":"2023-10-08T16:09:29.245466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'19","last_scrub_stamp":"2023-10-08T16:09:29.245108+0000","last_deep_scrub":"28'19","last_deep_scrub_stamp":"2023-10-08T16:09:29.245108+0000","last_clean_scrub_stamp":"2023-10-08T16:09:29.245108+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:33:03.239192+0000","scrub_duration":0.0073818440000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"28'296","reported_seq":375,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:44.799671+0000","last_change":"2023-10-08T16:09:44.799601+0000","last_active":"2023-10-08T16:09:44.799671+0000","last_peered":"2023-10-08T16:09:44.799671+0000","last_clean":"2023-10-08T16:09:44.799671+0000","last_became_active":"2023-10-08T16:04:17.628701+0000","last_became_peered":"2023-10-08T16:04:17.628701+0000","last_unstale":"2023-10-08T16:09:44.799671+0000","last_undegraded":"2023-10-08T16:09:44.799671+0000","last_fullsized":"2023-10-08T16:09:44.799671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'296","last_scrub_stamp":"2023-10-08T16:09:44.799289+0000","last_deep_scrub":"28'296","last_deep_scrub_stamp":"2023-10-08T16:09:44.799289+0000","last_clean_scrub_stamp":"2023-10-08T16:09:44.799289+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:16.491413+0000","scrub_duration":0.0039462280000000004,"objects_trimmed":0,"snaptrim_duration":0.012739413999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'278","reported_seq":307,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:24.541205+0000","last_change":"2023-10-08T16:09:24.541140+0000","last_active":"2023-10-08T16:09:24.541205+0000","last_peered":"2023-10-08T16:09:24.541205+0000","last_clean":"2023-10-08T16:09:24.541205+0000","last_became_active":"2023-10-08T16:04:16.651709+0000","last_became_peered":"2023-10-08T16:04:16.651709+0000","last_unstale":"2023-10-08T16:09:24.541205+0000","last_undegraded":"2023-10-08T16:09:24.541205+0000","last_fullsized":"2023-10-08T16:09:24.541205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'278","last_scrub_stamp":"2023-10-08T16:09:24.540994+0000","last_deep_scrub":"28'278","last_deep_scrub_stamp":"2023-10-08T16:09:24.540994+0000","last_clean_scrub_stamp":"2023-10-08T16:09:24.540994+0000","objects_scrubbed":2,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:20:43.173823+0000","scrub_duration":0.020437908000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"28'662","reported_seq":740,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:10:10.906245+0000","last_change":"2023-10-08T16:10:10.906181+0000","last_active":"2023-10-08T16:10:10.906245+0000","last_peered":"2023-10-08T16:10:10.906245+0000","last_clean":"2023-10-08T16:10:10.906245+0000","last_became_active":"2023-10-08T16:04:17.630908+0000","last_became_peered":"2023-10-08T16:04:17.630908+0000","last_unstale":"2023-10-08T16:10:10.906245+0000","last_undegraded":"2023-10-08T16:10:10.906245+0000","last_fullsized":"2023-10-08T16:10:10.906245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'662","last_scrub_stamp":"2023-10-08T16:10:10.905939+0000","last_deep_scrub":"28'662","last_deep_scrub_stamp":"2023-10-08T16:10:10.905939+0000","last_clean_scrub_stamp":"2023-10-08T16:10:10.905939+0000","objects_scrubbed":2,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:52:06.408074+0000","scrub_duration":0.010987073999999999,"objects_trimmed":0,"snaptrim_duration":0.014318363000000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"28'766","reported_seq":795,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:21.169223+0000","last_change":"2023-10-08T16:09:21.169188+0000","last_active":"2023-10-08T16:09:21.169223+0000","last_peered":"2023-10-08T16:09:21.169223+0000","last_clean":"2023-10-08T16:09:21.169223+0000","last_became_active":"2023-10-08T16:04:16.655245+0000","last_became_peered":"2023-10-08T16:04:16.655245+0000","last_unstale":"2023-10-08T16:09:21.169223+0000","last_undegraded":"2023-10-08T16:09:21.169223+0000","last_fullsized":"2023-10-08T16:09:21.169223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'766","last_scrub_stamp":"2023-10-08T16:09:21.169034+0000","last_deep_scrub":"28'766","last_deep_scrub_stamp":"2023-10-08T16:09:21.169034+0000","last_clean_scrub_stamp":"2023-10-08T16:09:21.169034+0000","objects_scrubbed":2,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:37:28.272678+0000","scrub_duration":0.023529600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":759,"num_write_kb":4511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"28'465","reported_seq":544,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:32.759016+0000","last_change":"2023-10-08T16:09:32.758894+0000","last_active":"2023-10-08T16:09:32.759016+0000","last_peered":"2023-10-08T16:09:32.759016+0000","last_clean":"2023-10-08T16:09:32.759016+0000","last_became_active":"2023-10-08T16:04:17.627369+0000","last_became_peered":"2023-10-08T16:04:17.627369+0000","last_unstale":"2023-10-08T16:09:32.759016+0000","last_undegraded":"2023-10-08T16:09:32.759016+0000","last_fullsized":"2023-10-08T16:09:32.759016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'465","last_scrub_stamp":"2023-10-08T16:09:32.758612+0000","last_deep_scrub":"28'465","last_deep_scrub_stamp":"2023-10-08T16:09:32.758612+0000","last_clean_scrub_stamp":"2023-10-08T16:09:32.758612+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:50:17.550433+0000","scrub_duration":0.0040334330000000003,"objects_trimmed":0,"snaptrim_duration":0.020078136999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"28'12","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:23.499905+0000","last_change":"2023-10-08T16:09:23.499833+0000","last_active":"2023-10-08T16:09:23.499905+0000","last_peered":"2023-10-08T16:09:23.499905+0000","last_clean":"2023-10-08T16:09:23.499905+0000","last_became_active":"2023-10-08T16:04:16.654124+0000","last_became_peered":"2023-10-08T16:04:16.654124+0000","last_unstale":"2023-10-08T16:09:23.499905+0000","last_undegraded":"2023-10-08T16:09:23.499905+0000","last_fullsized":"2023-10-08T16:09:23.499905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2023-10-08T16:09:23.499570+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2023-10-08T16:09:23.499570+0000","last_clean_scrub_stamp":"2023-10-08T16:09:23.499570+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:49.602798+0000","scrub_duration":0.0041480989999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'569","reported_seq":646,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:33.468529+0000","last_change":"2023-10-08T16:09:33.468457+0000","last_active":"2023-10-08T16:09:33.468529+0000","last_peered":"2023-10-08T16:09:33.468529+0000","last_clean":"2023-10-08T16:09:33.468529+0000","last_became_active":"2023-10-08T16:04:58.693477+0000","last_became_peered":"2023-10-08T16:04:58.693477+0000","last_unstale":"2023-10-08T16:09:33.468529+0000","last_undegraded":"2023-10-08T16:09:33.468529+0000","last_fullsized":"2023-10-08T16:09:33.468529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'569","last_scrub_stamp":"2023-10-08T16:09:33.468193+0000","last_deep_scrub":"28'569","last_deep_scrub_stamp":"2023-10-08T16:09:33.468193+0000","last_clean_scrub_stamp":"2023-10-08T16:09:33.468193+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:32.007329+0000","scrub_duration":0.0039894070000000004,"objects_trimmed":0,"snaptrim_duration":0.0094988650000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":184,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:22.835688+0000","last_change":"2023-10-08T16:09:22.835644+0000","last_active":"2023-10-08T16:09:22.835688+0000","last_peered":"2023-10-08T16:09:22.835688+0000","last_clean":"2023-10-08T16:09:22.835688+0000","last_became_active":"2023-10-08T16:04:06.368022+0000","last_became_peered":"2023-10-08T16:04:06.368022+0000","last_unstale":"2023-10-08T16:09:22.835688+0000","last_undegraded":"2023-10-08T16:09:22.835688+0000","last_fullsized":"2023-10-08T16:09:22.835688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2023-10-08T16:09:22.835476+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2023-10-08T16:09:22.835476+0000","last_clean_scrub_stamp":"2023-10-08T16:09:22.835476+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:21.374611+0000","scrub_duration":0.013473255999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"28'13","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:22.681945+0000","last_change":"2023-10-08T16:09:22.681883+0000","last_active":"2023-10-08T16:09:22.681945+0000","last_peered":"2023-10-08T16:09:22.681945+0000","last_clean":"2023-10-08T16:09:22.681945+0000","last_became_active":"2023-10-08T16:04:16.646086+0000","last_became_peered":"2023-10-08T16:04:16.646086+0000","last_unstale":"2023-10-08T16:09:22.681945+0000","last_undegraded":"2023-10-08T16:09:22.681945+0000","last_fullsized":"2023-10-08T16:09:22.681945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2023-10-08T16:09:22.681612+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2023-10-08T16:09:22.681612+0000","last_clean_scrub_stamp":"2023-10-08T16:09:22.681612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:32.115267+0000","scrub_duration":0.0043686569999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'510","reported_seq":589,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:35.338576+0000","last_change":"2023-10-08T16:09:35.338451+0000","last_active":"2023-10-08T16:09:35.338576+0000","last_peered":"2023-10-08T16:09:35.338576+0000","last_clean":"2023-10-08T16:09:35.338576+0000","last_became_active":"2023-10-08T16:04:17.629127+0000","last_became_peered":"2023-10-08T16:04:17.629127+0000","last_unstale":"2023-10-08T16:09:35.338576+0000","last_undegraded":"2023-10-08T16:09:35.338576+0000","last_fullsized":"2023-10-08T16:09:35.338576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'510","last_scrub_stamp":"2023-10-08T16:09:35.338140+0000","last_deep_scrub":"28'510","last_deep_scrub_stamp":"2023-10-08T16:09:35.338140+0000","last_clean_scrub_stamp":"2023-10-08T16:09:35.338140+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:50:20.129961+0000","scrub_duration":0.0040502020000000001,"objects_trimmed":0,"snaptrim_duration":0.011169416999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"28'1506","reported_seq":1535,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:25.858697+0000","last_change":"2023-10-08T16:09:25.858543+0000","last_active":"2023-10-08T16:09:25.858697+0000","last_peered":"2023-10-08T16:09:25.858697+0000","last_clean":"2023-10-08T16:09:25.858697+0000","last_became_active":"2023-10-08T16:04:16.661186+0000","last_became_peered":"2023-10-08T16:04:16.661186+0000","last_unstale":"2023-10-08T16:09:25.858697+0000","last_undegraded":"2023-10-08T16:09:25.858697+0000","last_fullsized":"2023-10-08T16:09:25.858697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1506","last_scrub_stamp":"2023-10-08T16:09:25.858210+0000","last_deep_scrub":"28'1506","last_deep_scrub_stamp":"2023-10-08T16:09:25.858210+0000","last_clean_scrub_stamp":"2023-10-08T16:09:25.858210+0000","objects_scrubbed":2,"log_size":1506,"log_dups_size":0,"ondisk_log_size":1506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:43.277855+0000","scrub_duration":0.039533828999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1499,"num_write_kb":8970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"28'493","reported_seq":572,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:34.511897+0000","last_change":"2023-10-08T16:09:34.511828+0000","last_active":"2023-10-08T16:09:34.511897+0000","last_peered":"2023-10-08T16:09:34.511897+0000","last_clean":"2023-10-08T16:09:34.511897+0000","last_became_active":"2023-10-08T16:04:17.615671+0000","last_became_peered":"2023-10-08T16:04:17.615671+0000","last_unstale":"2023-10-08T16:09:34.511897+0000","last_undegraded":"2023-10-08T16:09:34.511897+0000","last_fullsized":"2023-10-08T16:09:34.511897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'493","last_scrub_stamp":"2023-10-08T16:09:34.511546+0000","last_deep_scrub":"28'493","last_deep_scrub_stamp":"2023-10-08T16:09:34.511546+0000","last_clean_scrub_stamp":"2023-10-08T16:09:34.511546+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:56:04.532329+0000","scrub_duration":0.0042317580000000004,"objects_trimmed":0,"snaptrim_duration":0.043805617999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"28'75","reported_seq":166,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.438844+0000","last_change":"2023-10-08T16:09:20.438777+0000","last_active":"2023-10-08T16:09:20.438844+0000","last_peered":"2023-10-08T16:09:20.438844+0000","last_clean":"2023-10-08T16:09:20.438844+0000","last_became_active":"2023-10-08T16:04:16.654359+0000","last_became_peered":"2023-10-08T16:04:16.654359+0000","last_unstale":"2023-10-08T16:09:20.438844+0000","last_undegraded":"2023-10-08T16:09:20.438844+0000","last_fullsized":"2023-10-08T16:09:20.438844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'75","last_scrub_stamp":"2023-10-08T16:09:20.438516+0000","last_deep_scrub":"28'75","last_deep_scrub_stamp":"2023-10-08T16:09:20.438516+0000","last_clean_scrub_stamp":"2023-10-08T16:09:20.438516+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:18.855971+0000","scrub_duration":0.0049952249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":279988,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":321,"num_write":71,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'389","reported_seq":467,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:33.195937+0000","last_change":"2023-10-08T16:09:33.195879+0000","last_active":"2023-10-08T16:09:33.195937+0000","last_peered":"2023-10-08T16:09:33.195937+0000","last_clean":"2023-10-08T16:09:33.195937+0000","last_became_active":"2023-10-08T16:04:17.624876+0000","last_became_peered":"2023-10-08T16:04:17.624876+0000","last_unstale":"2023-10-08T16:09:33.195937+0000","last_undegraded":"2023-10-08T16:09:33.195937+0000","last_fullsized":"2023-10-08T16:09:33.195937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'389","last_scrub_stamp":"2023-10-08T16:09:33.195676+0000","last_deep_scrub":"28'389","last_deep_scrub_stamp":"2023-10-08T16:09:33.195676+0000","last_clean_scrub_stamp":"2023-10-08T16:09:33.195676+0000","objects_scrubbed":3,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:13:02.335470+0000","scrub_duration":0.010915272,"objects_trimmed":0,"snaptrim_duration":0.024289327999999999,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"28'1401","reported_seq":1430,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:26.761613+0000","last_change":"2023-10-08T16:09:26.761563+0000","last_active":"2023-10-08T16:09:26.761613+0000","last_peered":"2023-10-08T16:09:26.761613+0000","last_clean":"2023-10-08T16:09:26.761613+0000","last_became_active":"2023-10-08T16:04:16.654454+0000","last_became_peered":"2023-10-08T16:04:16.654454+0000","last_unstale":"2023-10-08T16:09:26.761613+0000","last_undegraded":"2023-10-08T16:09:26.761613+0000","last_fullsized":"2023-10-08T16:09:26.761613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1401","last_scrub_stamp":"2023-10-08T16:09:26.761369+0000","last_deep_scrub":"28'1401","last_deep_scrub_stamp":"2023-10-08T16:09:26.761369+0000","last_clean_scrub_stamp":"2023-10-08T16:09:26.761369+0000","objects_scrubbed":2,"log_size":1401,"log_dups_size":0,"ondisk_log_size":1401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:31.493587+0000","scrub_duration":0.039489099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1390,"num_write_kb":8905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"28'618","reported_seq":697,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:35.224258+0000","last_change":"2023-10-08T16:09:35.224192+0000","last_active":"2023-10-08T16:09:35.224258+0000","last_peered":"2023-10-08T16:09:35.224258+0000","last_clean":"2023-10-08T16:09:35.224258+0000","last_became_active":"2023-10-08T16:04:17.619294+0000","last_became_peered":"2023-10-08T16:04:17.619294+0000","last_unstale":"2023-10-08T16:09:35.224258+0000","last_undegraded":"2023-10-08T16:09:35.224258+0000","last_fullsized":"2023-10-08T16:09:35.224258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'618","last_scrub_stamp":"2023-10-08T16:09:35.223925+0000","last_deep_scrub":"28'618","last_deep_scrub_stamp":"2023-10-08T16:09:35.223925+0000","last_clean_scrub_stamp":"2023-10-08T16:09:35.223925+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:37:42.327569+0000","scrub_duration":0.0042708449999999997,"objects_trimmed":0,"snaptrim_duration":0.011233748,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"27'7","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:24.162687+0000","last_change":"2023-10-08T16:09:24.162557+0000","last_active":"2023-10-08T16:09:24.162687+0000","last_peered":"2023-10-08T16:09:24.162687+0000","last_clean":"2023-10-08T16:09:24.162687+0000","last_became_active":"2023-10-08T16:04:16.661756+0000","last_became_peered":"2023-10-08T16:04:16.661756+0000","last_unstale":"2023-10-08T16:09:24.162687+0000","last_undegraded":"2023-10-08T16:09:24.162687+0000","last_fullsized":"2023-10-08T16:09:24.162687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2023-10-08T16:09:24.162263+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2023-10-08T16:09:24.162263+0000","last_clean_scrub_stamp":"2023-10-08T16:09:24.162263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:33.595918+0000","scrub_duration":0.0046575389999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"28'515","reported_seq":594,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:31.715455+0000","last_change":"2023-10-08T16:09:31.715390+0000","last_active":"2023-10-08T16:09:31.715455+0000","last_peered":"2023-10-08T16:09:31.715455+0000","last_clean":"2023-10-08T16:09:31.715455+0000","last_became_active":"2023-10-08T16:04:17.616348+0000","last_became_peered":"2023-10-08T16:04:17.616348+0000","last_unstale":"2023-10-08T16:09:31.715455+0000","last_undegraded":"2023-10-08T16:09:31.715455+0000","last_fullsized":"2023-10-08T16:09:31.715455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'515","last_scrub_stamp":"2023-10-08T16:09:31.715159+0000","last_deep_scrub":"28'515","last_deep_scrub_stamp":"2023-10-08T16:09:31.715159+0000","last_clean_scrub_stamp":"2023-10-08T16:09:31.715159+0000","objects_scrubbed":2,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:49.134804+0000","scrub_duration":0.0093125989999999995,"objects_trimmed":0,"snaptrim_duration":0.016977602000000001,"stat_sum":{"num_bytes":4107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"26'21","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:26.813271+0000","last_change":"2023-10-08T16:09:26.813177+0000","last_active":"2023-10-08T16:09:26.813271+0000","last_peered":"2023-10-08T16:09:26.813271+0000","last_clean":"2023-10-08T16:09:26.813271+0000","last_became_active":"2023-10-08T16:04:16.662446+0000","last_became_peered":"2023-10-08T16:04:16.662446+0000","last_unstale":"2023-10-08T16:09:26.813271+0000","last_undegraded":"2023-10-08T16:09:26.813271+0000","last_fullsized":"2023-10-08T16:09:26.813271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'21","last_scrub_stamp":"2023-10-08T16:09:26.812910+0000","last_deep_scrub":"26'21","last_deep_scrub_stamp":"2023-10-08T16:09:26.812910+0000","last_clean_scrub_stamp":"2023-10-08T16:09:26.812910+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:55.952703+0000","scrub_duration":0.0040640759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'606","reported_seq":685,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:29.158906+0000","last_change":"2023-10-08T16:09:29.158842+0000","last_active":"2023-10-08T16:09:29.158906+0000","last_peered":"2023-10-08T16:09:29.158906+0000","last_clean":"2023-10-08T16:09:29.158906+0000","last_became_active":"2023-10-08T16:04:17.624319+0000","last_became_peered":"2023-10-08T16:04:17.624319+0000","last_unstale":"2023-10-08T16:09:29.158906+0000","last_undegraded":"2023-10-08T16:09:29.158906+0000","last_fullsized":"2023-10-08T16:09:29.158906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'606","last_scrub_stamp":"2023-10-08T16:09:29.158591+0000","last_deep_scrub":"28'606","last_deep_scrub_stamp":"2023-10-08T16:09:29.158591+0000","last_clean_scrub_stamp":"2023-10-08T16:09:29.158591+0000","objects_scrubbed":2,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:27.697727+0000","scrub_duration":0.0096838069999999991,"objects_trimmed":0,"snaptrim_duration":0.024480915999999998,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"28'47","reported_seq":76,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:19.116634+0000","last_change":"2023-10-08T16:09:19.116588+0000","last_active":"2023-10-08T16:09:19.116634+0000","last_peered":"2023-10-08T16:09:19.116634+0000","last_clean":"2023-10-08T16:09:19.116634+0000","last_became_active":"2023-10-08T16:04:16.660704+0000","last_became_peered":"2023-10-08T16:04:16.660704+0000","last_unstale":"2023-10-08T16:09:19.116634+0000","last_undegraded":"2023-10-08T16:09:19.116634+0000","last_fullsized":"2023-10-08T16:09:19.116634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'47","last_scrub_stamp":"2023-10-08T16:09:19.116491+0000","last_deep_scrub":"28'47","last_deep_scrub_stamp":"2023-10-08T16:09:19.116491+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.116491+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:45.219718+0000","scrub_duration":0.003732735,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"28'626","reported_seq":705,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:31.471750+0000","last_change":"2023-10-08T16:09:31.471628+0000","last_active":"2023-10-08T16:09:31.471750+0000","last_peered":"2023-10-08T16:09:31.471750+0000","last_clean":"2023-10-08T16:09:31.471750+0000","last_became_active":"2023-10-08T16:04:17.631615+0000","last_became_peered":"2023-10-08T16:04:17.631615+0000","last_unstale":"2023-10-08T16:09:31.471750+0000","last_undegraded":"2023-10-08T16:09:31.471750+0000","last_fullsized":"2023-10-08T16:09:31.471750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'626","last_scrub_stamp":"2023-10-08T16:09:31.471310+0000","last_deep_scrub":"28'626","last_deep_scrub_stamp":"2023-10-08T16:09:31.471310+0000","last_clean_scrub_stamp":"2023-10-08T16:09:31.471310+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:30.010445+0000","scrub_duration":0.0043343189999999997,"objects_trimmed":0,"snaptrim_duration":0.011336120999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"28'13","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:25.681310+0000","last_change":"2023-10-08T16:09:25.681241+0000","last_active":"2023-10-08T16:09:25.681310+0000","last_peered":"2023-10-08T16:09:25.681310+0000","last_clean":"2023-10-08T16:09:25.681310+0000","last_became_active":"2023-10-08T16:04:16.659148+0000","last_became_peered":"2023-10-08T16:04:16.659148+0000","last_unstale":"2023-10-08T16:09:25.681310+0000","last_undegraded":"2023-10-08T16:09:25.681310+0000","last_fullsized":"2023-10-08T16:09:25.681310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2023-10-08T16:09:25.680987+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2023-10-08T16:09:25.680987+0000","last_clean_scrub_stamp":"2023-10-08T16:09:25.680987+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:24.220123+0000","scrub_duration":0.0066810940000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'437","reported_seq":517,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:54.420481+0000","last_change":"2023-10-08T16:09:54.420408+0000","last_active":"2023-10-08T16:09:54.420481+0000","last_peered":"2023-10-08T16:09:54.420481+0000","last_clean":"2023-10-08T16:09:54.420481+0000","last_became_active":"2023-10-08T16:04:17.624385+0000","last_became_peered":"2023-10-08T16:04:17.624385+0000","last_unstale":"2023-10-08T16:09:54.420481+0000","last_undegraded":"2023-10-08T16:09:54.420481+0000","last_fullsized":"2023-10-08T16:09:54.420481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'437","last_scrub_stamp":"2023-10-08T16:09:54.420134+0000","last_deep_scrub":"28'437","last_deep_scrub_stamp":"2023-10-08T16:09:54.420134+0000","last_clean_scrub_stamp":"2023-10-08T16:09:54.420134+0000","objects_scrubbed":1,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:38.402372+0000","scrub_duration":0.0077655099999999998,"objects_trimmed":0,"snaptrim_duration":0.044071592,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"28'759","reported_seq":788,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:43.804911+0000","last_change":"2023-10-08T16:09:43.804831+0000","last_active":"2023-10-08T16:09:43.804911+0000","last_peered":"2023-10-08T16:09:43.804911+0000","last_clean":"2023-10-08T16:09:43.804911+0000","last_became_active":"2023-10-08T16:04:16.662327+0000","last_became_peered":"2023-10-08T16:04:16.662327+0000","last_unstale":"2023-10-08T16:09:43.804911+0000","last_undegraded":"2023-10-08T16:09:43.804911+0000","last_fullsized":"2023-10-08T16:09:43.804911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'759","last_scrub_stamp":"2023-10-08T16:09:43.804549+0000","last_deep_scrub":"28'759","last_deep_scrub_stamp":"2023-10-08T16:09:43.804549+0000","last_clean_scrub_stamp":"2023-10-08T16:09:43.804549+0000","objects_scrubbed":1,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:40:58.077028+0000","scrub_duration":0.025817079,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":753,"num_write_kb":4504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'450","reported_seq":529,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:41.341168+0000","last_change":"2023-10-08T16:09:41.341044+0000","last_active":"2023-10-08T16:09:41.341168+0000","last_peered":"2023-10-08T16:09:41.341168+0000","last_clean":"2023-10-08T16:09:41.341168+0000","last_became_active":"2023-10-08T16:04:17.622898+0000","last_became_peered":"2023-10-08T16:04:17.622898+0000","last_unstale":"2023-10-08T16:09:41.341168+0000","last_undegraded":"2023-10-08T16:09:41.341168+0000","last_fullsized":"2023-10-08T16:09:41.341168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'450","last_scrub_stamp":"2023-10-08T16:09:41.340711+0000","last_deep_scrub":"28'450","last_deep_scrub_stamp":"2023-10-08T16:09:41.340711+0000","last_clean_scrub_stamp":"2023-10-08T16:09:41.340711+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:56:11.361494+0000","scrub_duration":0.0045819090000000003,"objects_trimmed":0,"snaptrim_duration":0.0075401410000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'10","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.131846+0000","last_change":"2023-10-08T16:09:20.131788+0000","last_active":"2023-10-08T16:09:20.131846+0000","last_peered":"2023-10-08T16:09:20.131846+0000","last_clean":"2023-10-08T16:09:20.131846+0000","last_became_active":"2023-10-08T16:04:16.661055+0000","last_became_peered":"2023-10-08T16:04:16.661055+0000","last_unstale":"2023-10-08T16:09:20.131846+0000","last_undegraded":"2023-10-08T16:09:20.131846+0000","last_fullsized":"2023-10-08T16:09:20.131846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2023-10-08T16:09:20.131603+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2023-10-08T16:09:20.131603+0000","last_clean_scrub_stamp":"2023-10-08T16:09:20.131603+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:20:38.764433+0000","scrub_duration":0.0035988970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"28'502","reported_seq":581,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:34.370256+0000","last_change":"2023-10-08T16:09:34.370190+0000","last_active":"2023-10-08T16:09:34.370256+0000","last_peered":"2023-10-08T16:09:34.370256+0000","last_clean":"2023-10-08T16:09:34.370256+0000","last_became_active":"2023-10-08T16:04:17.626991+0000","last_became_peered":"2023-10-08T16:04:17.626991+0000","last_unstale":"2023-10-08T16:09:34.370256+0000","last_undegraded":"2023-10-08T16:09:34.370256+0000","last_fullsized":"2023-10-08T16:09:34.370256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'502","last_scrub_stamp":"2023-10-08T16:09:34.369933+0000","last_deep_scrub":"28'502","last_deep_scrub_stamp":"2023-10-08T16:09:34.369933+0000","last_clean_scrub_stamp":"2023-10-08T16:09:34.369933+0000","objects_scrubbed":1,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:51.789578+0000","scrub_duration":0.0074754299999999999,"objects_trimmed":0,"snaptrim_duration":0.010148346000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'11","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:27.146089+0000","last_change":"2023-10-08T16:09:27.146023+0000","last_active":"2023-10-08T16:09:27.146089+0000","last_peered":"2023-10-08T16:09:27.146089+0000","last_clean":"2023-10-08T16:09:27.146089+0000","last_became_active":"2023-10-08T16:04:16.657299+0000","last_became_peered":"2023-10-08T16:04:16.657299+0000","last_unstale":"2023-10-08T16:09:27.146089+0000","last_undegraded":"2023-10-08T16:09:27.146089+0000","last_fullsized":"2023-10-08T16:09:27.146089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2023-10-08T16:09:27.145765+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2023-10-08T16:09:27.145765+0000","last_clean_scrub_stamp":"2023-10-08T16:09:27.145765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:57.166548+0000","scrub_duration":0.0039273509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"28'602","reported_seq":679,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:32.438112+0000","last_change":"2023-10-08T16:09:32.438015+0000","last_active":"2023-10-08T16:09:32.438112+0000","last_peered":"2023-10-08T16:09:32.438112+0000","last_clean":"2023-10-08T16:09:32.438112+0000","last_became_active":"2023-10-08T16:04:17.620693+0000","last_became_peered":"2023-10-08T16:04:17.620693+0000","last_unstale":"2023-10-08T16:09:32.438112+0000","last_undegraded":"2023-10-08T16:09:32.438112+0000","last_fullsized":"2023-10-08T16:09:32.438112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'602","last_scrub_stamp":"2023-10-08T16:09:32.437705+0000","last_deep_scrub":"28'602","last_deep_scrub_stamp":"2023-10-08T16:09:32.437705+0000","last_clean_scrub_stamp":"2023-10-08T16:09:32.437705+0000","objects_scrubbed":5,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:35:26.186896+0000","scrub_duration":0.016386810000000002,"objects_trimmed":0,"snaptrim_duration":0.011078684,"stat_sum":{"num_bytes":4121,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'99","reported_seq":128,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:23.883532+0000","last_change":"2023-10-08T16:09:23.883485+0000","last_active":"2023-10-08T16:09:23.883532+0000","last_peered":"2023-10-08T16:09:23.883532+0000","last_clean":"2023-10-08T16:09:23.883532+0000","last_became_active":"2023-10-08T16:04:16.663184+0000","last_became_peered":"2023-10-08T16:04:16.663184+0000","last_unstale":"2023-10-08T16:09:23.883532+0000","last_undegraded":"2023-10-08T16:09:23.883532+0000","last_fullsized":"2023-10-08T16:09:23.883532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'99","last_scrub_stamp":"2023-10-08T16:09:23.883297+0000","last_deep_scrub":"28'99","last_deep_scrub_stamp":"2023-10-08T16:09:23.883297+0000","last_clean_scrub_stamp":"2023-10-08T16:09:23.883297+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:10:42.885487+0000","scrub_duration":0.019422511,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":4152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"28'779","reported_seq":858,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:43.468265+0000","last_change":"2023-10-08T16:09:43.468204+0000","last_active":"2023-10-08T16:09:43.468265+0000","last_peered":"2023-10-08T16:09:43.468265+0000","last_clean":"2023-10-08T16:09:43.468265+0000","last_became_active":"2023-10-08T16:04:17.622898+0000","last_became_peered":"2023-10-08T16:04:17.622898+0000","last_unstale":"2023-10-08T16:09:43.468265+0000","last_undegraded":"2023-10-08T16:09:43.468265+0000","last_fullsized":"2023-10-08T16:09:43.468265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'779","last_scrub_stamp":"2023-10-08T16:09:43.467964+0000","last_deep_scrub":"28'779","last_deep_scrub_stamp":"2023-10-08T16:09:43.467964+0000","last_clean_scrub_stamp":"2023-10-08T16:09:43.467964+0000","objects_scrubbed":1,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:27.450202+0000","scrub_duration":0.0079618980000000002,"objects_trimmed":0,"snaptrim_duration":0.012379262,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"28'814","reported_seq":892,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:10:03.786231+0000","last_change":"2023-10-08T16:10:03.786162+0000","last_active":"2023-10-08T16:10:03.786231+0000","last_peered":"2023-10-08T16:10:03.786231+0000","last_clean":"2023-10-08T16:10:03.786231+0000","last_became_active":"2023-10-08T16:04:17.617179+0000","last_became_peered":"2023-10-08T16:04:17.617179+0000","last_unstale":"2023-10-08T16:10:03.786231+0000","last_undegraded":"2023-10-08T16:10:03.786231+0000","last_fullsized":"2023-10-08T16:10:03.786231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'814","last_scrub_stamp":"2023-10-08T16:10:03.785949+0000","last_deep_scrub":"28'814","last_deep_scrub_stamp":"2023-10-08T16:10:03.785949+0000","last_clean_scrub_stamp":"2023-10-08T16:10:03.785949+0000","objects_scrubbed":2,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:47.418292+0000","scrub_duration":0.01103617,"objects_trimmed":0,"snaptrim_duration":0.016893819000000001,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"28'2505","reported_seq":2534,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:27.835009+0000","last_change":"2023-10-08T16:09:27.834959+0000","last_active":"2023-10-08T16:09:27.835009+0000","last_peered":"2023-10-08T16:09:27.835009+0000","last_clean":"2023-10-08T16:09:27.835009+0000","last_became_active":"2023-10-08T16:04:16.661215+0000","last_became_peered":"2023-10-08T16:04:16.661215+0000","last_unstale":"2023-10-08T16:09:27.835009+0000","last_undegraded":"2023-10-08T16:09:27.835009+0000","last_fullsized":"2023-10-08T16:09:27.835009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2505","last_scrub_stamp":"2023-10-08T16:09:27.834807+0000","last_deep_scrub":"28'2505","last_deep_scrub_stamp":"2023-10-08T16:09:27.834807+0000","last_clean_scrub_stamp":"2023-10-08T16:09:27.834807+0000","objects_scrubbed":2,"log_size":2505,"log_dups_size":0,"ondisk_log_size":2505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:38.729836+0000","scrub_duration":0.024538131000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2502,"num_write_kb":5839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'614","reported_seq":692,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:10:06.763218+0000","last_change":"2023-10-08T16:10:06.763149+0000","last_active":"2023-10-08T16:10:06.763218+0000","last_peered":"2023-10-08T16:10:06.763218+0000","last_clean":"2023-10-08T16:10:06.763218+0000","last_became_active":"2023-10-08T16:04:17.617216+0000","last_became_peered":"2023-10-08T16:04:17.617216+0000","last_unstale":"2023-10-08T16:10:06.763218+0000","last_undegraded":"2023-10-08T16:10:06.763218+0000","last_fullsized":"2023-10-08T16:10:06.763218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'614","last_scrub_stamp":"2023-10-08T16:10:06.762914+0000","last_deep_scrub":"28'614","last_deep_scrub_stamp":"2023-10-08T16:10:06.762914+0000","last_clean_scrub_stamp":"2023-10-08T16:10:06.762914+0000","objects_scrubbed":2,"log_size":614,"log_dups_size":0,"ondisk_log_size":614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:59:29.846169+0000","scrub_duration":0.010087624999999999,"objects_trimmed":0,"snaptrim_duration":0.020241687000000001,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1666","reported_seq":1695,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:38.888154+0000","last_change":"2023-10-08T16:09:38.888088+0000","last_active":"2023-10-08T16:09:38.888154+0000","last_peered":"2023-10-08T16:09:38.888154+0000","last_clean":"2023-10-08T16:09:38.888154+0000","last_became_active":"2023-10-08T16:04:16.661224+0000","last_became_peered":"2023-10-08T16:04:16.661224+0000","last_unstale":"2023-10-08T16:09:38.888154+0000","last_undegraded":"2023-10-08T16:09:38.888154+0000","last_fullsized":"2023-10-08T16:09:38.888154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1666","last_scrub_stamp":"2023-10-08T16:09:38.887848+0000","last_deep_scrub":"28'1666","last_deep_scrub_stamp":"2023-10-08T16:09:38.887848+0000","last_clean_scrub_stamp":"2023-10-08T16:09:38.887848+0000","objects_scrubbed":4,"log_size":1666,"log_dups_size":0,"ondisk_log_size":1666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:29:00.791153+0000","scrub_duration":0.041569068000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9349042,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1651,"num_write_kb":9976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"28'531","reported_seq":610,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:40.436362+0000","last_change":"2023-10-08T16:09:40.436264+0000","last_active":"2023-10-08T16:09:40.436362+0000","last_peered":"2023-10-08T16:09:40.436362+0000","last_clean":"2023-10-08T16:09:40.436362+0000","last_became_active":"2023-10-08T16:04:17.621550+0000","last_became_peered":"2023-10-08T16:04:17.621550+0000","last_unstale":"2023-10-08T16:09:40.436362+0000","last_undegraded":"2023-10-08T16:09:40.436362+0000","last_fullsized":"2023-10-08T16:09:40.436362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'531","last_scrub_stamp":"2023-10-08T16:09:40.435990+0000","last_deep_scrub":"28'531","last_deep_scrub_stamp":"2023-10-08T16:09:40.435990+0000","last_clean_scrub_stamp":"2023-10-08T16:09:40.435990+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:13:09.575783+0000","scrub_duration":0.0041406139999999999,"objects_trimmed":0,"snaptrim_duration":0.046468506999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"28'765","reported_seq":794,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:29.514816+0000","last_change":"2023-10-08T16:09:29.514743+0000","last_active":"2023-10-08T16:09:29.514816+0000","last_peered":"2023-10-08T16:09:29.514816+0000","last_clean":"2023-10-08T16:09:29.514816+0000","last_became_active":"2023-10-08T16:04:16.661907+0000","last_became_peered":"2023-10-08T16:04:16.661907+0000","last_unstale":"2023-10-08T16:09:29.514816+0000","last_undegraded":"2023-10-08T16:09:29.514816+0000","last_fullsized":"2023-10-08T16:09:29.514816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'765","last_scrub_stamp":"2023-10-08T16:09:29.514581+0000","last_deep_scrub":"28'765","last_deep_scrub_stamp":"2023-10-08T16:09:29.514581+0000","last_clean_scrub_stamp":"2023-10-08T16:09:29.514581+0000","objects_scrubbed":1,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:59.535364+0000","scrub_duration":0.024557628000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":4591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"28'526","reported_seq":605,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:30.490508+0000","last_change":"2023-10-08T16:09:30.490432+0000","last_active":"2023-10-08T16:09:30.490508+0000","last_peered":"2023-10-08T16:09:30.490508+0000","last_clean":"2023-10-08T16:09:30.490508+0000","last_became_active":"2023-10-08T16:04:17.627562+0000","last_became_peered":"2023-10-08T16:04:17.627562+0000","last_unstale":"2023-10-08T16:09:30.490508+0000","last_undegraded":"2023-10-08T16:09:30.490508+0000","last_fullsized":"2023-10-08T16:09:30.490508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'526","last_scrub_stamp":"2023-10-08T16:09:30.490173+0000","last_deep_scrub":"28'526","last_deep_scrub_stamp":"2023-10-08T16:09:30.490173+0000","last_clean_scrub_stamp":"2023-10-08T16:09:30.490173+0000","objects_scrubbed":2,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:48.404946+0000","scrub_duration":0.0091133989999999995,"objects_trimmed":0,"snaptrim_duration":0.011393438000000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"28'2624","reported_seq":2653,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-08T16:09:23.416533+0000","last_change":"2023-10-08T16:09:23.416452+0000","last_active":"2023-10-08T16:09:23.416533+0000","last_peered":"2023-10-08T16:09:23.416533+0000","last_clean":"2023-10-08T16:09:23.416533+0000","last_became_active":"2023-10-08T16:04:16.662714+0000","last_became_peered":"2023-10-08T16:04:16.662714+0000","last_unstale":"2023-10-08T16:09:23.416533+0000","last_undegraded":"2023-10-08T16:09:23.416533+0000","last_fullsized":"2023-10-08T16:09:23.416533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2624","last_scrub_stamp":"2023-10-08T16:09:23.416303+0000","last_deep_scrub":"28'2624","last_deep_scrub_stamp":"2023-10-08T16:09:23.416303+0000","last_clean_scrub_stamp":"2023-10-08T16:09:23.416303+0000","objects_scrubbed":3,"log_size":2624,"log_dups_size":0,"ondisk_log_size":2624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:49.519531+0000","scrub_duration":0.026130798,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194858,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2619,"num_write_kb":5944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":82,"num_object_clones":21,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":8,"num_read":31,"num_read_kb":21,"num_write":110,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37822,"ondisk_log_size":37822,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":85127916,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":62,"num_read_kb":321,"num_write":17973,"num_write_kb":93770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":170319872,"data_stored":170255832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18098,"ondisk_log_size":18098,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574929,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":348312,"kb_used_data":38736,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94023528,"statfs":{"total":96636764160,"available":96280092672,"internally_reserved":0,"allocated":39665664,"data_stored":39453451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.83099999999999996,"15min":0.86199999999999999},"min":{"1min":0.64100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.1950000000000001,"5min":1.976,"15min":1.976},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.83299999999999996,"15min":0.86199999999999999},"min":{"1min":0.65800000000000003,"5min":0.314,"15min":0.314},"max":{"1min":1.254,"5min":1.254,"15min":1.5429999999999999},"last":1.093}]},{"osd":1,"last update":"Sun Oct 8 16:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.85799999999999998,"15min":0.86799999999999999},"min":{"1min":0.65500000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.159,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.89600000000000002,"15min":0.91100000000000003},"min":{"1min":0.65000000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.2989999999999999,"5min":1.54,"15min":1.54},"last":0.72699999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.91100000000000003,"15min":0.90800000000000003},"min":{"1min":0.62,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.238,"5min":1.478,"15min":1.478},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.88300000000000001,"15min":0.91900000000000004},"min":{"1min":0.70499999999999996,"5min":0.44,"15min":0.44},"max":{"1min":1.2869999999999999,"5min":1.415,"15min":1.948},"last":0.86499999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96299999999999997,"15min":0.97799999999999998},"min":{"1min":0.80500000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.2609999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.214},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0189999999999999,"15min":1.0489999999999999},"min":{"1min":0.76400000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.375,"5min":1.548,"15min":1.552},"last":0.90100000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:10:16 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.96799999999999997,"15min":0.996},"min":{"1min":0.67300000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.204,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0629999999999999,"15min":1.0840000000000001},"min":{"1min":0.79700000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3300000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.1240000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.024,"15min":1.0569999999999999},"min":{"1min":0.72199999999999998,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.385,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.022},{"interface":"front","average":{"1min":1.115,"5min":1.087,"15min":1.121},"min":{"1min":0.89400000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.3169999999999999,"5min":1.5860000000000001,"15min":1.726},"last":1.248}]},{"osd":6,"last update":"Sun Oct 8 16:10:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1499999999999999,"15min":1.208},"min":{"1min":0.99099999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4199999999999999,"5min":1.6759999999999999,"15min":2.0339999999999998},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.1679999999999999,"15min":1.1950000000000001},"min":{"1min":1.016,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4079999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.3009999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574930,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319056,"kb_used_data":17672,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94052784,"statfs":{"total":96636764160,"available":96310050816,"internally_reserved":0,"allocated":18096128,"data_stored":17891613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:19 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.77800000000000002,"15min":0.76900000000000002},"min":{"1min":0.627,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.077,"5min":3.8290000000000002,"15min":3.8290000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.88300000000000001,"15min":0.76500000000000001},"min":{"1min":0.54200000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.258,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.85299999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:10:19 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.92700000000000005,"15min":0.91700000000000004},"min":{"1min":0.73799999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1930000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.94999999999999996,"15min":0.93799999999999994},"min":{"1min":0.877,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.3129999999999999,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.091}]},{"osd":2,"last update":"Sun Oct 8 16:10:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.871,"15min":0.85099999999999998},"min":{"1min":0.622,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2110000000000001,"5min":1.25,"15min":1.25},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.91100000000000003,"15min":0.91700000000000004},"min":{"1min":0.71999999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2010000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.1859999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:10:19 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.94799999999999995,"15min":0.86899999999999999},"min":{"1min":0.71899999999999997,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2370000000000001,"5min":2.173,"15min":2.173},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.016,"15min":0.96799999999999997},"min":{"1min":0.72399999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2989999999999999,"5min":1.381,"15min":1.381},"last":0.96799999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:10:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.93400000000000005,"15min":0.98599999999999999},"min":{"1min":0.57699999999999996,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.1950000000000001,"5min":1.413,"15min":1.413},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.026,"5min":1.052,"15min":1.0229999999999999},"min":{"1min":0.71299999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1870000000000001,"5min":2.25,"15min":2.25},"last":1.014}]},{"osd":5,"last update":"Sun Oct 8 16:10:19 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.083,"15min":1.0409999999999999},"min":{"1min":0.71899999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3500000000000001,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":1.212},{"interface":"front","average":{"1min":1.119,"5min":1.3009999999999999,"15min":1.2010000000000001},"min":{"1min":0.82099999999999995,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.397,"5min":17.428999999999998,"15min":17.428999999999998},"last":0.91100000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:10:19 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.1619999999999999,"15min":1.1040000000000001},"min":{"1min":0.875,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3300000000000001,"5min":6.0229999999999997,"15min":6.0229999999999997},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.2290000000000001,"15min":1.204},"min":{"1min":1.0049999999999999,"5min":0.626,"15min":0.626},"max":{"1min":1.4359999999999999,"5min":3.706,"15min":3.706},"last":1.1240000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574931,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":330424,"kb_used_data":20848,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94041416,"statfs":{"total":96636764160,"available":96298409984,"internally_reserved":0,"allocated":21348352,"data_stored":21141337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.79200000000000004,"15min":0.873},"min":{"1min":0.63700000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":1.236},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.64700000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.232,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.79600000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.875,"15min":0.84299999999999997},"min":{"1min":0.74199999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0840000000000001,"5min":4.399,"15min":4.399},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.90500000000000003,"15min":0.89900000000000002},"min":{"1min":0.70199999999999996,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.3129999999999999,"5min":4.5149999999999997,"15min":4.5149999999999997},"last":1.02}]},{"osd":2,"last update":"Sun Oct 8 16:10:15 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.85099999999999998,"15min":0.89300000000000002},"min":{"1min":0.65100000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0660000000000001,"5min":1.286,"15min":1.5760000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.91700000000000004,"15min":0.90300000000000002},"min":{"1min":0.69599999999999995,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.339,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.1579999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:10:15 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.008,"15min":1.0069999999999999},"min":{"1min":0.78000000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.3979999999999999,"5min":4.7140000000000004,"15min":4.7140000000000004},"last":1.496},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.056,"15min":1.0640000000000001},"min":{"1min":0.94599999999999995,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3600000000000001,"5min":4.6920000000000002,"15min":4.6920000000000002},"last":1.2030000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:10:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0089999999999999,"15min":1.0429999999999999},"min":{"1min":0.68000000000000005,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.4690000000000001,"5min":1.5800000000000001,"15min":1.9259999999999999},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.109,"5min":1.0069999999999999,"15min":1.093},"min":{"1min":0.85699999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.335,"5min":1.353,"15min":1.7649999999999999},"last":1.099}]},{"osd":6,"last update":"Sun Oct 8 16:10:15 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.04,"15min":1.0760000000000001},"min":{"1min":0.81899999999999995,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.45,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.101,"15min":1.2030000000000001},"min":{"1min":0.82799999999999996,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.542,"5min":1.593,"15min":2.6589999999999998},"last":1.6299999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:10:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.0800000000000001,"15min":1.1930000000000001},"min":{"1min":0.876,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":2.0840000000000001},"last":1.306},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1599999999999999,"15min":1.1859999999999999},"min":{"1min":0.92100000000000004,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5009999999999999,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.663}]}]},{"osd":4,"up_from":13,"seq":55834574930,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":334488,"kb_used_data":29008,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94037352,"statfs":{"total":96636764160,"available":96294248448,"internally_reserved":0,"allocated":29704192,"data_stored":29497190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80400000000000005,"15min":0.81399999999999995},"min":{"1min":0.41999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.3100000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.876},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.81699999999999995,"15min":0.79400000000000004},"min":{"1min":0.45000000000000001,"5min":0.379,"15min":0.379},"max":{"1min":1.1120000000000001,"5min":1.641,"15min":1.641},"last":1.1599999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.81799999999999995,"15min":0.84299999999999997},"min":{"1min":0.63500000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.206,"5min":1.2729999999999999,"15min":1.292},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.90700000000000003,"15min":0.879},"min":{"1min":0.70599999999999996,"5min":0.438,"15min":0.438},"max":{"1min":1.224,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.95099999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.874,"15min":0.877},"min":{"1min":0.53400000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.228,"5min":1.276,"15min":1.276},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.0149999999999999,"15min":0.96499999999999997},"min":{"1min":0.55800000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.357,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.0580000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.92600000000000005,"15min":0.96699999999999997},"min":{"1min":0.66200000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.228,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0269999999999999,"15min":1.087},"min":{"1min":0.90000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.224,"5min":1.333,"15min":1.448},"last":0.84799999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.99299999999999999,"15min":1.0129999999999999},"min":{"1min":0.58899999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.444,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.071,"15min":1.0649999999999999},"min":{"1min":0.66200000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.337,"5min":9.8480000000000008,"15min":9.8480000000000008},"last":1.095}]},{"osd":6,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0029999999999999,"15min":1.119},"min":{"1min":0.76400000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.26,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.133,"15min":1.163},"min":{"1min":0.66600000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3999999999999999,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":0.72799999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.1639999999999999,"15min":1.1599999999999999},"min":{"1min":0.78000000000000003,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.385,"5min":8.8290000000000006,"15min":8.8290000000000006},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.141,"15min":1.248},"min":{"1min":0.70299999999999996,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3100000000000001,"5min":1.6850000000000001,"15min":1.71},"last":1.034}]}]},{"osd":3,"up_from":13,"seq":55834574929,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":318408,"kb_used_data":17024,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94053432,"statfs":{"total":96636764160,"available":96310714368,"internally_reserved":0,"allocated":17432576,"data_stored":17223470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.432,"5min":0.214,"15min":0.214},"max":{"1min":0.98299999999999998,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.72199999999999998,"15min":0.71799999999999997},"min":{"1min":0.72799999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.96799999999999997,"5min":3.0190000000000001,"15min":3.0190000000000001},"last":0.96099999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70799999999999996,"15min":0.65900000000000003},"min":{"1min":0.54300000000000004,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97799999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.873,"15min":0.77600000000000002},"min":{"1min":0.55800000000000005,"5min":0.249,"15min":0.249},"max":{"1min":1.095,"5min":8.3059999999999992,"15min":8.3059999999999992},"last":0.745}]},{"osd":2,"last update":"Sun Oct 8 16:10:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.78000000000000003,"15min":0.77100000000000002},"min":{"1min":0.57599999999999996,"5min":0.312,"15min":0.312},"max":{"1min":1.052,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.83099999999999996,"15min":0.79100000000000004},"min":{"1min":0.65900000000000003,"5min":0.433,"15min":0.433},"max":{"1min":1.29,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.68500000000000005}]},{"osd":4,"last update":"Sun Oct 8 16:10:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":0.98999999999999999,"15min":1.03},"min":{"1min":0.85499999999999998,"5min":0.374,"15min":0.374},"max":{"1min":1.339,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.085,"5min":1.012,"15min":1.01},"min":{"1min":0.89100000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.468,"5min":2.202,"15min":2.202},"last":0.83699999999999997}]},{"osd":5,"last update":"Sun Oct 8 16:10:11 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0609999999999999,"15min":1.083},"min":{"1min":0.68400000000000005,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.49,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.121,"5min":1.0780000000000001,"15min":1.1000000000000001},"min":{"1min":0.89200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.421,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.88400000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:10:11 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0680000000000001,"15min":1.0700000000000001},"min":{"1min":0.76600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.5509999999999999,"5min":2.113,"15min":2.113},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.2,"5min":1.1319999999999999,"15min":1.169},"min":{"1min":0.874,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4019999999999999,"5min":3.351,"15min":3.351},"last":1.1559999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:10:11 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.139,"15min":1.2090000000000001},"min":{"1min":0.91500000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.5780000000000001,"5min":2.919,"15min":2.984},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.196,"15min":1.1459999999999999},"min":{"1min":0.99299999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.482,"5min":6.3940000000000001,"15min":6.3940000000000001},"last":1.079}]}]},{"osd":2,"up_from":13,"seq":55834574929,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314296,"kb_used_data":4720,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94057544,"statfs":{"total":96636764160,"available":96314925056,"internally_reserved":0,"allocated":4833280,"data_stored":4631728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61399999999999999,"15min":0.63200000000000001},"min":{"1min":0.41999999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.876,"5min":1.131,"15min":1.131},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.66400000000000003,"15min":0.63200000000000001},"min":{"1min":0.46800000000000003,"5min":0.32200000000000001,"15min":0.30199999999999999},"max":{"1min":1.1910000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.92900000000000005}]},{"osd":1,"last update":"Sun Oct 8 16:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.71199999999999997,"15min":0.74399999999999999},"min":{"1min":0.5,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0169999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.78300000000000003,"15min":0.751},"min":{"1min":0.40200000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.018,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.79800000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.73299999999999998,"15min":0.755},"min":{"1min":0.51500000000000001,"5min":0.315,"15min":0.315},"max":{"1min":1.042,"5min":1.454,"15min":1.454},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.85599999999999998,"15min":0.871},"min":{"1min":0.55300000000000005,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.145,"5min":1.2989999999999999,"15min":1.306},"last":0.83899999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.92900000000000005,"15min":1},"min":{"1min":0.65100000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.3,"5min":1.3560000000000001,"15min":1.954},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.97499999999999998,"15min":1.0269999999999999},"min":{"1min":0.86399999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3999999999999999,"5min":1.4450000000000001,"15min":1.804},"last":0.68999999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:10:18 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.92200000000000004,"15min":1.0009999999999999},"min":{"1min":0.73099999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.411,"5min":1.6519999999999999,"15min":1.873},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.022,"15min":1.0840000000000001},"min":{"1min":0.69099999999999995,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.391,"5min":1.391,"15min":1.6779999999999999},"last":1.0369999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.0249999999999999,"15min":1.077},"min":{"1min":0.75700000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.974},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.0209999999999999,"15min":1.071},"min":{"1min":0.70199999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":2.4399999999999999},"last":0.95999999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:10:18 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.0940000000000001,"15min":1.1399999999999999},"min":{"1min":0.85599999999999998,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.915},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.081,"15min":1.149},"min":{"1min":0.76800000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":2.524},"last":1.085}]}]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326288,"kb_used_data":20808,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94045552,"statfs":{"total":96636764160,"available":96302645248,"internally_reserved":0,"allocated":21307392,"data_stored":21108603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.61699999999999999,"15min":0.61299999999999999},"min":{"1min":0.52500000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68500000000000005,"15min":0.66100000000000003},"min":{"1min":0.53700000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.92400000000000004,"5min":1.522,"15min":1.522},"last":0.72199999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71999999999999997,"15min":0.66300000000000003},"min":{"1min":0.57999999999999996,"5min":0.373,"15min":0.373},"max":{"1min":1.139,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.75600000000000001,"15min":0.76600000000000001},"min":{"1min":0.60899999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.995,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.68400000000000005}]},{"osd":3,"last update":"Sun Oct 8 16:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.78300000000000003,"15min":0.83399999999999996},"min":{"1min":0.60799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.0680000000000001,"5min":1.2989999999999999,"15min":1.7549999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.80800000000000005,"15min":0.77800000000000002},"min":{"1min":0.58899999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.2470000000000001,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.82799999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.93500000000000005,"15min":0.94099999999999995},"min":{"1min":0.73699999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.246,"5min":1.845,"15min":1.845},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.018,"15min":1.016},"min":{"1min":0.67800000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3660000000000001,"5min":3.5910000000000002,"15min":3.5910000000000002},"last":0.86699999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:10:24 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0289999999999999,"15min":1.0369999999999999},"min":{"1min":0.75900000000000001,"5min":0.628,"15min":0.628},"max":{"1min":1.518,"5min":3.6280000000000001,"15min":3.6280000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.05,"15min":1.1040000000000001},"min":{"1min":0.81899999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.4370000000000001,"5min":1.641,"15min":1.641},"last":0.91100000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:10:24 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.0369999999999999,"15min":1.0900000000000001},"min":{"1min":0.85699999999999998,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.415,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.087,"5min":1.095,"15min":1.135},"min":{"1min":0.84399999999999997,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.593,"5min":3.657,"15min":3.657},"last":1.0780000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:10:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.0920000000000001,"15min":1.1459999999999999},"min":{"1min":0.95199999999999996,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.4870000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.032},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.095,"15min":1.125},"min":{"1min":0.89800000000000002,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3380000000000001,"5min":2.101,"15min":2.101},"last":1.006}]}]},{"osd":0,"up_from":13,"seq":55834574929,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":330996,"kb_used_data":21420,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94040844,"statfs":{"total":96636764160,"available":96297824256,"internally_reserved":0,"allocated":21934080,"data_stored":21706793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65500000000000003,"15min":0.64300000000000002},"min":{"1min":0.53800000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.84899999999999998,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70899999999999996,"15min":0.69899999999999995},"min":{"1min":0.49299999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.88,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.78000000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.73899999999999999,"15min":0.70899999999999996},"min":{"1min":0.51300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.103,"5min":1.766,"15min":1.766},"last":1.091},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.83199999999999996,"15min":0.79200000000000004},"min":{"1min":0.56000000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.024,"5min":5.9610000000000003,"15min":5.9610000000000003},"last":1.123}]},{"osd":3,"last update":"Sun Oct 8 16:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.73599999999999999,"15min":0.76300000000000001},"min":{"1min":0.41399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":1.103,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.85299999999999998,"15min":0.82699999999999996},"min":{"1min":0.69099999999999995,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.0740000000000001,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.99299999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.98299999999999998,"15min":0.996},"min":{"1min":0.76700000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.141,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.036},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.94599999999999995,"15min":1.0049999999999999},"min":{"1min":0.70799999999999996,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2450000000000001,"5min":1.365,"15min":1.552},"last":1.167}]},{"osd":5,"last update":"Sun Oct 8 16:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.97599999999999998,"15min":1.008},"min":{"1min":0.82899999999999996,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.4019999999999999,"5min":1.4510000000000001,"15min":1.601},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.0600000000000001,"15min":1.0720000000000001},"min":{"1min":0.84099999999999997,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.351,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.198}]},{"osd":6,"last update":"Sun Oct 8 16:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.087,"15min":1.1200000000000001},"min":{"1min":0.80200000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.369,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.282},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1619999999999999,"15min":1.1060000000000001},"min":{"1min":0.92100000000000004,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.46,"5min":5.827,"15min":5.827},"last":1.3919999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.1619999999999999,"15min":1.157},"min":{"1min":0.91100000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.472,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.306},{"interface":"front","average":{"1min":1.139,"5min":1.0900000000000001,"15min":1.1140000000000001},"min":{"1min":0.86599999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.393,"5min":1.51,"15min":1.51},"last":1.2270000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20983808,"data_stored":20972130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20979712,"data_stored":20971680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4476928,"data_stored":4474292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17068032,"data_stored":17057848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17747968,"data_stored":17738294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":38715392,"data_stored":38709724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":24687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":16404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":36917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":45103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":16417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":49208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":32800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":32840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:10:42.104 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-08T16:10:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.211+0000 7f5ec8a8e700 1 Processor -- start 2023-10-08T16:10:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.211+0000 7f5ec8a8e700 1 -- start start 2023-10-08T16:10:42.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.211+0000 7f5ec8a8e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ec40b4730 0x7f5ec413c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.211+0000 7f5ec8a8e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec40b4d50 con 0x7f5ec40b0ae0 2023-10-08T16:10:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.211+0000 7f5ec8a8e700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec40b1e30 con 0x7f5ec40634e0 2023-10-08T16:10:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.211+0000 7f5ec8a8e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec40b4b50 con 0x7f5ec40b4730 2023-10-08T16:10:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.211+0000 7f5ebaffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5ec40b0ae0 0x7f5ec413c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55092/0 (socket says 172.21.15.133:55092) 2023-10-08T16:10:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.211+0000 7f5ebaffd700 1 -- 172.21.15.133:0/3789609044 learned_addr learned my addr 172.21.15.133:0/3789609044 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:10:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.211+0000 7f5ec3fff700 1 --2- 172.21.15.133:0/3789609044 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ec40b4730 0x7f5ec413c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.211+0000 7f5ec2ffd700 1 -- 172.21.15.133:0/3789609044 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080265565 0 0) 0x7f5ec40b4d50 con 0x7f5ec40b0ae0 2023-10-08T16:10:42.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.211+0000 7f5ec2ffd700 1 -- 172.21.15.133:0/3789609044 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5eb0003570 con 0x7f5ec40b0ae0 2023-10-08T16:10:42.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.211+0000 7f5ec2ffd700 1 -- 172.21.15.133:0/3789609044 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1985107205 0 0) 0x7f5ec40b1e30 con 0x7f5ec40634e0 2023-10-08T16:10:42.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.211+0000 7f5ec2ffd700 1 -- 172.21.15.133:0/3789609044 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ec40b4d50 con 0x7f5ec40634e0 2023-10-08T16:10:42.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.211+0000 7f5ec3fff700 1 -- 172.21.15.133:0/3789609044 >> v1:172.21.15.190:6789/0 conn(0x7f5ec40634e0 legacy=0x7f5ec40b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.211+0000 7f5ec3fff700 1 -- 172.21.15.133:0/3789609044 >> v1:172.21.15.133:6789/0 conn(0x7f5ec40b0ae0 legacy=0x7f5ec413c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.211+0000 7f5ec3fff700 1 -- 172.21.15.133:0/3789609044 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec40b1bc0 con 0x7f5ec40b4730 2023-10-08T16:10:42.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec3fff700 1 --2- 172.21.15.133:0/3789609044 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ec40b4730 0x7f5ec413c840 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009e90 tx=0x7f5ebc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb319d027fb37e05 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:42.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec2ffd700 1 -- 172.21.15.133:0/3789609044 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc00e070 con 0x7f5ec40b4730 2023-10-08T16:10:42.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec2ffd700 1 -- 172.21.15.133:0/3789609044 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ebc00bb80 con 0x7f5ec40b4730 2023-10-08T16:10:42.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec2ffd700 1 -- 172.21.15.133:0/3789609044 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc012430 con 0x7f5ec40b4730 2023-10-08T16:10:42.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec8a8e700 1 -- 172.21.15.133:0/3789609044 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ec40b4730 msgr2=0x7f5ec413c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec8a8e700 1 --2- 172.21.15.133:0/3789609044 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ec40b4730 0x7f5ec413c840 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009e90 tx=0x7f5ebc009780 comp rx=0 tx=0).stop 2023-10-08T16:10:42.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec8a8e700 1 -- 172.21.15.133:0/3789609044 shutdown_connections 2023-10-08T16:10:42.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec8a8e700 1 --2- 172.21.15.133:0/3789609044 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ec40b4730 0x7f5ec413c840 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec8a8e700 1 -- 172.21.15.133:0/3789609044 >> 172.21.15.133:0/3789609044 conn(0x7f5ec4067cd0 msgr2=0x7f5ec4062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:42.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec8a8e700 1 -- 172.21.15.133:0/3789609044 shutdown_connections 2023-10-08T16:10:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec8a8e700 1 -- 172.21.15.133:0/3789609044 wait complete. 2023-10-08T16:10:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec8a8e700 1 Processor -- start 2023-10-08T16:10:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec8a8e700 1 -- start start 2023-10-08T16:10:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec8a8e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ec40634e0 0x7f5ec4154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec8a8e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ec40b0ae0 0x7f5ec413d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec8a8e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ec40b4730 0x7f5ec40b7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec8a8e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec4144770 con 0x7f5ec40b4730 2023-10-08T16:10:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec8a8e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec413cdf0 con 0x7f5ec40634e0 2023-10-08T16:10:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec8a8e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec413d000 con 0x7f5ec40b0ae0 2023-10-08T16:10:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ec40b4730 0x7f5ec40b7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ec40b4730 0x7f5ec40b7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34012/0 (socket says 172.21.15.133:34012) 2023-10-08T16:10:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec3fff700 1 -- 172.21.15.133:0/3521850154 learned_addr learned my addr 172.21.15.133:0/3521850154 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:10:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ebaffd700 1 --2- 172.21.15.133:0/3521850154 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ec40b0ae0 0x7f5ec413d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec37fe700 1 --2- 172.21.15.133:0/3521850154 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ec40634e0 0x7f5ec4154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec3fff700 1 -- 172.21.15.133:0/3521850154 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ec40b0ae0 msgr2=0x7f5ec413d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec3fff700 1 --2- 172.21.15.133:0/3521850154 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ec40b0ae0 0x7f5ec413d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec3fff700 1 -- 172.21.15.133:0/3521850154 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ec40634e0 msgr2=0x7f5ec4154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec3fff700 1 --2- 172.21.15.133:0/3521850154 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ec40634e0 0x7f5ec4154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec3fff700 1 -- 172.21.15.133:0/3521850154 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ebc009a20 con 0x7f5ec40b4730 2023-10-08T16:10:42.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ec3fff700 1 --2- 172.21.15.133:0/3521850154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ec40b4730 0x7f5ec40b7c00 secure :-1 s=READY pgs=4416 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc00b610 tx=0x7f5ebc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:42.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.215+0000 7f5ebbfff700 1 -- 172.21.15.133:0/3521850154 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc007000 con 0x7f5ec40b4730 2023-10-08T16:10:42.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.219+0000 7f5ebbfff700 1 -- 172.21.15.133:0/3521850154 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ebc0263f0 con 0x7f5ec40b4730 2023-10-08T16:10:42.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.219+0000 7f5ebbfff700 1 -- 172.21.15.133:0/3521850154 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc0267f0 con 0x7f5ec40b4730 2023-10-08T16:10:42.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.219+0000 7f5ec8a8e700 1 -- 172.21.15.133:0/3521850154 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec413d2e0 con 0x7f5ec40b4730 2023-10-08T16:10:42.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.219+0000 7f5ec8a8e700 1 -- 172.21.15.133:0/3521850154 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec40b8140 con 0x7f5ec40b4730 2023-10-08T16:10:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.219+0000 7f5ec8a8e700 1 -- 172.21.15.133:0/3521850154 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec413d4d0 con 0x7f5ec40b4730 2023-10-08T16:10:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.219+0000 7f5ebbfff700 1 -- 172.21.15.133:0/3521850154 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5ebc026be0 con 0x7f5ec40b4730 2023-10-08T16:10:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.219+0000 7f5ebbfff700 1 --2- 172.21.15.133:0/3521850154 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5ea4060580 0x7f5ea4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.219+0000 7f5ebbfff700 1 -- 172.21.15.133:0/3521850154 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f5ebc07e3b0 con 0x7f5ec40b4730 2023-10-08T16:10:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.219+0000 7f5ec37fe700 1 --2- 172.21.15.133:0/3521850154 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5ea4060580 0x7f5ea4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.219+0000 7f5ec37fe700 1 --2- 172.21.15.133:0/3521850154 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5ea4060580 0x7f5ea4062a30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4007fd0 tx=0x7f5eb4007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:42.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.223+0000 7f5ebbfff700 1 -- 172.21.15.133:0/3521850154 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5ebc04e910 con 0x7f5ec40b4730 2023-10-08T16:10:42.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.383+0000 7f5ec8a8e700 1 -- 172.21.15.133:0/3521850154 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f5ec404be40 con 0x7f5ec40b4730 2023-10-08T16:10:42.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.395+0000 7f5ebbfff700 1 -- 172.21.15.133:0/3521850154 <== mon.0 v2:172.21.15.133:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5ebc04e910 con 0x7f5ec40b4730 2023-10-08T16:10:42.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.395+0000 7f5ebbfff700 1 -- 172.21.15.133:0/3521850154 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f5ebc051f30 con 0x7f5ec40b4730 2023-10-08T16:10:42.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.399+0000 7f5ec8a8e700 1 -- 172.21.15.133:0/3521850154 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5ea4060580 msgr2=0x7f5ea4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.399+0000 7f5ec8a8e700 1 --2- 172.21.15.133:0/3521850154 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5ea4060580 0x7f5ea4062a30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4007fd0 tx=0x7f5eb4007d50 comp rx=0 tx=0).stop 2023-10-08T16:10:42.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.399+0000 7f5ec8a8e700 1 -- 172.21.15.133:0/3521850154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ec40b4730 msgr2=0x7f5ec40b7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.399+0000 7f5ec8a8e700 1 --2- 172.21.15.133:0/3521850154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ec40b4730 0x7f5ec40b7c00 secure :-1 s=READY pgs=4416 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc00b610 tx=0x7f5ebc019000 comp rx=0 tx=0).stop 2023-10-08T16:10:42.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.399+0000 7f5ec8a8e700 1 -- 172.21.15.133:0/3521850154 shutdown_connections 2023-10-08T16:10:42.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.399+0000 7f5ec8a8e700 1 --2- 172.21.15.133:0/3521850154 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5ea4060580 0x7f5ea4062a30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.399+0000 7f5ec8a8e700 1 --2- 172.21.15.133:0/3521850154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ec40b4730 0x7f5ec40b7c00 unknown :-1 s=CLOSED pgs=4416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.399+0000 7f5ec8a8e700 1 --2- 172.21.15.133:0/3521850154 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ec40b0ae0 0x7f5ec413d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.399+0000 7f5ec8a8e700 1 --2- 172.21.15.133:0/3521850154 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ec40634e0 0x7f5ec4154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.399+0000 7f5ec8a8e700 1 -- 172.21.15.133:0/3521850154 >> 172.21.15.133:0/3521850154 conn(0x7f5ec4067cd0 msgr2=0x7f5ec413aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:42.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.399+0000 7f5ec8a8e700 1 -- 172.21.15.133:0/3521850154 shutdown_connections 2023-10-08T16:10:42.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.399+0000 7f5ec8a8e700 1 -- 172.21.15.133:0/3521850154 wait complete. 2023-10-08T16:10:42.416 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T16:10:42.417 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:10:42.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.507+0000 7fce9c84a700 1 Processor -- start 2023-10-08T16:10:42.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.507+0000 7fce9c84a700 1 -- start start 2023-10-08T16:10:42.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.507+0000 7fce9c84a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fce980b2ec0 0x7fce98143810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.507+0000 7fce9c84a700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce98140540 0x7fce98140980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.507+0000 7fce9c84a700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce980aff50 con 0x7fce980af400 2023-10-08T16:10:42.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.511+0000 7fce9c84a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce9813aa90 con 0x7fce980b2ec0 2023-10-08T16:10:42.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.511+0000 7fce9c84a700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce98144610 con 0x7fce98140540 2023-10-08T16:10:42.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.511+0000 7fce977fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fce980b2ec0 0x7fce98143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.511+0000 7fce977fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fce980b2ec0 0x7fce98143810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34014/0 (socket says 172.21.15.133:34014) 2023-10-08T16:10:42.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.511+0000 7fce977fe700 1 -- 172.21.15.133:0/1233455981 learned_addr learned my addr 172.21.15.133:0/1233455981 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:10:42.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.511+0000 7fce8effd700 1 --2- 172.21.15.133:0/1233455981 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce98140540 0x7fce98140980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.511+0000 7fce96ffd700 1 -- 172.21.15.133:0/1233455981 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235989806 0 0) 0x7fce90001490 con 0x7fce980af400 2023-10-08T16:10:42.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.511+0000 7fce96ffd700 1 -- 172.21.15.133:0/1233455981 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce84003570 con 0x7fce980af400 2023-10-08T16:10:42.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.511+0000 7fce977fe700 1 -- 172.21.15.133:0/1233455981 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce98140540 msgr2=0x7fce98140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:42.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.511+0000 7fce977fe700 1 --2- 172.21.15.133:0/1233455981 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce98140540 0x7fce98140980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.511+0000 7fce977fe700 1 -- 172.21.15.133:0/1233455981 >> v1:172.21.15.190:6789/0 conn(0x7fce980af400 legacy=0x7fce980af840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.511+0000 7fce977fe700 1 -- 172.21.15.133:0/1233455981 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce980b1e90 con 0x7fce980b2ec0 2023-10-08T16:10:42.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.511+0000 7fce977fe700 1 --2- 172.21.15.133:0/1233455981 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce980b2ec0 0x7fce98143810 secure :-1 s=READY pgs=4417 cs=0 l=1 rev1=1 crypto rx=0x7fce880099b0 tx=0x7fce88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa29db21bb7c574 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:42.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.511+0000 7fce96ffd700 1 -- 172.21.15.133:0/1233455981 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8800b680 con 0x7fce980b2ec0 2023-10-08T16:10:42.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.511+0000 7fce96ffd700 1 -- 172.21.15.133:0/1233455981 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fce8800b7e0 con 0x7fce980b2ec0 2023-10-08T16:10:42.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.511+0000 7fce96ffd700 1 -- 172.21.15.133:0/1233455981 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8800bba0 con 0x7fce980b2ec0 2023-10-08T16:10:42.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.511+0000 7fce9c84a700 1 -- 172.21.15.133:0/1233455981 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce980b2ec0 msgr2=0x7fce98143810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.511+0000 7fce9c84a700 1 --2- 172.21.15.133:0/1233455981 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce980b2ec0 0x7fce98143810 secure :-1 s=READY pgs=4417 cs=0 l=1 rev1=1 crypto rx=0x7fce880099b0 tx=0x7fce88009250 comp rx=0 tx=0).stop 2023-10-08T16:10:42.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.511+0000 7fce9c84a700 1 -- 172.21.15.133:0/1233455981 shutdown_connections 2023-10-08T16:10:42.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.511+0000 7fce9c84a700 1 --2- 172.21.15.133:0/1233455981 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce98140540 0x7fce98140980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.511+0000 7fce9c84a700 1 --2- 172.21.15.133:0/1233455981 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce980b2ec0 0x7fce98143810 unknown :-1 s=CLOSED pgs=4417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.511+0000 7fce9c84a700 1 -- 172.21.15.133:0/1233455981 >> 172.21.15.133:0/1233455981 conn(0x7fce98067a60 msgr2=0x7fce980b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:42.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.511+0000 7fce9c84a700 1 -- 172.21.15.133:0/1233455981 shutdown_connections 2023-10-08T16:10:42.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.511+0000 7fce9c84a700 1 -- 172.21.15.133:0/1233455981 wait complete. 2023-10-08T16:10:42.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.515+0000 7fce9c84a700 1 Processor -- start 2023-10-08T16:10:42.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.515+0000 7fce9c84a700 1 -- start start 2023-10-08T16:10:42.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.515+0000 7fce9c84a700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce980af400 0x7fce981381a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.515+0000 7fce9c84a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce980b2ec0 0x7fce980ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.515+0000 7fce9c84a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce98140540 0x7fce980ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.515+0000 7fce9c84a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce981386e0 con 0x7fce98140540 2023-10-08T16:10:42.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.515+0000 7fce9c84a700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9813c5c0 con 0x7fce980b2ec0 2023-10-08T16:10:42.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.515+0000 7fce9c84a700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce980aded0 con 0x7fce980af400 2023-10-08T16:10:42.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.515+0000 7fce97fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce98140540 0x7fce980ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.515+0000 7fce97fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce98140540 0x7fce980ae8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34024/0 (socket says 172.21.15.133:34024) 2023-10-08T16:10:42.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.515+0000 7fce97fff700 1 -- 172.21.15.133:0/321088029 learned_addr learned my addr 172.21.15.133:0/321088029 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:10:42.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.515+0000 7fce977fe700 1 --2- 172.21.15.133:0/321088029 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce980af400 0x7fce981381a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.515+0000 7fce8effd700 1 --2- 172.21.15.133:0/321088029 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce980b2ec0 0x7fce980ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.515+0000 7fce97fff700 1 -- 172.21.15.133:0/321088029 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce980af400 msgr2=0x7fce981381a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.515+0000 7fce97fff700 1 --2- 172.21.15.133:0/321088029 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce980af400 0x7fce981381a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.515+0000 7fce97fff700 1 -- 172.21.15.133:0/321088029 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce980b2ec0 msgr2=0x7fce980ae3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.515+0000 7fce97fff700 1 --2- 172.21.15.133:0/321088029 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce980b2ec0 0x7fce980ae3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.515+0000 7fce97fff700 1 -- 172.21.15.133:0/321088029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce880094f0 con 0x7fce98140540 2023-10-08T16:10:42.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.515+0000 7fce8effd700 1 --2- 172.21.15.133:0/321088029 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce980b2ec0 0x7fce980ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:42.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.515+0000 7fce97fff700 1 --2- 172.21.15.133:0/321088029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce98140540 0x7fce980ae8f0 secure :-1 s=READY pgs=4418 cs=0 l=1 rev1=1 crypto rx=0x7fce9000c820 tx=0x7fce9000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:42.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.515+0000 7fce8ffff700 1 -- 172.21.15.133:0/321088029 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce90002260 con 0x7fce98140540 2023-10-08T16:10:42.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.515+0000 7fce8ffff700 1 -- 172.21.15.133:0/321088029 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fce900023c0 con 0x7fce98140540 2023-10-08T16:10:42.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.515+0000 7fce9c84a700 1 -- 172.21.15.133:0/321088029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce9813b110 con 0x7fce98140540 2023-10-08T16:10:42.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.515+0000 7fce8ffff700 1 -- 172.21.15.133:0/321088029 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce90001740 con 0x7fce98140540 2023-10-08T16:10:42.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.515+0000 7fce9c84a700 1 -- 172.21.15.133:0/321088029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce980af100 con 0x7fce98140540 2023-10-08T16:10:42.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.515+0000 7fce9c84a700 1 -- 172.21.15.133:0/321088029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce980ae090 con 0x7fce98140540 2023-10-08T16:10:42.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.519+0000 7fce8ffff700 1 -- 172.21.15.133:0/321088029 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fce90001b70 con 0x7fce98140540 2023-10-08T16:10:42.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.519+0000 7fce8ffff700 1 --2- 172.21.15.133:0/321088029 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fce78060550 0x7fce78062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.519+0000 7fce8ffff700 1 -- 172.21.15.133:0/321088029 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fce9007c750 con 0x7fce98140540 2023-10-08T16:10:42.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.519+0000 7fce977fe700 1 --2- 172.21.15.133:0/321088029 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fce78060550 0x7fce78062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.519+0000 7fce977fe700 1 --2- 172.21.15.133:0/321088029 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fce78060550 0x7fce78062a00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fce880099b0 tx=0x7fce88009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:42.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.527+0000 7fce8ffff700 1 -- 172.21.15.133:0/321088029 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fce9004cc90 con 0x7fce98140540 2023-10-08T16:10:42.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.723+0000 7fce9c84a700 1 -- 172.21.15.133:0/321088029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce980aff50 con 0x7fce98140540 2023-10-08T16:10:42.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.723+0000 7fce8ffff700 1 -- 172.21.15.133:0/321088029 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3082 (secure 0 0 0) 0x7fce980aff50 con 0x7fce98140540 2023-10-08T16:10:42.727 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:10:42.727 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3690493804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3690493804},{"type":"v1","addr":"172.21.15.190:6833","nonce":3690493804}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:04:16.997946+0000","modified":"2023-10-08T16:04:19.656961+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/443398897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":443398897},{"type":"v1","addr":"172.21.15.133:6835","nonce":443398897}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:10:42.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.727+0000 7fce9c84a700 1 -- 172.21.15.133:0/321088029 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fce78060550 msgr2=0x7fce78062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.727+0000 7fce9c84a700 1 --2- 172.21.15.133:0/321088029 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fce78060550 0x7fce78062a00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fce880099b0 tx=0x7fce88009250 comp rx=0 tx=0).stop 2023-10-08T16:10:42.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.727+0000 7fce9c84a700 1 -- 172.21.15.133:0/321088029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce98140540 msgr2=0x7fce980ae8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.727+0000 7fce9c84a700 1 --2- 172.21.15.133:0/321088029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce98140540 0x7fce980ae8f0 secure :-1 s=READY pgs=4418 cs=0 l=1 rev1=1 crypto rx=0x7fce9000c820 tx=0x7fce9000cbe0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.727+0000 7fce9c84a700 1 -- 172.21.15.133:0/321088029 shutdown_connections 2023-10-08T16:10:42.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.727+0000 7fce9c84a700 1 --2- 172.21.15.133:0/321088029 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7fce78060550 0x7fce78062a00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.727+0000 7fce9c84a700 1 --2- 172.21.15.133:0/321088029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce98140540 0x7fce980ae8f0 unknown :-1 s=CLOSED pgs=4418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.727+0000 7fce9c84a700 1 --2- 172.21.15.133:0/321088029 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce980b2ec0 0x7fce980ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.727+0000 7fce9c84a700 1 --2- 172.21.15.133:0/321088029 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce980af400 0x7fce981381a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.727+0000 7fce9c84a700 1 -- 172.21.15.133:0/321088029 >> 172.21.15.133:0/321088029 conn(0x7fce98067a60 msgr2=0x7fce9813e200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:42.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.727+0000 7fce9c84a700 1 -- 172.21.15.133:0/321088029 shutdown_connections 2023-10-08T16:10:42.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.727+0000 7fce9c84a700 1 -- 172.21.15.133:0/321088029 wait complete. 2023-10-08T16:10:42.732 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 6 2023-10-08T16:10:42.743 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:10:42.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.843+0000 7f244759e700 1 Processor -- start 2023-10-08T16:10:42.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.843+0000 7f244759e700 1 -- start start 2023-10-08T16:10:42.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.847+0000 7f244759e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24480b1dc0 0x7f24480ae180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.847+0000 7f244759e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f24480b0030 0x7f2448067c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.847+0000 7f244759e700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24480b0ec0 con 0x7f24480681b0 2023-10-08T16:10:42.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.847+0000 7f244759e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24480ae6c0 con 0x7f24480b0030 2023-10-08T16:10:42.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.847+0000 7f244759e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24480ad4f0 con 0x7f24480b1dc0 2023-10-08T16:10:42.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.847+0000 7f2445d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f24480b0030 0x7f2448067c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.847+0000 7f2445d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f24480b0030 0x7f2448067c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34034/0 (socket says 172.21.15.133:34034) 2023-10-08T16:10:42.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.847+0000 7f2445d9b700 1 -- 172.21.15.133:0/1042301067 learned_addr learned my addr 172.21.15.133:0/1042301067 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:10:42.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.847+0000 7f244659c700 1 --2- 172.21.15.133:0/1042301067 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24480b1dc0 0x7f24480ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.847+0000 7f2445d9b700 1 -- 172.21.15.133:0/1042301067 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24480b1dc0 msgr2=0x7f24480ae180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:42.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.847+0000 7f2445d9b700 1 --2- 172.21.15.133:0/1042301067 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24480b1dc0 0x7f24480ae180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.847+0000 7f2445d9b700 1 -- 172.21.15.133:0/1042301067 >> v1:172.21.15.190:6789/0 conn(0x7f24480681b0 legacy=0x7f244814a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.847+0000 7f244559a700 1 -- 172.21.15.133:0/1042301067 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071778976 0 0) 0x7f24480b0ec0 con 0x7f24480681b0 2023-10-08T16:10:42.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.847+0000 7f2445d9b700 1 -- 172.21.15.133:0/1042301067 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24480ac250 con 0x7f24480b0030 2023-10-08T16:10:42.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.847+0000 7f2445d9b700 1 --2- 172.21.15.133:0/1042301067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24480b0030 0x7f2448067c70 secure :-1 s=READY pgs=4419 cs=0 l=1 rev1=1 crypto rx=0x7f24300099b0 tx=0x7f2430009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e0db36432c2a908 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:42.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.847+0000 7f244559a700 1 -- 172.21.15.133:0/1042301067 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2430009ea0 con 0x7f24480b0030 2023-10-08T16:10:42.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.847+0000 7f244559a700 1 -- 172.21.15.133:0/1042301067 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f243000b860 con 0x7f24480b0030 2023-10-08T16:10:42.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.847+0000 7f244559a700 1 -- 172.21.15.133:0/1042301067 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243000bc20 con 0x7f24480b0030 2023-10-08T16:10:42.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.847+0000 7f244759e700 1 -- 172.21.15.133:0/1042301067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24480b0030 msgr2=0x7f2448067c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.847+0000 7f244759e700 1 --2- 172.21.15.133:0/1042301067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24480b0030 0x7f2448067c70 secure :-1 s=READY pgs=4419 cs=0 l=1 rev1=1 crypto rx=0x7f24300099b0 tx=0x7f2430009250 comp rx=0 tx=0).stop 2023-10-08T16:10:42.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.847+0000 7f244759e700 1 -- 172.21.15.133:0/1042301067 shutdown_connections 2023-10-08T16:10:42.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.847+0000 7f244759e700 1 --2- 172.21.15.133:0/1042301067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24480b0030 0x7f2448067c70 unknown :-1 s=CLOSED pgs=4419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.847+0000 7f244759e700 1 --2- 172.21.15.133:0/1042301067 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24480b1dc0 0x7f24480ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.847+0000 7f244759e700 1 -- 172.21.15.133:0/1042301067 >> 172.21.15.133:0/1042301067 conn(0x7f2448063670 msgr2=0x7f24480b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:42.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.847+0000 7f244759e700 1 -- 172.21.15.133:0/1042301067 shutdown_connections 2023-10-08T16:10:42.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.847+0000 7f244759e700 1 -- 172.21.15.133:0/1042301067 wait complete. 2023-10-08T16:10:42.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.851+0000 7f244759e700 1 Processor -- start 2023-10-08T16:10:42.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.851+0000 7f244759e700 1 -- start start 2023-10-08T16:10:42.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.851+0000 7f244759e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24480681b0 0x7f244806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.851+0000 7f244759e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24480b0030 0x7f2448156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.851+0000 7f244759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24480b1dc0 0x7f24481566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.851+0000 7f244759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2448143630 con 0x7f24480b1dc0 2023-10-08T16:10:42.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.851+0000 7f244759e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2448159900 con 0x7f24480681b0 2023-10-08T16:10:42.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.851+0000 7f244759e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24480a61a0 con 0x7f24480b0030 2023-10-08T16:10:42.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.851+0000 7f2446d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24480b1dc0 0x7f24481566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.851+0000 7f2446d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24480b1dc0 0x7f24481566c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34038/0 (socket says 172.21.15.133:34038) 2023-10-08T16:10:42.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.851+0000 7f2446d9d700 1 -- 172.21.15.133:0/2096561237 learned_addr learned my addr 172.21.15.133:0/2096561237 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:10:42.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.851+0000 7f2445d9b700 1 --2- 172.21.15.133:0/2096561237 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24480b0030 0x7f2448156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.851+0000 7f244659c700 1 --2- 172.21.15.133:0/2096561237 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24480681b0 0x7f244806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.851+0000 7f2446d9d700 1 -- 172.21.15.133:0/2096561237 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24480b0030 msgr2=0x7f2448156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.851+0000 7f2446d9d700 1 --2- 172.21.15.133:0/2096561237 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24480b0030 0x7f2448156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.851+0000 7f2446d9d700 1 -- 172.21.15.133:0/2096561237 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24480681b0 msgr2=0x7f244806d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.851+0000 7f2446d9d700 1 --2- 172.21.15.133:0/2096561237 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24480681b0 0x7f244806d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.851+0000 7f2446d9d700 1 -- 172.21.15.133:0/2096561237 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24300094f0 con 0x7f24480b1dc0 2023-10-08T16:10:42.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.851+0000 7f244659c700 1 --2- 172.21.15.133:0/2096561237 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24480681b0 0x7f244806d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:42.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.851+0000 7f2446d9d700 1 --2- 172.21.15.133:0/2096561237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24480b1dc0 0x7f24481566c0 secure :-1 s=READY pgs=4420 cs=0 l=1 rev1=1 crypto rx=0x7f244000c860 tx=0x7f2440001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:42.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.851+0000 7f243e7fc700 1 -- 172.21.15.133:0/2096561237 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440012630 con 0x7f24480b1dc0 2023-10-08T16:10:42.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.851+0000 7f243e7fc700 1 -- 172.21.15.133:0/2096561237 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f24400127b0 con 0x7f24480b1dc0 2023-10-08T16:10:42.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.851+0000 7f243e7fc700 1 -- 172.21.15.133:0/2096561237 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440012b90 con 0x7f24480b1dc0 2023-10-08T16:10:42.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.851+0000 7f244759e700 1 -- 172.21.15.133:0/2096561237 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24480a64e0 con 0x7f24480b1dc0 2023-10-08T16:10:42.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.851+0000 7f244759e700 1 -- 172.21.15.133:0/2096561237 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f244806d690 con 0x7f24480b1dc0 2023-10-08T16:10:42.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.855+0000 7f244759e700 1 -- 172.21.15.133:0/2096561237 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f244804be40 con 0x7f24480b1dc0 2023-10-08T16:10:42.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.855+0000 7f243e7fc700 1 -- 172.21.15.133:0/2096561237 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f244001b400 con 0x7f24480b1dc0 2023-10-08T16:10:42.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.855+0000 7f243e7fc700 1 --2- 172.21.15.133:0/2096561237 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f2428060550 0x7f2428062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.855+0000 7f244659c700 1 --2- 172.21.15.133:0/2096561237 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f2428060550 0x7f2428062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.855+0000 7f243e7fc700 1 -- 172.21.15.133:0/2096561237 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f244007cad0 con 0x7f24480b1dc0 2023-10-08T16:10:42.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.855+0000 7f244659c700 1 --2- 172.21.15.133:0/2096561237 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f2428060550 0x7f2428062a00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f244814b710 tx=0x7f2438008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:42.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:42.859+0000 7f243e7fc700 1 -- 172.21.15.133:0/2096561237 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f244004d0b0 con 0x7f24480b1dc0 2023-10-08T16:10:43.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.051+0000 7f244759e700 1 -- 172.21.15.133:0/2096561237 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24480ac530 con 0x7f24480b1dc0 2023-10-08T16:10:43.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.055+0000 7f243e7fc700 1 -- 172.21.15.133:0/2096561237 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3082 (secure 0 0 0) 0x7f2440016090 con 0x7f24480b1dc0 2023-10-08T16:10:43.059 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:10:43.059 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3690493804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3690493804},{"type":"v1","addr":"172.21.15.190:6833","nonce":3690493804}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:04:16.997946+0000","modified":"2023-10-08T16:04:19.656961+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/443398897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":443398897},{"type":"v1","addr":"172.21.15.133:6835","nonce":443398897}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:10:43.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.055+0000 7f244759e700 1 -- 172.21.15.133:0/2096561237 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f2428060550 msgr2=0x7f2428062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.055+0000 7f244759e700 1 --2- 172.21.15.133:0/2096561237 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f2428060550 0x7f2428062a00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f244814b710 tx=0x7f2438008040 comp rx=0 tx=0).stop 2023-10-08T16:10:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.055+0000 7f244759e700 1 -- 172.21.15.133:0/2096561237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24480b1dc0 msgr2=0x7f24481566c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.055+0000 7f244759e700 1 --2- 172.21.15.133:0/2096561237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24480b1dc0 0x7f24481566c0 secure :-1 s=READY pgs=4420 cs=0 l=1 rev1=1 crypto rx=0x7f244000c860 tx=0x7f2440001670 comp rx=0 tx=0).stop 2023-10-08T16:10:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.055+0000 7f244759e700 1 -- 172.21.15.133:0/2096561237 shutdown_connections 2023-10-08T16:10:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.055+0000 7f244759e700 1 --2- 172.21.15.133:0/2096561237 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f2428060550 0x7f2428062a00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.055+0000 7f244759e700 1 --2- 172.21.15.133:0/2096561237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24480b1dc0 0x7f24481566c0 unknown :-1 s=CLOSED pgs=4420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.055+0000 7f244759e700 1 --2- 172.21.15.133:0/2096561237 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24480b0030 0x7f2448156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.055+0000 7f244759e700 1 --2- 172.21.15.133:0/2096561237 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24480681b0 0x7f244806d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.055+0000 7f244759e700 1 -- 172.21.15.133:0/2096561237 >> 172.21.15.133:0/2096561237 conn(0x7f2448063670 msgr2=0x7f2448148830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:43.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.055+0000 7f244759e700 1 -- 172.21.15.133:0/2096561237 shutdown_connections 2023-10-08T16:10:43.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.055+0000 7f244759e700 1 -- 172.21.15.133:0/2096561237 wait complete. 2023-10-08T16:10:43.063 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 6 2023-10-08T16:10:43.074 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:10:43.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6ab6006700 1 Processor -- start 2023-10-08T16:10:43.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6ab6006700 1 -- start start 2023-10-08T16:10:43.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6ab6006700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6ab0142a80 0x7f6ab0142f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6ab6006700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab006c5c0 con 0x7f6ab00b2ec0 2023-10-08T16:10:43.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6ab6006700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab01425a0 con 0x7f6ab013bcc0 2023-10-08T16:10:43.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6ab6006700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab0146550 con 0x7f6ab0142a80 2023-10-08T16:10:43.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6ab5004700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6ab00b2ec0 0x7f6ab0145a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55096/0 (socket says 172.21.15.133:55096) 2023-10-08T16:10:43.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6ab5004700 1 -- 172.21.15.133:0/465383295 learned_addr learned my addr 172.21.15.133:0/465383295 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:10:43.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6ab4803700 1 --2- 172.21.15.133:0/465383295 >> v2:172.21.15.190:3300/0 conn(0x7f6ab0142a80 0x7f6ab0142f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6aa7fff700 1 -- 172.21.15.133:0/465383295 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2689559135 0 0) 0x7f6ab006c5c0 con 0x7f6ab00b2ec0 2023-10-08T16:10:43.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6aa7fff700 1 -- 172.21.15.133:0/465383295 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a98003570 con 0x7f6ab00b2ec0 2023-10-08T16:10:43.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6aa7fff700 1 -- 172.21.15.133:0/465383295 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674964302 0 0) 0x7f6ab01425a0 con 0x7f6ab013bcc0 2023-10-08T16:10:43.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6aa7fff700 1 -- 172.21.15.133:0/465383295 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ab006c5c0 con 0x7f6ab013bcc0 2023-10-08T16:10:43.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6aa7fff700 1 -- 172.21.15.133:0/465383295 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3295781711 0 0) 0x7f6a98003570 con 0x7f6ab00b2ec0 2023-10-08T16:10:43.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6aa7fff700 1 -- 172.21.15.133:0/465383295 >> v2:172.21.15.190:3300/0 conn(0x7f6ab0142a80 msgr2=0x7f6ab0142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:43.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6aa7fff700 1 --2- 172.21.15.133:0/465383295 >> v2:172.21.15.190:3300/0 conn(0x7f6ab0142a80 0x7f6ab0142f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6aa7fff700 1 -- 172.21.15.133:0/465383295 >> v1:172.21.15.190:6789/0 conn(0x7f6ab013bcc0 legacy=0x7f6ab013c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6aa7fff700 1 -- 172.21.15.133:0/465383295 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab00b3290 con 0x7f6ab00b2ec0 2023-10-08T16:10:43.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6aa7fff700 1 -- 172.21.15.133:0/465383295 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2883817959 0 0) 0x7f6aa00017f0 con 0x7f6ab00b2ec0 2023-10-08T16:10:43.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6aa7fff700 1 -- 172.21.15.133:0/465383295 >> v1:172.21.15.133:6789/0 conn(0x7f6ab00b2ec0 legacy=0x7f6ab0145a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6aa7fff700 1 --2- 172.21.15.133:0/465383295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a98003c40 0x7f6a98004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6aa7fff700 1 --2- 172.21.15.133:0/465383295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a98004810 0x7f6a98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6aa7fff700 1 --2- 172.21.15.133:0/465383295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a98005210 0x7f6a9800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6aa7fff700 1 -- 172.21.15.133:0/465383295 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab0146550 con 0x7f6a98003c40 2023-10-08T16:10:43.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6aa7fff700 1 -- 172.21.15.133:0/465383295 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9800c1b0 con 0x7f6a98005210 2023-10-08T16:10:43.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6aa7fff700 1 -- 172.21.15.133:0/465383295 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9800c370 con 0x7f6a98004810 2023-10-08T16:10:43.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.175+0000 7f6ab5004700 1 --2- 172.21.15.133:0/465383295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a98003c40 0x7f6a98004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.179+0000 7f6ab4803700 1 --2- 172.21.15.133:0/465383295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a98004810 0x7f6a98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.179+0000 7f6ab5805700 1 --2- 172.21.15.133:0/465383295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a98005210 0x7f6a9800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.179+0000 7f6ab5004700 1 -- 172.21.15.133:0/465383295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a98004810 msgr2=0x7f6a98004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:43.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.179+0000 7f6ab5004700 1 --2- 172.21.15.133:0/465383295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a98004810 0x7f6a98004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.179+0000 7f6ab5004700 1 -- 172.21.15.133:0/465383295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a98005210 msgr2=0x7f6a9800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:43.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.179+0000 7f6ab5004700 1 --2- 172.21.15.133:0/465383295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a98005210 0x7f6a9800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.179+0000 7f6ab5004700 1 -- 172.21.15.133:0/465383295 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a98003570 con 0x7f6a98003c40 2023-10-08T16:10:43.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.179+0000 7f6ab5805700 1 --2- 172.21.15.133:0/465383295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a98005210 0x7f6a9800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:43.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.179+0000 7f6ab5805700 1 -- 172.21.15.133:0/465383295 reap_dead start 2023-10-08T16:10:43.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.179+0000 7f6ab5004700 1 --2- 172.21.15.133:0/465383295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a98003c40 0x7f6a98004030 secure :-1 s=READY pgs=4422 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000a7f0 tx=0x7f6ab0142730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c55e7486630bc3d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:43.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.179+0000 7f6aa7fff700 1 -- 172.21.15.133:0/465383295 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa00070d0 con 0x7f6a98003c40 2023-10-08T16:10:43.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.179+0000 7f6aa7fff700 1 -- 172.21.15.133:0/465383295 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6aa0007230 con 0x7f6a98003c40 2023-10-08T16:10:43.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.179+0000 7f6aa7fff700 1 -- 172.21.15.133:0/465383295 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0007610 con 0x7f6a98003c40 2023-10-08T16:10:43.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.179+0000 7f6ab6006700 1 -- 172.21.15.133:0/465383295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a98003c40 msgr2=0x7f6a98004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.179+0000 7f6ab6006700 1 --2- 172.21.15.133:0/465383295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a98003c40 0x7f6a98004030 secure :-1 s=READY pgs=4422 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000a7f0 tx=0x7f6ab0142730 comp rx=0 tx=0).stop 2023-10-08T16:10:43.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.179+0000 7f6ab6006700 1 -- 172.21.15.133:0/465383295 shutdown_connections 2023-10-08T16:10:43.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.179+0000 7f6ab6006700 1 --2- 172.21.15.133:0/465383295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a98003c40 0x7f6a98004030 unknown :-1 s=CLOSED pgs=4422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.179+0000 7f6ab6006700 1 -- 172.21.15.133:0/465383295 >> 172.21.15.133:0/465383295 conn(0x7f6ab0067a60 msgr2=0x7f6ab00b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:43.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.179+0000 7f6ab6006700 1 -- 172.21.15.133:0/465383295 shutdown_connections 2023-10-08T16:10:43.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.179+0000 7f6ab6006700 1 -- 172.21.15.133:0/465383295 wait complete. 2023-10-08T16:10:43.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.179+0000 7f6ab6006700 1 Processor -- start 2023-10-08T16:10:43.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.179+0000 7f6ab6006700 1 -- start start 2023-10-08T16:10:43.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.183+0000 7f6ab6006700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a98003c40 0x7f6ab00a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.183+0000 7f6ab6006700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ab006e310 0x7f6ab00aad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.183+0000 7f6ab6006700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ab0155e90 0x7f6ab0156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.183+0000 7f6ab6006700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00abc00 con 0x7f6a98003c40 2023-10-08T16:10:43.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.183+0000 7f6ab6006700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00af810 con 0x7f6ab0155e90 2023-10-08T16:10:43.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.183+0000 7f6ab6006700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00b5820 con 0x7f6ab006e310 2023-10-08T16:10:43.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.183+0000 7f6ab5004700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a98003c40 0x7f6ab00a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.183+0000 7f6ab5805700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ab0155e90 0x7f6ab0156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.183+0000 7f6ab5004700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a98003c40 0x7f6ab00a9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34054/0 (socket says 172.21.15.133:34054) 2023-10-08T16:10:43.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.183+0000 7f6ab5004700 1 -- 172.21.15.133:0/468836828 learned_addr learned my addr 172.21.15.133:0/468836828 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:10:43.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.183+0000 7f6ab4803700 1 --2- 172.21.15.133:0/468836828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ab006e310 0x7f6ab00aad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.183+0000 7f6ab5004700 1 -- 172.21.15.133:0/468836828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ab006e310 msgr2=0x7f6ab00aad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.183+0000 7f6ab5004700 1 --2- 172.21.15.133:0/468836828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ab006e310 0x7f6ab00aad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.183+0000 7f6ab5004700 1 -- 172.21.15.133:0/468836828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ab0155e90 msgr2=0x7f6ab0156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.183+0000 7f6ab5004700 1 --2- 172.21.15.133:0/468836828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ab0155e90 0x7f6ab0156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.183+0000 7f6ab5004700 1 -- 172.21.15.133:0/468836828 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab00a9fb0 con 0x7f6a98003c40 2023-10-08T16:10:43.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.183+0000 7f6ab5004700 1 --2- 172.21.15.133:0/468836828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a98003c40 0x7f6ab00a9a70 secure :-1 s=READY pgs=4423 cs=0 l=1 rev1=1 crypto rx=0x7f6a9800c180 tx=0x7f6ab0142730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:43.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.183+0000 7f6aa57fa700 1 -- 172.21.15.133:0/468836828 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0012610 con 0x7f6a98003c40 2023-10-08T16:10:43.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.183+0000 7f6aa57fa700 1 -- 172.21.15.133:0/468836828 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6aa0012770 con 0x7f6a98003c40 2023-10-08T16:10:43.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.183+0000 7f6ab6006700 1 -- 172.21.15.133:0/468836828 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab006ea80 con 0x7f6a98003c40 2023-10-08T16:10:43.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.183+0000 7f6aa57fa700 1 -- 172.21.15.133:0/468836828 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0012b50 con 0x7f6a98003c40 2023-10-08T16:10:43.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.183+0000 7f6ab6006700 1 -- 172.21.15.133:0/468836828 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab0156850 con 0x7f6a98003c40 2023-10-08T16:10:43.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.183+0000 7f6ab6006700 1 -- 172.21.15.133:0/468836828 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab006a6b0 con 0x7f6a98003c40 2023-10-08T16:10:43.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.187+0000 7f6aa57fa700 1 -- 172.21.15.133:0/468836828 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6aa001a070 con 0x7f6a98003c40 2023-10-08T16:10:43.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.187+0000 7f6aa57fa700 1 --2- 172.21.15.133:0/468836828 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6a9c060550 0x7f6a9c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.187+0000 7f6aa57fa700 1 -- 172.21.15.133:0/468836828 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f6aa007e800 con 0x7f6a98003c40 2023-10-08T16:10:43.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.187+0000 7f6ab4803700 1 --2- 172.21.15.133:0/468836828 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6a9c060550 0x7f6a9c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.187+0000 7f6ab4803700 1 --2- 172.21.15.133:0/468836828 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6a9c060550 0x7f6a9c062a00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00b5270 tx=0x7f6aac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:43.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.195+0000 7f6aa57fa700 1 -- 172.21.15.133:0/468836828 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6ab006a6b0 con 0x7f6a98003c40 2023-10-08T16:10:43.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.359+0000 7f6ab6006700 1 -- 172.21.15.133:0/468836828 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ab006a6b0 con 0x7f6a98003c40 2023-10-08T16:10:43.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.359+0000 7f6aa57fa700 1 -- 172.21.15.133:0/468836828 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+15654 (secure 0 0 0) 0x7f6ab006a6b0 con 0x7f6a98003c40 2023-10-08T16:10:43.364 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-10-08T16:10:43.364 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":28,"fsid":"f2546191-d59e-4805-8e1b-3d8d3d1dad86","created":"2023-10-08T16:03:52.631855+0000","modified":"2023-10-08T16:08:57.686321+0000","last_up_change":"2023-10-08T16:04:04.030581+0000","last_in_change":"2023-10-08T16:03:54.835293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:04:04.898316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:04:14.869859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:04:15.983795+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":27,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8c5deadf-a203-4d30-aa7f-6e2e492b6ffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6809","nonce":33493},{"type":"v1","addr":"172.21.15.133:6811","nonce":33493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":33493},{"type":"v1","addr":"172.21.15.133:6815","nonce":33493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":33493},{"type":"v1","addr":"172.21.15.133:6822","nonce":33493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":33493},{"type":"v1","addr":"172.21.15.133:6818","nonce":33493}]},"public_addr":"172.21.15.133:6811/33493","cluster_addr":"172.21.15.133:6815/33493","heartbeat_back_addr":"172.21.15.133:6822/33493","heartbeat_front_addr":"172.21.15.133:6818/33493","state":["exists","up"]},{"osd":1,"uuid":"9b081c42-c915-48c3-a1ad-410f09a78576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":33490},{"type":"v1","addr":"172.21.15.133:6801","nonce":33490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":33490},{"type":"v1","addr":"172.21.15.133:6803","nonce":33490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":33490},{"type":"v1","addr":"172.21.15.133:6807","nonce":33490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":33490},{"type":"v1","addr":"172.21.15.133:6805","nonce":33490}]},"public_addr":"172.21.15.133:6801/33490","cluster_addr":"172.21.15.133:6803/33490","heartbeat_back_addr":"172.21.15.133:6807/33490","heartbeat_front_addr":"172.21.15.133:6805/33490","state":["exists","up"]},{"osd":2,"uuid":"88ecda43-01cd-4644-ab0c-92c91fd38966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":33492},{"type":"v1","addr":"172.21.15.133:6825","nonce":33492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":33492},{"type":"v1","addr":"172.21.15.133:6827","nonce":33492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":33492},{"type":"v1","addr":"172.21.15.133:6831","nonce":33492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":33492},{"type":"v1","addr":"172.21.15.133:6829","nonce":33492}]},"public_addr":"172.21.15.133:6825/33492","cluster_addr":"172.21.15.133:6827/33492","heartbeat_back_addr":"172.21.15.133:6831/33492","heartbeat_front_addr":"172.21.15.133:6829/33492","state":["exists","up"]},{"osd":3,"uuid":"39faf38d-b8e2-4e11-9b3b-84dc834c977c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":33491},{"type":"v1","addr":"172.21.15.133:6810","nonce":33491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":33491},{"type":"v1","addr":"172.21.15.133:6814","nonce":33491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6821","nonce":33491},{"type":"v1","addr":"172.21.15.133:6823","nonce":33491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":33491},{"type":"v1","addr":"172.21.15.133:6819","nonce":33491}]},"public_addr":"172.21.15.133:6810/33491","cluster_addr":"172.21.15.133:6814/33491","heartbeat_back_addr":"172.21.15.133:6823/33491","heartbeat_front_addr":"172.21.15.133:6819/33491","state":["exists","up"]},{"osd":4,"uuid":"4c097e61-1cad-4b61-9183-4e7bc486bd32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":33678},{"type":"v1","addr":"172.21.15.190:6810","nonce":33678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":33678},{"type":"v1","addr":"172.21.15.190:6814","nonce":33678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":33678},{"type":"v1","addr":"172.21.15.190:6822","nonce":33678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":33678},{"type":"v1","addr":"172.21.15.190:6818","nonce":33678}]},"public_addr":"172.21.15.190:6810/33678","cluster_addr":"172.21.15.190:6814/33678","heartbeat_back_addr":"172.21.15.190:6822/33678","heartbeat_front_addr":"172.21.15.190:6818/33678","state":["exists","up"]},{"osd":5,"uuid":"05f072e0-7bc0-40f0-8cb6-8e322c82d6d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":33676},{"type":"v1","addr":"172.21.15.190:6811","nonce":33676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":33676},{"type":"v1","addr":"172.21.15.190:6815","nonce":33676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":33676},{"type":"v1","addr":"172.21.15.190:6823","nonce":33676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":33676},{"type":"v1","addr":"172.21.15.190:6819","nonce":33676}]},"public_addr":"172.21.15.190:6811/33676","cluster_addr":"172.21.15.190:6815/33676","heartbeat_back_addr":"172.21.15.190:6823/33676","heartbeat_front_addr":"172.21.15.190:6819/33676","state":["exists","up"]},{"osd":6,"uuid":"1bcce8d7-14f3-442d-b135-68c7d66cdedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":33677},{"type":"v1","addr":"172.21.15.190:6801","nonce":33677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":33677},{"type":"v1","addr":"172.21.15.190:6803","nonce":33677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":33677},{"type":"v1","addr":"172.21.15.190:6807","nonce":33677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":33677},{"type":"v1","addr":"172.21.15.190:6805","nonce":33677}]},"public_addr":"172.21.15.190:6801/33677","cluster_addr":"172.21.15.190:6803/33677","heartbeat_back_addr":"172.21.15.190:6807/33677","heartbeat_front_addr":"172.21.15.190:6805/33677","state":["exists","up"]},{"osd":7,"uuid":"9157dbf7-2bf9-43d7-a89a-a8e3dae7514c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":33686},{"type":"v1","addr":"172.21.15.190:6825","nonce":33686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":33686},{"type":"v1","addr":"172.21.15.190:6827","nonce":33686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":33686},{"type":"v1","addr":"172.21.15.190:6831","nonce":33686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":33686},{"type":"v1","addr":"172.21.15.190:6829","nonce":33686}]},"public_addr":"172.21.15.190:6825/33686","cluster_addr":"172.21.15.190:6827/33686","heartbeat_back_addr":"172.21.15.190:6831/33686","heartbeat_front_addr":"172.21.15.190:6829/33686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.886742+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.199618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.871695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.115926+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.069650+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:03:59.841448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.132320+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:04:00.315132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":14,"length":6}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:10:43.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.363+0000 7f6ab6006700 1 -- 172.21.15.133:0/468836828 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6a9c060550 msgr2=0x7f6a9c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.363+0000 7f6ab6006700 1 --2- 172.21.15.133:0/468836828 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6a9c060550 0x7f6a9c062a00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00b5270 tx=0x7f6aac008040 comp rx=0 tx=0).stop 2023-10-08T16:10:43.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.363+0000 7f6ab6006700 1 -- 172.21.15.133:0/468836828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a98003c40 msgr2=0x7f6ab00a9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.363+0000 7f6ab6006700 1 --2- 172.21.15.133:0/468836828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a98003c40 0x7f6ab00a9a70 secure :-1 s=READY pgs=4423 cs=0 l=1 rev1=1 crypto rx=0x7f6a9800c180 tx=0x7f6ab0142730 comp rx=0 tx=0).stop 2023-10-08T16:10:43.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.363+0000 7f6ab6006700 1 -- 172.21.15.133:0/468836828 shutdown_connections 2023-10-08T16:10:43.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.363+0000 7f6ab6006700 1 --2- 172.21.15.133:0/468836828 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f6a9c060550 0x7f6a9c062a00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.363+0000 7f6ab6006700 1 --2- 172.21.15.133:0/468836828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ab0155e90 0x7f6ab0156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.363+0000 7f6ab6006700 1 --2- 172.21.15.133:0/468836828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ab006e310 0x7f6ab00aad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.363+0000 7f6ab6006700 1 --2- 172.21.15.133:0/468836828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a98003c40 0x7f6ab00a9a70 unknown :-1 s=CLOSED pgs=4423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.363+0000 7f6ab6006700 1 -- 172.21.15.133:0/468836828 >> 172.21.15.133:0/468836828 conn(0x7f6ab0067a60 msgr2=0x7f6ab0141c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:43.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.363+0000 7f6ab6006700 1 -- 172.21.15.133:0/468836828 shutdown_connections 2023-10-08T16:10:43.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.363+0000 7f6ab6006700 1 -- 172.21.15.133:0/468836828 wait complete. 2023-10-08T16:10:43.379 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T16:10:43.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.483+0000 7f50e40c2700 1 Processor -- start 2023-10-08T16:10:43.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.483+0000 7f50e40c2700 1 -- start start 2023-10-08T16:10:43.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.483+0000 7f50e40c2700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f50dc0ae190 0x7f50dc0b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.483+0000 7f50e40c2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50dc0afed0 con 0x7f50dc144260 2023-10-08T16:10:43.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.483+0000 7f50e40c2700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50dc06b730 con 0x7f50dc0ae560 2023-10-08T16:10:43.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.483+0000 7f50e40c2700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50dc0b0e20 con 0x7f50dc0ae190 2023-10-08T16:10:43.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.483+0000 7f50e265f700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f50dc144260 0x7f50dc06e280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55100/0 (socket says 172.21.15.133:55100) 2023-10-08T16:10:43.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.483+0000 7f50e265f700 1 -- 172.21.15.133:0/3687280431 learned_addr learned my addr 172.21.15.133:0/3687280431 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:10:43.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.483+0000 7f50e1e5e700 1 --2- 172.21.15.133:0/3687280431 >> v2:172.21.15.190:3300/0 conn(0x7f50dc0ae190 0x7f50dc0b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.483+0000 7f50e0e5c700 1 -- 172.21.15.133:0/3687280431 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1451211617 0 0) 0x7f50dc0afed0 con 0x7f50dc144260 2023-10-08T16:10:43.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.483+0000 7f50e0e5c700 1 -- 172.21.15.133:0/3687280431 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50c4003570 con 0x7f50dc144260 2023-10-08T16:10:43.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.483+0000 7f50e1e5e700 1 -- 172.21.15.133:0/3687280431 >> v1:172.21.15.190:6789/0 conn(0x7f50dc0ae560 legacy=0x7f50dc143b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.483+0000 7f50e1e5e700 1 -- 172.21.15.133:0/3687280431 >> v1:172.21.15.133:6789/0 conn(0x7f50dc144260 legacy=0x7f50dc06e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.483+0000 7f50e1e5e700 1 -- 172.21.15.133:0/3687280431 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50dc0af880 con 0x7f50dc0ae190 2023-10-08T16:10:43.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.483+0000 7f50e1e5e700 1 --2- 172.21.15.133:0/3687280431 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50dc0ae190 0x7f50dc0b08e0 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009e60 tx=0x7f50cc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=210594be66bade17 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:43.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.483+0000 7f50e0e5c700 1 -- 172.21.15.133:0/3687280431 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc00e070 con 0x7f50dc0ae190 2023-10-08T16:10:43.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.483+0000 7f50e0e5c700 1 -- 172.21.15.133:0/3687280431 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f50cc00bb60 con 0x7f50dc0ae190 2023-10-08T16:10:43.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.483+0000 7f50e0e5c700 1 -- 172.21.15.133:0/3687280431 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc012430 con 0x7f50dc0ae190 2023-10-08T16:10:43.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.483+0000 7f50e40c2700 1 -- 172.21.15.133:0/3687280431 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50dc0ae190 msgr2=0x7f50dc0b08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.487+0000 7f50e40c2700 1 --2- 172.21.15.133:0/3687280431 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50dc0ae190 0x7f50dc0b08e0 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009e60 tx=0x7f50cc009780 comp rx=0 tx=0).stop 2023-10-08T16:10:43.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.487+0000 7f50e40c2700 1 -- 172.21.15.133:0/3687280431 shutdown_connections 2023-10-08T16:10:43.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.487+0000 7f50e40c2700 1 --2- 172.21.15.133:0/3687280431 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50dc0ae190 0x7f50dc0b08e0 unknown :-1 s=CLOSED pgs=2264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.487+0000 7f50e40c2700 1 -- 172.21.15.133:0/3687280431 >> 172.21.15.133:0/3687280431 conn(0x7f50dc0b4ba0 msgr2=0x7f50dc0b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:43.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.487+0000 7f50e40c2700 1 -- 172.21.15.133:0/3687280431 shutdown_connections 2023-10-08T16:10:43.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.487+0000 7f50e40c2700 1 -- 172.21.15.133:0/3687280431 wait complete. 2023-10-08T16:10:43.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.487+0000 7f50e40c2700 1 Processor -- start 2023-10-08T16:10:43.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.487+0000 7f50e40c2700 1 -- start start 2023-10-08T16:10:43.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.487+0000 7f50e40c2700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50dc0ae190 0x7f50dc142a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.487+0000 7f50e40c2700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50dc0ae560 0x7f50dc153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.487+0000 7f50e40c2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50dc144260 0x7f50dc137e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.487+0000 7f50e40c2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc13ba90 con 0x7f50dc144260 2023-10-08T16:10:43.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.487+0000 7f50e40c2700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc140560 con 0x7f50dc0ae190 2023-10-08T16:10:43.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.487+0000 7f50e40c2700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc1400d0 con 0x7f50dc0ae560 2023-10-08T16:10:43.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.487+0000 7f50e265f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50dc144260 0x7f50dc137e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.487+0000 7f50e265f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50dc144260 0x7f50dc137e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34064/0 (socket says 172.21.15.133:34064) 2023-10-08T16:10:43.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.487+0000 7f50e265f700 1 -- 172.21.15.133:0/2242731877 learned_addr learned my addr 172.21.15.133:0/2242731877 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:10:43.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.487+0000 7f50e1e5e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50dc0ae190 0x7f50dc142a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.487+0000 7f50e165d700 1 --2- 172.21.15.133:0/2242731877 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50dc0ae560 0x7f50dc153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.487+0000 7f50e265f700 1 -- 172.21.15.133:0/2242731877 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50dc0ae560 msgr2=0x7f50dc153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.487+0000 7f50e265f700 1 --2- 172.21.15.133:0/2242731877 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50dc0ae560 0x7f50dc153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.487+0000 7f50e265f700 1 -- 172.21.15.133:0/2242731877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50dc0ae190 msgr2=0x7f50dc142a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.487+0000 7f50e265f700 1 --2- 172.21.15.133:0/2242731877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50dc0ae190 0x7f50dc142a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.487+0000 7f50e265f700 1 -- 172.21.15.133:0/2242731877 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc009a20 con 0x7f50dc144260 2023-10-08T16:10:43.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.487+0000 7f50e165d700 1 --2- 172.21.15.133:0/2242731877 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50dc0ae560 0x7f50dc153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:43.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.491+0000 7f50e265f700 1 --2- 172.21.15.133:0/2242731877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50dc144260 0x7f50dc137e70 secure :-1 s=READY pgs=4425 cs=0 l=1 rev1=1 crypto rx=0x7f50d400c7c0 tx=0x7f50d4007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:43.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.491+0000 7f50d9ffb700 1 -- 172.21.15.133:0/2242731877 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4005c00 con 0x7f50dc144260 2023-10-08T16:10:43.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.491+0000 7f50d9ffb700 1 -- 172.21.15.133:0/2242731877 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f50d4005d60 con 0x7f50dc144260 2023-10-08T16:10:43.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.491+0000 7f50d9ffb700 1 -- 172.21.15.133:0/2242731877 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4007300 con 0x7f50dc144260 2023-10-08T16:10:43.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.491+0000 7f50e40c2700 1 -- 172.21.15.133:0/2242731877 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50dc13fd80 con 0x7f50dc144260 2023-10-08T16:10:43.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.491+0000 7f50e40c2700 1 -- 172.21.15.133:0/2242731877 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50dc143610 con 0x7f50dc144260 2023-10-08T16:10:43.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.491+0000 7f50e40c2700 1 -- 172.21.15.133:0/2242731877 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50dc064810 con 0x7f50dc144260 2023-10-08T16:10:43.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.491+0000 7f50d9ffb700 1 -- 172.21.15.133:0/2242731877 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f50d401b3b0 con 0x7f50dc144260 2023-10-08T16:10:43.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.495+0000 7f50d9ffb700 1 --2- 172.21.15.133:0/2242731877 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f50c8060550 0x7f50c8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.495+0000 7f50d9ffb700 1 -- 172.21.15.133:0/2242731877 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f50d407bd50 con 0x7f50dc144260 2023-10-08T16:10:43.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.495+0000 7f50e1e5e700 1 --2- 172.21.15.133:0/2242731877 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f50c8060550 0x7f50c8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.495+0000 7f50e1e5e700 1 --2- 172.21.15.133:0/2242731877 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f50c8060550 0x7f50c8062a00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0099f0 tx=0x7f50cc009780 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:43.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.499+0000 7f50d9ffb700 1 -- 172.21.15.133:0/2242731877 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f50d407f030 con 0x7f50dc144260 2023-10-08T16:10:43.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.691+0000 7f50e40c2700 1 -- 172.21.15.133:0/2242731877 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f50dc140210 con 0x7f50dc144260 2023-10-08T16:10:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.707+0000 7f50d9ffb700 1 -- 172.21.15.133:0/2242731877 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7f50d4017090 con 0x7f50dc144260 2023-10-08T16:10:43.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.711+0000 7f50e40c2700 1 -- 172.21.15.133:0/2242731877 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f50c8060550 msgr2=0x7f50c8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.711+0000 7f50e40c2700 1 --2- 172.21.15.133:0/2242731877 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f50c8060550 0x7f50c8062a00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0099f0 tx=0x7f50cc009780 comp rx=0 tx=0).stop 2023-10-08T16:10:43.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.711+0000 7f50e40c2700 1 -- 172.21.15.133:0/2242731877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50dc144260 msgr2=0x7f50dc137e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.711+0000 7f50e40c2700 1 --2- 172.21.15.133:0/2242731877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50dc144260 0x7f50dc137e70 secure :-1 s=READY pgs=4425 cs=0 l=1 rev1=1 crypto rx=0x7f50d400c7c0 tx=0x7f50d4007d90 comp rx=0 tx=0).stop 2023-10-08T16:10:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.711+0000 7f50e40c2700 1 -- 172.21.15.133:0/2242731877 shutdown_connections 2023-10-08T16:10:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.711+0000 7f50e40c2700 1 --2- 172.21.15.133:0/2242731877 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f50c8060550 0x7f50c8062a00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.711+0000 7f50e40c2700 1 --2- 172.21.15.133:0/2242731877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50dc144260 0x7f50dc137e70 unknown :-1 s=CLOSED pgs=4425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.711+0000 7f50e40c2700 1 --2- 172.21.15.133:0/2242731877 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50dc0ae560 0x7f50dc153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.711+0000 7f50e40c2700 1 --2- 172.21.15.133:0/2242731877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50dc0ae190 0x7f50dc142a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.711+0000 7f50e40c2700 1 -- 172.21.15.133:0/2242731877 >> 172.21.15.133:0/2242731877 conn(0x7f50dc0b4ba0 msgr2=0x7f50dc06e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.711+0000 7f50e40c2700 1 -- 172.21.15.133:0/2242731877 shutdown_connections 2023-10-08T16:10:43.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.711+0000 7f50e40c2700 1 -- 172.21.15.133:0/2242731877 wait complete. 2023-10-08T16:10:43.717 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T16:10:43.727 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T16:10:43.746 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2023-10-08T16:10:43.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2439b05700 1 Processor -- start 2023-10-08T16:10:43.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2439b05700 1 -- start start 2023-10-08T16:10:43.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2439b05700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f24340b51a0 0x7f24340ade60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2439b05700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f24340ae3a0 0x7f24340b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2439b05700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24340b1800 0x7f24340b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2439b05700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24340b2170 con 0x7f24340ae3a0 2023-10-08T16:10:43.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2439b05700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24340ac5b0 con 0x7f24340b51a0 2023-10-08T16:10:43.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2439b05700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243406ade0 con 0x7f24340b1800 2023-10-08T16:10:43.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2433fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f24340ae3a0 0x7f24340b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2433fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f24340ae3a0 0x7f24340b12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34088/0 (socket says 172.21.15.133:34088) 2023-10-08T16:10:43.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2433fff700 1 -- 172.21.15.133:0/1750067515 learned_addr learned my addr 172.21.15.133:0/1750067515 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:10:43.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2438b03700 1 --2- 172.21.15.133:0/1750067515 >> v2:172.21.15.190:3300/0 conn(0x7f24340b51a0 0x7f24340ade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2439304700 1 --2- 172.21.15.133:0/1750067515 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24340b1800 0x7f24340b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2433fff700 1 -- 172.21.15.133:0/1750067515 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24340b1800 msgr2=0x7f24340b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:43.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2433fff700 1 --2- 172.21.15.133:0/1750067515 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24340b1800 0x7f24340b1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2433fff700 1 -- 172.21.15.133:0/1750067515 >> v2:172.21.15.190:3300/0 conn(0x7f24340b51a0 msgr2=0x7f24340ade60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:43.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2433fff700 1 --2- 172.21.15.133:0/1750067515 >> v2:172.21.15.190:3300/0 conn(0x7f24340b51a0 0x7f24340ade60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2433fff700 1 -- 172.21.15.133:0/1750067515 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24340ad460 con 0x7f24340ae3a0 2023-10-08T16:10:43.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2433fff700 1 --2- 172.21.15.133:0/1750067515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24340ae3a0 0x7f24340b12c0 secure :-1 s=READY pgs=4426 cs=0 l=1 rev1=1 crypto rx=0x7f24340b4920 tx=0x7f2420009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831881ba6f79ffc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:43.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f24337fe700 1 -- 172.21.15.133:0/1750067515 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242000b860 con 0x7f24340ae3a0 2023-10-08T16:10:43.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f24337fe700 1 -- 172.21.15.133:0/1750067515 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f242000b9c0 con 0x7f24340ae3a0 2023-10-08T16:10:43.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f24337fe700 1 -- 172.21.15.133:0/1750067515 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242000bd80 con 0x7f24340ae3a0 2023-10-08T16:10:43.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2439b05700 1 -- 172.21.15.133:0/1750067515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24340ae3a0 msgr2=0x7f24340b12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2439b05700 1 --2- 172.21.15.133:0/1750067515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24340ae3a0 0x7f24340b12c0 secure :-1 s=READY pgs=4426 cs=0 l=1 rev1=1 crypto rx=0x7f24340b4920 tx=0x7f2420009250 comp rx=0 tx=0).stop 2023-10-08T16:10:43.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2439b05700 1 -- 172.21.15.133:0/1750067515 shutdown_connections 2023-10-08T16:10:43.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2439b05700 1 --2- 172.21.15.133:0/1750067515 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24340b1800 0x7f24340b1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2439b05700 1 --2- 172.21.15.133:0/1750067515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24340ae3a0 0x7f24340b12c0 unknown :-1 s=CLOSED pgs=4426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2439b05700 1 --2- 172.21.15.133:0/1750067515 >> v2:172.21.15.190:3300/0 conn(0x7f24340b51a0 0x7f24340ade60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2439b05700 1 -- 172.21.15.133:0/1750067515 >> 172.21.15.133:0/1750067515 conn(0x7f2434068420 msgr2=0x7f2434070830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:43.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2439b05700 1 -- 172.21.15.133:0/1750067515 shutdown_connections 2023-10-08T16:10:43.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.831+0000 7f2439b05700 1 -- 172.21.15.133:0/1750067515 wait complete. 2023-10-08T16:10:43.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.835+0000 7f2439b05700 1 Processor -- start 2023-10-08T16:10:43.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.835+0000 7f2439b05700 1 -- start start 2023-10-08T16:10:43.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.835+0000 7f2439b05700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24340ae3a0 0x7f24340a8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.835+0000 7f2439b05700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24340b1800 0x7f2434125750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.835+0000 7f2439b05700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24340b51a0 0x7f2434126520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.835+0000 7f2439b05700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24340aabd0 con 0x7f24340ae3a0 2023-10-08T16:10:43.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.835+0000 7f2439b05700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24341252c0 con 0x7f24340b51a0 2023-10-08T16:10:43.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.835+0000 7f2439b05700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24341279e0 con 0x7f24340b1800 2023-10-08T16:10:43.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.835+0000 7f2438b03700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24340ae3a0 0x7f24340a8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.835+0000 7f2438b03700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24340ae3a0 0x7f24340a8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34098/0 (socket says 172.21.15.133:34098) 2023-10-08T16:10:43.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.835+0000 7f2438b03700 1 -- 172.21.15.133:0/2197789538 learned_addr learned my addr 172.21.15.133:0/2197789538 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:10:43.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.835+0000 7f2433fff700 1 --2- 172.21.15.133:0/2197789538 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24340b1800 0x7f2434125750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.835+0000 7f2439304700 1 --2- 172.21.15.133:0/2197789538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24340b51a0 0x7f2434126520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.835+0000 7f2438b03700 1 -- 172.21.15.133:0/2197789538 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24340b1800 msgr2=0x7f2434125750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.835+0000 7f2438b03700 1 --2- 172.21.15.133:0/2197789538 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24340b1800 0x7f2434125750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.835+0000 7f2438b03700 1 -- 172.21.15.133:0/2197789538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24340b51a0 msgr2=0x7f2434126520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.835+0000 7f2438b03700 1 --2- 172.21.15.133:0/2197789538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24340b51a0 0x7f2434126520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.835+0000 7f2438b03700 1 -- 172.21.15.133:0/2197789538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24200094f0 con 0x7f24340ae3a0 2023-10-08T16:10:43.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.835+0000 7f2438b03700 1 --2- 172.21.15.133:0/2197789538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24340ae3a0 0x7f24340a8b90 secure :-1 s=READY pgs=4427 cs=0 l=1 rev1=1 crypto rx=0x7f242800d890 tx=0x7f2428008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:43.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.835+0000 7f2430ff9700 1 -- 172.21.15.133:0/2197789538 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242800b600 con 0x7f24340ae3a0 2023-10-08T16:10:43.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.835+0000 7f2430ff9700 1 -- 172.21.15.133:0/2197789538 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f242800b760 con 0x7f24340ae3a0 2023-10-08T16:10:43.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.835+0000 7f2439b05700 1 -- 172.21.15.133:0/2197789538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2434127770 con 0x7f24340ae3a0 2023-10-08T16:10:43.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.835+0000 7f2430ff9700 1 -- 172.21.15.133:0/2197789538 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242800bb00 con 0x7f24340ae3a0 2023-10-08T16:10:43.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.835+0000 7f2439b05700 1 -- 172.21.15.133:0/2197789538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2434124f50 con 0x7f24340ae3a0 2023-10-08T16:10:43.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.835+0000 7f2439b05700 1 -- 172.21.15.133:0/2197789538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f243404be40 con 0x7f24340ae3a0 2023-10-08T16:10:43.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.839+0000 7f2430ff9700 1 -- 172.21.15.133:0/2197789538 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f242801e460 con 0x7f24340ae3a0 2023-10-08T16:10:43.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.839+0000 7f2430ff9700 1 --2- 172.21.15.133:0/2197789538 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f2418060550 0x7f2418062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.839+0000 7f2433fff700 1 --2- 172.21.15.133:0/2197789538 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f2418060550 0x7f2418062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.839+0000 7f2430ff9700 1 -- 172.21.15.133:0/2197789538 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5907+0+0 (secure 0 0 0) 0x7f242807cf40 con 0x7f24340ae3a0 2023-10-08T16:10:43.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.839+0000 7f2433fff700 1 --2- 172.21.15.133:0/2197789538 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f2418060550 0x7f2418062a00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f24340b4920 tx=0x7f2420009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:43.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:43.843+0000 7f2430ff9700 1 -- 172.21.15.133:0/2197789538 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f242804d440 con 0x7f24340ae3a0 2023-10-08T16:10:44.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.039+0000 7f2439b05700 1 -- 172.21.15.133:0/2197789538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f24340abf60 con 0x7f24340ae3a0 2023-10-08T16:10:44.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.731+0000 7f2430ff9700 1 -- 172.21.15.133:0/2197789538 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2428050a60 con 0x7f24340ae3a0 2023-10-08T16:10:44.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.735+0000 7f2439b05700 1 -- 172.21.15.133:0/2197789538 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f2418060550 msgr2=0x7f2418062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:44.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.735+0000 7f2439b05700 1 --2- 172.21.15.133:0/2197789538 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f2418060550 0x7f2418062a00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f24340b4920 tx=0x7f2420009250 comp rx=0 tx=0).stop 2023-10-08T16:10:44.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.735+0000 7f2439b05700 1 -- 172.21.15.133:0/2197789538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24340ae3a0 msgr2=0x7f24340a8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:44.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.735+0000 7f2439b05700 1 --2- 172.21.15.133:0/2197789538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24340ae3a0 0x7f24340a8b90 secure :-1 s=READY pgs=4427 cs=0 l=1 rev1=1 crypto rx=0x7f242800d890 tx=0x7f2428008040 comp rx=0 tx=0).stop 2023-10-08T16:10:44.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.739+0000 7f2439b05700 1 -- 172.21.15.133:0/2197789538 shutdown_connections 2023-10-08T16:10:44.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.739+0000 7f2439b05700 1 --2- 172.21.15.133:0/2197789538 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f2418060550 0x7f2418062a00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.739+0000 7f2439b05700 1 --2- 172.21.15.133:0/2197789538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24340b51a0 0x7f2434126520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.739+0000 7f2439b05700 1 --2- 172.21.15.133:0/2197789538 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24340b1800 0x7f2434125750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.739+0000 7f2439b05700 1 --2- 172.21.15.133:0/2197789538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24340ae3a0 0x7f24340a8b90 unknown :-1 s=CLOSED pgs=4427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.739+0000 7f2439b05700 1 -- 172.21.15.133:0/2197789538 >> 172.21.15.133:0/2197789538 conn(0x7f2434068420 msgr2=0x7f24340b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:44.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.739+0000 7f2439b05700 1 -- 172.21.15.133:0/2197789538 shutdown_connections 2023-10-08T16:10:44.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.739+0000 7f2439b05700 1 -- 172.21.15.133:0/2197789538 wait complete. 2023-10-08T16:10:44.758 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T16:10:44.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.919+0000 7efd855cb700 1 Processor -- start 2023-10-08T16:10:44.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.923+0000 7efd855cb700 1 -- start start 2023-10-08T16:10:44.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.923+0000 7efd855cb700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efd800b9680 0x7efd80145b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:44.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.923+0000 7efd855cb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efd800b0870 0x7efd8013c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:44.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.923+0000 7efd855cb700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd801460b0 con 0x7efd800b0cc0 2023-10-08T16:10:44.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.923+0000 7efd855cb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd800b1d70 con 0x7efd800b0870 2023-10-08T16:10:44.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.923+0000 7efd855cb700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd800b1b00 con 0x7efd800b9680 2023-10-08T16:10:44.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.923+0000 7efd77fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efd800b0870 0x7efd8013c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:44.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.923+0000 7efd77fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efd800b0870 0x7efd8013c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34110/0 (socket says 172.21.15.133:34110) 2023-10-08T16:10:44.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.923+0000 7efd77fff700 1 -- 172.21.15.133:0/3806245737 learned_addr learned my addr 172.21.15.133:0/3806245737 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:10:44.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.923+0000 7efd7effd700 1 --2- 172.21.15.133:0/3806245737 >> v2:172.21.15.190:3300/0 conn(0x7efd800b9680 0x7efd80145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:44.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.923+0000 7efd77fff700 1 -- 172.21.15.133:0/3806245737 >> v2:172.21.15.190:3300/0 conn(0x7efd800b9680 msgr2=0x7efd80145b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:44.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.923+0000 7efd77fff700 1 --2- 172.21.15.133:0/3806245737 >> v2:172.21.15.190:3300/0 conn(0x7efd800b9680 0x7efd80145b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.923+0000 7efd77fff700 1 -- 172.21.15.133:0/3806245737 >> v1:172.21.15.190:6789/0 conn(0x7efd800b0cc0 legacy=0x7efd8013c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:44.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.923+0000 7efd7e7fc700 1 -- 172.21.15.133:0/3806245737 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2982516513 0 0) 0x7efd801460b0 con 0x7efd800b0cc0 2023-10-08T16:10:44.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.923+0000 7efd77fff700 1 -- 172.21.15.133:0/3806245737 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd800b2610 con 0x7efd800b0870 2023-10-08T16:10:44.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.923+0000 7efd77fff700 1 --2- 172.21.15.133:0/3806245737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd800b0870 0x7efd8013c2e0 secure :-1 s=READY pgs=4428 cs=0 l=1 rev1=1 crypto rx=0x7efd800b9d70 tx=0x7efd68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc3f50f970d6c61 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:44.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.923+0000 7efd7e7fc700 1 -- 172.21.15.133:0/3806245737 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68009e70 con 0x7efd800b0870 2023-10-08T16:10:44.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.923+0000 7efd7e7fc700 1 -- 172.21.15.133:0/3806245737 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efd6800b860 con 0x7efd800b0870 2023-10-08T16:10:44.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.923+0000 7efd7e7fc700 1 -- 172.21.15.133:0/3806245737 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6800bc40 con 0x7efd800b0870 2023-10-08T16:10:44.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.923+0000 7efd855cb700 1 -- 172.21.15.133:0/3806245737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd800b0870 msgr2=0x7efd8013c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:44.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.923+0000 7efd855cb700 1 --2- 172.21.15.133:0/3806245737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd800b0870 0x7efd8013c2e0 secure :-1 s=READY pgs=4428 cs=0 l=1 rev1=1 crypto rx=0x7efd800b9d70 tx=0x7efd68009250 comp rx=0 tx=0).stop 2023-10-08T16:10:44.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.923+0000 7efd855cb700 1 -- 172.21.15.133:0/3806245737 shutdown_connections 2023-10-08T16:10:44.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.923+0000 7efd855cb700 1 --2- 172.21.15.133:0/3806245737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd800b0870 0x7efd8013c2e0 unknown :-1 s=CLOSED pgs=4428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.923+0000 7efd855cb700 1 --2- 172.21.15.133:0/3806245737 >> v2:172.21.15.190:3300/0 conn(0x7efd800b9680 0x7efd80145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.923+0000 7efd855cb700 1 -- 172.21.15.133:0/3806245737 >> 172.21.15.133:0/3806245737 conn(0x7efd80067df0 msgr2=0x7efd800681f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:44.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.927+0000 7efd855cb700 1 -- 172.21.15.133:0/3806245737 shutdown_connections 2023-10-08T16:10:44.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.927+0000 7efd855cb700 1 -- 172.21.15.133:0/3806245737 wait complete. 2023-10-08T16:10:44.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.927+0000 7efd855cb700 1 Processor -- start 2023-10-08T16:10:44.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.927+0000 7efd855cb700 1 -- start start 2023-10-08T16:10:44.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.927+0000 7efd855cb700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd800b0870 0x7efd80142eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:44.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.927+0000 7efd855cb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd800b0cc0 0x7efd80141e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:44.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.927+0000 7efd855cb700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd800b9680 0x7efd80143970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:44.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.927+0000 7efd855cb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd80155770 con 0x7efd800b0cc0 2023-10-08T16:10:44.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.927+0000 7efd855cb700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8013d1b0 con 0x7efd800b9680 2023-10-08T16:10:44.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.927+0000 7efd855cb700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd80155980 con 0x7efd800b0870 2023-10-08T16:10:44.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.927+0000 7efd77fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd800b0cc0 0x7efd80141e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:44.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.927+0000 7efd77fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd800b0cc0 0x7efd80141e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34126/0 (socket says 172.21.15.133:34126) 2023-10-08T16:10:44.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.927+0000 7efd77fff700 1 -- 172.21.15.133:0/2560961738 learned_addr learned my addr 172.21.15.133:0/2560961738 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:10:44.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.927+0000 7efd7effd700 1 --2- 172.21.15.133:0/2560961738 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd800b0870 0x7efd80142eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:44.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.927+0000 7efd7f7fe700 1 --2- 172.21.15.133:0/2560961738 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd800b9680 0x7efd80143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:44.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.927+0000 7efd77fff700 1 -- 172.21.15.133:0/2560961738 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd800b0870 msgr2=0x7efd80142eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:44.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.927+0000 7efd77fff700 1 --2- 172.21.15.133:0/2560961738 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd800b0870 0x7efd80142eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.927+0000 7efd77fff700 1 -- 172.21.15.133:0/2560961738 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd800b9680 msgr2=0x7efd80143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:44.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.927+0000 7efd77fff700 1 --2- 172.21.15.133:0/2560961738 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd800b9680 0x7efd80143970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.927+0000 7efd77fff700 1 -- 172.21.15.133:0/2560961738 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd680094f0 con 0x7efd800b0cc0 2023-10-08T16:10:44.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.927+0000 7efd77fff700 1 --2- 172.21.15.133:0/2560961738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd800b0cc0 0x7efd80141e50 secure :-1 s=READY pgs=4429 cs=0 l=1 rev1=1 crypto rx=0x7efd680090b0 tx=0x7efd68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:44.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.927+0000 7efd76ffd700 1 -- 172.21.15.133:0/2560961738 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6801aca0 con 0x7efd800b0cc0 2023-10-08T16:10:44.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.927+0000 7efd76ffd700 1 -- 172.21.15.133:0/2560961738 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efd6801ae00 con 0x7efd800b0cc0 2023-10-08T16:10:44.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.931+0000 7efd855cb700 1 -- 172.21.15.133:0/2560961738 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd80155c60 con 0x7efd800b0cc0 2023-10-08T16:10:44.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.931+0000 7efd76ffd700 1 -- 172.21.15.133:0/2560961738 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd680266c0 con 0x7efd800b0cc0 2023-10-08T16:10:44.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.931+0000 7efd855cb700 1 -- 172.21.15.133:0/2560961738 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd80156460 con 0x7efd800b0cc0 2023-10-08T16:10:44.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.931+0000 7efd855cb700 1 -- 172.21.15.133:0/2560961738 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd80064810 con 0x7efd800b0cc0 2023-10-08T16:10:44.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.931+0000 7efd76ffd700 1 -- 172.21.15.133:0/2560961738 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7efd68026af0 con 0x7efd800b0cc0 2023-10-08T16:10:44.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.931+0000 7efd76ffd700 1 --2- 172.21.15.133:0/2560961738 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7efd60060550 0x7efd60062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:44.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.931+0000 7efd7effd700 1 --2- 172.21.15.133:0/2560961738 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7efd60060550 0x7efd60062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:44.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.931+0000 7efd76ffd700 1 -- 172.21.15.133:0/2560961738 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5907+0+0 (secure 0 0 0) 0x7efd6807e160 con 0x7efd800b0cc0 2023-10-08T16:10:44.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.931+0000 7efd7effd700 1 --2- 172.21.15.133:0/2560961738 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7efd60060550 0x7efd60062a00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efd70009d40 tx=0x7efd70008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:44.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:44.939+0000 7efd76ffd700 1 -- 172.21.15.133:0/2560961738 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efd6804e7e0 con 0x7efd800b0cc0 2023-10-08T16:10:45.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.103+0000 7efd855cb700 1 -- 172.21.15.133:0/2560961738 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efd800b76a0 con 0x7efd800b0cc0 2023-10-08T16:10:45.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.743+0000 7efd76ffd700 1 -- 172.21.15.133:0/2560961738 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) v1 ==== 181+0+0 (secure 0 0 0) 0x7efd68051e00 con 0x7efd800b0cc0 2023-10-08T16:10:45.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.751+0000 7efd855cb700 1 -- 172.21.15.133:0/2560961738 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7efd60060550 msgr2=0x7efd60062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:45.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.751+0000 7efd855cb700 1 --2- 172.21.15.133:0/2560961738 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7efd60060550 0x7efd60062a00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efd70009d40 tx=0x7efd70008040 comp rx=0 tx=0).stop 2023-10-08T16:10:45.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.751+0000 7efd855cb700 1 -- 172.21.15.133:0/2560961738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd800b0cc0 msgr2=0x7efd80141e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:45.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.751+0000 7efd855cb700 1 --2- 172.21.15.133:0/2560961738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd800b0cc0 0x7efd80141e50 secure :-1 s=READY pgs=4429 cs=0 l=1 rev1=1 crypto rx=0x7efd680090b0 tx=0x7efd68009250 comp rx=0 tx=0).stop 2023-10-08T16:10:45.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.751+0000 7efd855cb700 1 -- 172.21.15.133:0/2560961738 shutdown_connections 2023-10-08T16:10:45.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.751+0000 7efd855cb700 1 --2- 172.21.15.133:0/2560961738 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7efd60060550 0x7efd60062a00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.751+0000 7efd855cb700 1 --2- 172.21.15.133:0/2560961738 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd800b9680 0x7efd80143970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.751+0000 7efd855cb700 1 --2- 172.21.15.133:0/2560961738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd800b0cc0 0x7efd80141e50 unknown :-1 s=CLOSED pgs=4429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.751+0000 7efd855cb700 1 --2- 172.21.15.133:0/2560961738 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd800b0870 0x7efd80142eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.751+0000 7efd855cb700 1 -- 172.21.15.133:0/2560961738 >> 172.21.15.133:0/2560961738 conn(0x7efd80067df0 msgr2=0x7efd80062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:45.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.751+0000 7efd855cb700 1 -- 172.21.15.133:0/2560961738 shutdown_connections 2023-10-08T16:10:45.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.751+0000 7efd855cb700 1 -- 172.21.15.133:0/2560961738 wait complete. 2023-10-08T16:10:45.759 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2023-10-08T16:10:45.772 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T16:10:45.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.867+0000 7f5ff93c4700 1 Processor -- start 2023-10-08T16:10:45.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.867+0000 7f5ff93c4700 1 -- start start 2023-10-08T16:10:45.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.867+0000 7f5ff93c4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5ff406e610 0x7f5ff40ac430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:45.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.867+0000 7f5ff93c4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff40ad750 con 0x7f5ff40b5130 2023-10-08T16:10:45.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.867+0000 7f5ff93c4700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff40ad100 con 0x7f5ff413fb40 2023-10-08T16:10:45.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.867+0000 7f5ff93c4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff40ac970 con 0x7f5ff406e610 2023-10-08T16:10:45.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.867+0000 7f5ff37fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5ff406e610 0x7f5ff40ac430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:45.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.867+0000 7f5ff2ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5ff40b5130 0x7f5ff413f430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55110/0 (socket says 172.21.15.133:55110) 2023-10-08T16:10:45.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.867+0000 7f5ff37fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5ff406e610 0x7f5ff40ac430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34140/0 (socket says 172.21.15.133:34140) 2023-10-08T16:10:45.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.867+0000 7f5ff2ffd700 1 -- 172.21.15.133:0/265391556 learned_addr learned my addr 172.21.15.133:0/265391556 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-10-08T16:10:45.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.867+0000 7f5ff37fe700 1 -- 172.21.15.133:0/265391556 >> v1:172.21.15.190:6789/0 conn(0x7f5ff413fb40 legacy=0x7f5ff406df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:45.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.867+0000 7f5ff37fe700 1 -- 172.21.15.133:0/265391556 >> v1:172.21.15.133:6789/0 conn(0x7f5ff40b5130 legacy=0x7f5ff413f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:45.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.867+0000 7f5ff37fe700 1 -- 172.21.15.133:0/265391556 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff40ad3e0 con 0x7f5ff406e610 2023-10-08T16:10:45.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.867+0000 7f5ff37fe700 1 --2- 172.21.15.133:0/265391556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ff406e610 0x7f5ff40ac430 secure :-1 s=READY pgs=4431 cs=0 l=1 rev1=1 crypto rx=0x7f5fe40098e0 tx=0x7f5fe40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86201fb935872b99 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:45.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.867+0000 7f5ff1ffb700 1 -- 172.21.15.133:0/265391556 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4009e80 con 0x7f5ff406e610 2023-10-08T16:10:45.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.867+0000 7f5ff1ffb700 1 -- 172.21.15.133:0/265391556 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5fe400b820 con 0x7f5ff406e610 2023-10-08T16:10:45.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.867+0000 7f5ff1ffb700 1 -- 172.21.15.133:0/265391556 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe400bbc0 con 0x7f5ff406e610 2023-10-08T16:10:45.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.867+0000 7f5ff93c4700 1 -- 172.21.15.133:0/265391556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ff406e610 msgr2=0x7f5ff40ac430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:45.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.867+0000 7f5ff93c4700 1 --2- 172.21.15.133:0/265391556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ff406e610 0x7f5ff40ac430 secure :-1 s=READY pgs=4431 cs=0 l=1 rev1=1 crypto rx=0x7f5fe40098e0 tx=0x7f5fe40091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5ff93c4700 1 -- 172.21.15.133:0/265391556 shutdown_connections 2023-10-08T16:10:45.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5ff93c4700 1 --2- 172.21.15.133:0/265391556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ff406e610 0x7f5ff40ac430 unknown :-1 s=CLOSED pgs=4431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5ff93c4700 1 -- 172.21.15.133:0/265391556 >> 172.21.15.133:0/265391556 conn(0x7f5ff4067e60 msgr2=0x7f5ff4068260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:45.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5ff93c4700 1 -- 172.21.15.133:0/265391556 shutdown_connections 2023-10-08T16:10:45.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5ff93c4700 1 -- 172.21.15.133:0/265391556 wait complete. 2023-10-08T16:10:45.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5ff93c4700 1 Processor -- start 2023-10-08T16:10:45.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5ff93c4700 1 -- start start 2023-10-08T16:10:45.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5ff93c4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ff406e610 0x7f5ff40af700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:45.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5ff93c4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ff40b5130 0x7f5ff4153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:45.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5ff93c4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ff413fb40 0x7f5ff4153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:45.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5ff93c4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff406c1a0 con 0x7f5ff40b5130 2023-10-08T16:10:45.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5ff93c4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff406b000 con 0x7f5ff413fb40 2023-10-08T16:10:45.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5ff93c4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff406b450 con 0x7f5ff406e610 2023-10-08T16:10:45.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5ff27fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ff40b5130 0x7f5ff4153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:45.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5ff27fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ff40b5130 0x7f5ff4153500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34154/0 (socket says 172.21.15.133:34154) 2023-10-08T16:10:45.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5ff27fc700 1 -- 172.21.15.133:0/1707173543 learned_addr learned my addr 172.21.15.133:0/1707173543 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-10-08T16:10:45.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5ff2ffd700 1 --2- 172.21.15.133:0/1707173543 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ff406e610 0x7f5ff40af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:45.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5ff37fe700 1 --2- 172.21.15.133:0/1707173543 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ff413fb40 0x7f5ff4153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:45.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5ff27fc700 1 -- 172.21.15.133:0/1707173543 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ff406e610 msgr2=0x7f5ff40af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:45.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5ff27fc700 1 --2- 172.21.15.133:0/1707173543 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ff406e610 0x7f5ff40af700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5ff27fc700 1 -- 172.21.15.133:0/1707173543 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ff413fb40 msgr2=0x7f5ff4153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:45.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5ff27fc700 1 --2- 172.21.15.133:0/1707173543 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ff413fb40 0x7f5ff4153a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:45.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5ff27fc700 1 -- 172.21.15.133:0/1707173543 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe4009420 con 0x7f5ff40b5130 2023-10-08T16:10:45.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5ff27fc700 1 --2- 172.21.15.133:0/1707173543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ff40b5130 0x7f5ff4153500 secure :-1 s=READY pgs=4432 cs=0 l=1 rev1=1 crypto rx=0x7f5fe800c5c0 tx=0x7f5fe8007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:45.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5fdaffd700 1 -- 172.21.15.133:0/1707173543 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8011590 con 0x7f5ff40b5130 2023-10-08T16:10:45.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5fdaffd700 1 -- 172.21.15.133:0/1707173543 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5fe80116f0 con 0x7f5ff40b5130 2023-10-08T16:10:45.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5fdaffd700 1 -- 172.21.15.133:0/1707173543 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8011ad0 con 0x7f5ff40b5130 2023-10-08T16:10:45.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5ff93c4700 1 -- 172.21.15.133:0/1707173543 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff406c410 con 0x7f5ff40b5130 2023-10-08T16:10:45.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.871+0000 7f5ff93c4700 1 -- 172.21.15.133:0/1707173543 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff413c420 con 0x7f5ff40b5130 2023-10-08T16:10:45.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.875+0000 7f5ff93c4700 1 -- 172.21.15.133:0/1707173543 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff406b170 con 0x7f5ff40b5130 2023-10-08T16:10:45.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.875+0000 7f5fdaffd700 1 -- 172.21.15.133:0/1707173543 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5fe801c460 con 0x7f5ff40b5130 2023-10-08T16:10:45.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.875+0000 7f5fdaffd700 1 --2- 172.21.15.133:0/1707173543 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5fe0060550 0x7f5fe0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:45.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.875+0000 7f5fdaffd700 1 -- 172.21.15.133:0/1707173543 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5469+0+0 (secure 0 0 0) 0x7f5fe807c470 con 0x7f5ff40b5130 2023-10-08T16:10:45.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.875+0000 7f5ff2ffd700 1 --2- 172.21.15.133:0/1707173543 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5fe0060550 0x7f5fe0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:45.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.875+0000 7f5ff2ffd700 1 --2- 172.21.15.133:0/1707173543 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5fe0060550 0x7f5fe0062a00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5ff413ce00 tx=0x7f5fec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:45.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:45.883+0000 7f5fdaffd700 1 -- 172.21.15.133:0/1707173543 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5ff406b170 con 0x7f5ff40b5130 2023-10-08T16:10:46.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:46.047+0000 7f5ff93c4700 1 -- 172.21.15.133:0/1707173543 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5ff406b170 con 0x7f5ff40b5130 2023-10-08T16:10:46.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:46.759+0000 7f5fdaffd700 1 -- 172.21.15.133:0/1707173543 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5ff406b170 con 0x7f5ff40b5130 2023-10-08T16:10:46.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:46.767+0000 7f5ff93c4700 1 -- 172.21.15.133:0/1707173543 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5fe0060550 msgr2=0x7f5fe0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:46.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:46.767+0000 7f5ff93c4700 1 --2- 172.21.15.133:0/1707173543 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5fe0060550 0x7f5fe0062a00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5ff413ce00 tx=0x7f5fec009040 comp rx=0 tx=0).stop 2023-10-08T16:10:46.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:46.767+0000 7f5ff93c4700 1 -- 172.21.15.133:0/1707173543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ff40b5130 msgr2=0x7f5ff4153500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:46.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:46.767+0000 7f5ff93c4700 1 --2- 172.21.15.133:0/1707173543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ff40b5130 0x7f5ff4153500 secure :-1 s=READY pgs=4432 cs=0 l=1 rev1=1 crypto rx=0x7f5fe800c5c0 tx=0x7f5fe8007f30 comp rx=0 tx=0).stop 2023-10-08T16:10:46.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:46.767+0000 7f5ff93c4700 1 -- 172.21.15.133:0/1707173543 shutdown_connections 2023-10-08T16:10:46.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:46.767+0000 7f5ff93c4700 1 --2- 172.21.15.133:0/1707173543 >> [v2:172.21.15.133:6832/33362,v1:172.21.15.133:6833/33362] conn(0x7f5fe0060550 0x7f5fe0062a00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:46.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:46.767+0000 7f5ff93c4700 1 --2- 172.21.15.133:0/1707173543 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ff413fb40 0x7f5ff4153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:46.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:46.767+0000 7f5ff93c4700 1 --2- 172.21.15.133:0/1707173543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ff40b5130 0x7f5ff4153500 unknown :-1 s=CLOSED pgs=4432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:46.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:46.767+0000 7f5ff93c4700 1 --2- 172.21.15.133:0/1707173543 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ff406e610 0x7f5ff40af700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:46.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:46.767+0000 7f5ff93c4700 1 -- 172.21.15.133:0/1707173543 >> 172.21.15.133:0/1707173543 conn(0x7f5ff4067e60 msgr2=0x7f5ff4063160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:46.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:46.767+0000 7f5ff93c4700 1 -- 172.21.15.133:0/1707173543 shutdown_connections 2023-10-08T16:10:46.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-10-08T16:10:46.767+0000 7f5ff93c4700 1 -- 172.21.15.133:0/1707173543 wait complete. 2023-10-08T16:10:46.776 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2023-10-08T16:10:46.788 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-08T16:10:46.789 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T16:10:46.789 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:10:46.800 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T16:10:46.800 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T16:10:46.800 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:10:46.812 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T16:10:46.812 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-08T16:10:46.812 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-08T16:10:46.813 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:10:46.888 INFO:tasks.ceph.osd.0:Stopped 2023-10-08T16:10:46.888 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-08T16:10:46.888 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:10:46.968 INFO:tasks.ceph.osd.1:Stopped 2023-10-08T16:10:46.968 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-08T16:10:46.968 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:10:47.040 INFO:tasks.ceph.osd.2:Stopped 2023-10-08T16:10:47.040 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-08T16:10:47.040 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:10:47.120 INFO:tasks.ceph.osd.3:Stopped 2023-10-08T16:10:47.121 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-08T16:10:47.121 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:10:47.199 INFO:tasks.ceph.osd.4:Stopped 2023-10-08T16:10:47.199 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-08T16:10:47.199 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:10:47.271 INFO:tasks.ceph.osd.5:Stopped 2023-10-08T16:10:47.272 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-08T16:10:47.272 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:10:47.342 INFO:tasks.ceph.osd.6:Stopped 2023-10-08T16:10:47.343 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-08T16:10:47.343 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:10:48.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-10-08T16:10:50.016 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:10:50.018 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:10:53.444 INFO:tasks.ceph.osd.7:Stopped 2023-10-08T16:10:53.445 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-08T16:10:53.445 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-08T16:10:53.445 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:10:53.476 INFO:tasks.ceph.mgr.y:Stopped 2023-10-08T16:10:53.476 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-08T16:10:53.476 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:10:53.505 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~6s 2023-10-08T16:10:53.505 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2023-10-08T16:10:53.506 INFO:tasks.ceph.mgr.x:Stopped 2023-10-08T16:10:53.506 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-08T16:10:53.506 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-08T16:10:53.506 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:10:53.537 INFO:tasks.ceph.mon.a:Stopped 2023-10-08T16:10:53.537 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-08T16:10:53.537 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:10:53.555 INFO:tasks.ceph.mon.b:Stopped 2023-10-08T16:10:53.556 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-08T16:10:53.556 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:10:53.570 INFO:tasks.ceph.mon.c:Stopped 2023-10-08T16:10:53.570 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-08T16:10:53.570 DEBUG:teuthology.orchestra.run.smithi133:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-08T16:10:53.592 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi133.front.sepia.ceph.com 2023-10-08T16:10:53.593 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-08T16:10:53.920 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi133.front.sepia.ceph.com 2023-10-08T16:10:53.921 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-08T16:10:54.134 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi133.front.sepia.ceph.com 2023-10-08T16:10:54.134 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-08T16:10:54.307 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi133.front.sepia.ceph.com 2023-10-08T16:10:54.307 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-08T16:10:54.484 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi190.front.sepia.ceph.com 2023-10-08T16:10:54.485 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-08T16:10:54.804 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi190.front.sepia.ceph.com 2023-10-08T16:10:54.804 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-08T16:10:55.006 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi190.front.sepia.ceph.com 2023-10-08T16:10:55.007 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-08T16:10:55.197 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi190.front.sepia.ceph.com 2023-10-08T16:10:55.198 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-08T16:10:55.371 INFO:tasks.ceph:Archiving mon data... 2023-10-08T16:10:55.373 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418300/data/mon.a.tgz 2023-10-08T16:10:55.373 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2023-10-08T16:10:55.380 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.maqvsgneeb 2023-10-08T16:10:55.380 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.maqvsgneeb 2023-10-08T16:10:55.505 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.maqvsgneeb 2023-10-08T16:10:55.527 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.maqvsgneeb is 313KB 2023-10-08T16:10:55.588 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.maqvsgneeb 2023-10-08T16:10:55.594 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418300/data/mon.b.tgz 2023-10-08T16:10:55.595 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2023-10-08T16:10:55.601 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.DLLpBot5aQ 2023-10-08T16:10:55.602 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.DLLpBot5aQ 2023-10-08T16:10:55.748 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.DLLpBot5aQ 2023-10-08T16:10:55.772 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.DLLpBot5aQ is 417KB 2023-10-08T16:10:55.834 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.DLLpBot5aQ 2023-10-08T16:10:55.840 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418300/data/mon.c.tgz 2023-10-08T16:10:55.841 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2023-10-08T16:10:55.847 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.8HN1zqNjnp 2023-10-08T16:10:55.847 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.8HN1zqNjnp 2023-10-08T16:10:55.948 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.8HN1zqNjnp 2023-10-08T16:10:56.019 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.8HN1zqNjnp is 417KB 2023-10-08T16:10:56.082 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.8HN1zqNjnp 2023-10-08T16:10:56.089 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-08T16:10:56.089 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-08T16:10:56.092 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-08T16:10:56.106 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-08T16:10:56.106 DEBUG:teuthology.orchestra.run.smithi133:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-08T16:10:56.109 DEBUG:teuthology.orchestra.run.smithi190:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-08T16:10:56.135 INFO:teuthology.orchestra.run.smithi133.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-08T16:10:56.139 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-08T16:10:56.145 INFO:tasks.ceph:Archiving crash dumps... 2023-10-08T16:10:56.147 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418300/remote/smithi133/crash 2023-10-08T16:10:56.148 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-08T16:10:56.198 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418300/remote/smithi190/crash 2023-10-08T16:10:56.200 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-08T16:10:56.217 INFO:tasks.ceph:Shutting down logrotate 2023-10-08T16:10:56.217 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:10:56.220 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:10:56.267 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-08T16:10:56.281 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-08T16:10:56.296 INFO:tasks.ceph:Compressing logs... 2023-10-08T16:10:56.297 DEBUG:teuthology.orchestra.run.smithi133:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T16:10:56.327 DEBUG:teuthology.orchestra.run.smithi190:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T16:10:56.351 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40288.log 2023-10-08T16:10:56.352 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40261.log 2023-10-08T16:10:56.352 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81447.log 2023-10-08T16:10:56.354 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81526.log 2023-10-08T16:10:56.354 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40261.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40288.log.gz 2023-10-08T16:10:56.354 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39721.log 2023-10-08T16:10:56.354 INFO:teuthology.orchestra.run.smithi133.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.81447.log.gz 2023-10-08T16:10:56.354 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40261.log.gz 2023-10-08T16:10:56.355 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-08T16:10:56.356 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40884.log 2023-10-08T16:10:56.356 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.39721.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.81526.log.gz 2023-10-08T16:10:56.357 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39850.log 2023-10-08T16:10:56.357 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39721.log.gz 2023-10-08T16:10:56.357 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81361.log 2023-10-08T16:10:56.357 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40884.log: /var/log/ceph/ceph-client.admin.39850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40065.log 2023-10-08T16:10:56.360 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39850.log.gz 2023-10-08T16:10:56.360 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81333.log 2023-10-08T16:10:56.361 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40720.log 2023-10-08T16:10:56.361 INFO:teuthology.orchestra.run.smithi133.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.40884.log.gz 2023-10-08T16:10:56.361 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40065.log: /var/log/ceph/ceph-client.admin.81333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39848.log 2023-10-08T16:10:56.362 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81361.log.gz 2023-10-08T16:10:56.362 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40720.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.81333.log.gz 2023-10-08T16:10:56.362 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40065.log.gz 2023-10-08T16:10:56.363 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81007.log 2023-10-08T16:10:56.363 INFO:teuthology.orchestra.run.smithi133.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40720.log.gz 2023-10-08T16:10:56.363 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40477.log 2023-10-08T16:10:56.368 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39848.log.gz 2023-10-08T16:10:56.368 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81472.log 2023-10-08T16:10:56.368 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40477.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.81007.log.gz 2023-10-08T16:10:56.368 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40477.log.gz 2023-10-08T16:10:56.368 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81580.log 2023-10-08T16:10:56.369 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39226.log 2023-10-08T16:10:56.369 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81472.log: /var/log/ceph/ceph-client.admin.81580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39611.log 2023-10-08T16:10:56.369 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81472.log.gz 2023-10-08T16:10:56.369 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-08T16:10:56.369 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39226.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.81580.log.gz 2023-10-08T16:10:56.369 INFO:teuthology.orchestra.run.smithi133.stderr:gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39226.log.gz 2023-10-08T16:10:56.369 INFO:teuthology.orchestra.run.smithi133.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.40286.log 2023-10-08T16:10:56.370 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39464.log 2023-10-08T16:10:56.370 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mds.a.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39611.log.gz 2023-10-08T16:10:56.370 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40286.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40286.log.gz 2023-10-08T16:10:56.370 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80678.log 2023-10-08T16:10:56.370 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39640.log 2023-10-08T16:10:56.370 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39381.log 2023-10-08T16:10:56.371 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.80678.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39464.log.gz 2023-10-08T16:10:56.371 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81115.log 2023-10-08T16:10:56.371 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.80678.log.gz 2023-10-08T16:10:56.371 INFO:teuthology.orchestra.run.smithi133.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39640.log.gz 2023-10-08T16:10:56.371 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39381.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39381.log.gz 2023-10-08T16:10:56.376 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33450.log 2023-10-08T16:10:56.376 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-08T16:10:56.377 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.33450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33558.log 2023-10-08T16:10:56.377 INFO:teuthology.orchestra.run.smithi190.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33450.log.gz 2023-10-08T16:10:56.377 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-08T16:10:56.377 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33530.log 2023-10-08T16:10:56.377 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.33558.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-08T16:10:56.377 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-osd.5.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33558.log.gz 2023-10-08T16:10:56.377 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.33530.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-08T16:10:56.378 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- 87.4%/var/log/ceph/ceph.audit.log -- replaced with /var/log/ceph/ceph-client.admin.33530.log.gz 2023-10-08T16:10:56.378 INFO:teuthology.orchestra.run.smithi190.stderr: 2023-10-08T16:10:56.378 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-08T16:10:56.378 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33475.log 2023-10-08T16:10:56.380 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-osd.6.log: 93.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-08T16:10:56.380 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-08T16:10:56.392 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33636.log 2023-10-08T16:10:56.392 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.33475.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-08T16:10:56.392 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mds.b.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33475.log.gz 2023-10-08T16:10:56.392 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.33636.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33636.log.gz 2023-10-08T16:10:56.393 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-08T16:10:56.393 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph.log: 93.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-08T16:10:56.393 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33503.log 2023-10-08T16:10:56.393 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33611.log 2023-10-08T16:10:56.393 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.33503.log: 94.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-08T16:10:56.393 INFO:teuthology.orchestra.run.smithi190.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33503.log.gz 2023-10-08T16:10:56.393 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33584.log 2023-10-08T16:10:56.394 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-08T16:10:56.394 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.33611.log: /var/log/ceph/ceph-client.admin.33584.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33611.log.gz 2023-10-08T16:10:56.394 INFO:teuthology.orchestra.run.smithi190.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33584.log.gz 2023-10-08T16:10:56.394 INFO:teuthology.orchestra.run.smithi190.stderr: 91.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-08T16:10:56.400 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39272.log 2023-10-08T16:10:56.400 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39857.log 2023-10-08T16:10:56.400 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81115.log: /var/log/ceph/ceph-client.admin.39272.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.81115.log.gz 2023-10-08T16:10:56.400 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80980.log 2023-10-08T16:10:56.400 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39272.log.gz 2023-10-08T16:10:56.400 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40070.log 2023-10-08T16:10:56.401 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39857.log: /var/log/ceph/ceph-client.admin.80980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81607.log 2023-10-08T16:10:56.401 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.80980.log.gz 2023-10-08T16:10:56.401 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39857.log.gz 2023-10-08T16:10:56.401 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81306.log 2023-10-08T16:10:56.401 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40070.log.gz 2023-10-08T16:10:56.401 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-08T16:10:56.402 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81607.log: /var/log/ceph/ceph-client.admin.81306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40068.log 2023-10-08T16:10:56.402 INFO:teuthology.orchestra.run.smithi133.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.81607.log.gz 2023-10-08T16:10:56.402 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40585.log 2023-10-08T16:10:56.402 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.81306.log.gz 2023-10-08T16:10:56.402 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.40068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80732.log 2023-10-08T16:10:56.402 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40068.log.gz 2023-10-08T16:10:56.403 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41026.log 2023-10-08T16:10:56.403 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40284.log 2023-10-08T16:10:56.403 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40585.log.gz 2023-10-08T16:10:56.403 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.80732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40531.log 2023-10-08T16:10:56.403 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.41026.log: /var/log/ceph/ceph-client.admin.40284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80624.log 2023-10-08T16:10:56.403 INFO:teuthology.orchestra.run.smithi133.stderr: 89.5% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40284.log.gz 2023-10-08T16:10:56.404 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40287.log 2023-10-08T16:10:56.404 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.80732.log.gz 2023-10-08T16:10:56.404 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40531.log: /var/log/ceph/ceph-client.admin.80624.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40531.log.gz 2023-10-08T16:10:56.404 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.80624.log.gz 2023-10-08T16:10:56.404 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40073.log 2023-10-08T16:10:56.404 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33635.log 2023-10-08T16:10:56.405 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40558.log 2023-10-08T16:10:56.405 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40287.log.gz 2023-10-08T16:10:56.405 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33635.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40073.log.gz 2023-10-08T16:10:56.405 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-08T16:10:56.405 INFO:teuthology.orchestra.run.smithi133.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33635.log.gz 2023-10-08T16:10:56.405 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39195.log 2023-10-08T16:10:56.405 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81142.log 2023-10-08T16:10:56.406 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph.audit.log: gzip /var/log/ceph/ceph-client.admin.39195.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.80926.log 2023-10-08T16:10:56.406 INFO:teuthology.orchestra.run.smithi133.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40558.log.gz 2023-10-08T16:10:56.406 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39195.log.gz/var/log/ceph/ceph-client.admin.81142.log: 2023-10-08T16:10:56.406 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39854.log 2023-10-08T16:10:56.406 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.81142.log.gz 2023-10-08T16:10:56.407 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.80926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephfs_foo_test.1892788649.61178.log 2023-10-08T16:10:56.407 INFO:teuthology.orchestra.run.smithi133.stderr: 88.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-08T16:10:56.407 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39854.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39408.log 2023-10-08T16:10:56.407 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.80926.log.gz 2023-10-08T16:10:56.407 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39854.log.gz 2023-10-08T16:10:56.407 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39748.log 2023-10-08T16:10:56.407 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.libcephfs_foo_test.1892788649.61178.log: /var/log/ceph/ceph-client.admin.39408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40062.log 2023-10-08T16:10:56.408 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39493.log 2023-10-08T16:10:56.408 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39408.log.gz 2023-10-08T16:10:56.408 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39748.log: 87.6% -- replaced with /var/log/ceph/ceph-client.libcephfs_foo_test.1892788649.61178.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39528.log 2023-10-08T16:10:56.408 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40062.log: 2023-10-08T16:10:56.408 INFO:teuthology.orchestra.run.smithi133.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39748.log.gz 2023-10-08T16:10:56.408 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40062.log.gz 2023-10-08T16:10:56.409 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39493.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39493.log.gz 2023-10-08T16:10:56.409 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81223.log 2023-10-08T16:10:56.409 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40067.log 2023-10-08T16:10:56.409 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39667.log 2023-10-08T16:10:56.409 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81223.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39528.log.gz 2023-10-08T16:10:56.409 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61178.log 2023-10-08T16:10:56.410 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.81223.log.gz 2023-10-08T16:10:56.410 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40067.log.gz 2023-10-08T16:10:56.410 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39667.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39667.log.gz 2023-10-08T16:10:56.410 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80872.log 2023-10-08T16:10:56.410 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.61178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81653.log 2023-10-08T16:10:56.410 INFO:teuthology.orchestra.run.smithi133.stderr:gzip /var/log/ceph/ceph-client.admin.80872.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39853.log 2023-10-08T16:10:56.410 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81653.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.80872.log.gz 2023-10-08T16:10:56.411 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.81653.log.gz 2023-10-08T16:10:56.411 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81034.log 2023-10-08T16:10:56.411 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39694.log 2023-10-08T16:10:56.411 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-08T16:10:56.411 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81034.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39853.log.gz 2023-10-08T16:10:56.411 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39694.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81390.log 2023-10-08T16:10:56.411 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.81034.log.gz 2023-10-08T16:10:56.411 INFO:teuthology.orchestra.run.smithi133.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39694.log.gz 2023-10-08T16:10:56.412 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 /var/log/ceph/ceph-osd.1.log: --verbose -- /var/log/ceph/ceph-client.admin.39852.log 2023-10-08T16:10:56.412 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81390.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.81390.log.gz 2023-10-08T16:10:56.412 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81553.log 2023-10-08T16:10:56.412 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39852.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39852.log.gz 2023-10-08T16:10:56.412 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39435.log 2023-10-08T16:10:56.412 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39354.log 2023-10-08T16:10:56.413 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39435.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.81553.log.gz 2023-10-08T16:10:56.413 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephfs_readonly_test.978270043.61178.log 2023-10-08T16:10:56.413 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39435.log.gz 2023-10-08T16:10:56.413 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80899.log 2023-10-08T16:10:56.413 INFO:teuthology.orchestra.run.smithi133.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39354.log.gz 2023-10-08T16:10:56.413 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.libcephfs_readonly_test.978270043.61178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39802.log 2023-10-08T16:10:56.421 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.80899.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.80899.log.gz 2023-10-08T16:10:56.421 INFO:teuthology.orchestra.run.smithi133.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.libcephfs_readonly_test.978270043.61178.log.gz 2023-10-08T16:10:56.421 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40285.log 2023-10-08T16:10:56.421 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39802.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39802.log.gz 2023-10-08T16:10:56.422 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80651.log 2023-10-08T16:10:56.422 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40285.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40285.log.gz 2023-10-08T16:10:56.422 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80791.log 2023-10-08T16:10:56.422 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.80651.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80651.log.gz 2023-10-08T16:10:56.422 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40666.log 2023-10-08T16:10:56.422 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.80791.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.80791.log.gz 2023-10-08T16:10:56.422 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40828.log 2023-10-08T16:10:56.423 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40666.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40666.log.gz 2023-10-08T16:10:56.423 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40774.log 2023-10-08T16:10:56.423 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39837.log 2023-10-08T16:10:56.423 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39555.log 2023-10-08T16:10:56.423 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40828.log: /var/log/ceph/ceph-client.admin.39837.log: 87.7% 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39837.log.gz 2023-10-08T16:10:56.423 INFO:teuthology.orchestra.run.smithi133.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.40828.log.gz 2023-10-08T16:10:56.424 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40774.log.gz 2023-10-08T16:10:56.424 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40747.log 2023-10-08T16:10:56.424 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39555.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39555.log.gz 2023-10-08T16:10:56.424 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40639.log 2023-10-08T16:10:56.424 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40747.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40747.log.gz 2023-10-08T16:10:56.424 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81169.log 2023-10-08T16:10:56.424 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40639.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40639.log.gz 2023-10-08T16:10:56.425 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80818.log 2023-10-08T16:10:56.425 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81169.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.81169.log.gz 2023-10-08T16:10:56.425 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40612.log 2023-10-08T16:10:56.425 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.80818.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.80818.log.gz 2023-10-08T16:10:56.425 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81088.log 2023-10-08T16:10:56.425 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40612.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40612.log.gz 2023-10-08T16:10:56.425 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40801.log 2023-10-08T16:10:56.426 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81088.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.81088.log.gz 2023-10-08T16:10:56.426 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39582.log 2023-10-08T16:10:56.426 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 /var/log/ceph/ceph-client.admin.40801.log: --verbose -- /var/log/ceph/ceph-client.admin.80845.log 2023-10-08T16:10:56.426 INFO:teuthology.orchestra.run.smithi133.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40801.log.gz 2023-10-08T16:10:56.426 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39775.log 2023-10-08T16:10:56.426 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39582.log.gz 2023-10-08T16:10:56.427 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.80845.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.80845.log.gz 2023-10-08T16:10:56.427 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-08T16:10:56.427 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39775.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39775.log.gz 2023-10-08T16:10:56.427 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81499.log 2023-10-08T16:10:56.427 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40289.log 2023-10-08T16:10:56.427 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81499.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.81499.log.gz 2023-10-08T16:10:56.427 INFO:teuthology.orchestra.run.smithi133.stderr: 84.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-08T16:10:56.427 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81420.log 2023-10-08T16:10:56.428 INFO:teuthology.orchestra.run.smithi133.stderr:gzip /var/log/ceph/ceph-client.admin.40289.log: -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-08T16:10:56.428 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40289.log.gz 2023-10-08T16:10:56.428 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81420.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.81420.log.gz 2023-10-08T16:10:56.429 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81061.log 2023-10-08T16:10:56.429 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39856.log 2023-10-08T16:10:56.429 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81061.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.81061.log.gz 2023-10-08T16:10:56.430 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40071.log 2023-10-08T16:10:56.431 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39856.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39856.log.gz 2023-10-08T16:10:56.434 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40693.log 2023-10-08T16:10:56.435 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40071.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40071.log.gz 2023-10-08T16:10:56.435 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80953.log 2023-10-08T16:10:56.436 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40693.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40693.log.gz 2023-10-08T16:10:56.436 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39327.log 2023-10-08T16:10:56.437 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.80953.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.80953.log.gz 2023-10-08T16:10:56.445 INFO:teuthology.orchestra.run.smithi133.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-08T16:10:56.446 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81680.log 2023-10-08T16:10:56.446 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39327.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-08T16:10:56.447 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81680.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39327.log.gz 2023-10-08T16:10:56.447 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39127.log 2023-10-08T16:10:56.448 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.81680.log.gz 2023-10-08T16:10:56.448 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40072.log 2023-10-08T16:10:56.448 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39127.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39127.log.gz 2023-10-08T16:10:56.450 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80764.log 2023-10-08T16:10:56.451 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40072.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40072.log.gz 2023-10-08T16:10:56.451 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80705.log 2023-10-08T16:10:56.452 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.80764.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.80764.log.gz 2023-10-08T16:10:56.452 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33361.log 2023-10-08T16:10:56.453 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.80705.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.80705.log.gz 2023-10-08T16:10:56.453 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephfs_path_test.285878393.61178.log 2023-10-08T16:10:56.454 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33361.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.33361.log.gz 2023-10-08T16:10:56.455 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81250.log 2023-10-08T16:10:56.462 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.libcephfs_path_test.285878393.61178.log: 93.6%gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28553.log 2023-10-08T16:10:56.463 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81250.log: -- replaced with /var/log/ceph/ceph-client.libcephfs_path_test.285878393.61178.log.gz 2023-10-08T16:10:56.463 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.81250.log.gz 2023-10-08T16:10:56.464 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephfs_user_test.41969701.61178.log 2023-10-08T16:10:56.464 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph.tmp-client.admin.28553.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28553.log.gz 2023-10-08T16:10:56.465 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39299.log 2023-10-08T16:10:56.469 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.libcephfs_user_test.41969701.61178.log: 94.1% -- replaced with /var/log/ceph/ceph-client.libcephfs_user_test.41969701.61178.log.gz 2023-10-08T16:10:56.469 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81196.log 2023-10-08T16:10:56.470 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39299.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39299.log.gz 2023-10-08T16:10:56.470 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81279.log 2023-10-08T16:10:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81196.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.81196.log.gz 2023-10-08T16:10:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40857.log 2023-10-08T16:10:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81279.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.81279.log.gz 2023-10-08T16:10:56.473 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-08T16:10:56.473 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40857.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40857.log.gz 2023-10-08T16:10:56.474 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33489.log 2023-10-08T16:10:56.498 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40504.log 2023-10-08T16:10:56.499 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33489.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33489.log.gz 2023-10-08T16:10:56.514 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40279.log 2023-10-08T16:10:56.515 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40504.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40504.log.gz 2023-10-08T16:10:56.530 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40279.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40279.log.gz 2023-10-08T16:10:56.602 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-osd.7.log: 92.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-08T16:10:56.733 INFO:teuthology.orchestra.run.smithi190.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-08T16:10:57.142 INFO:teuthology.orchestra.run.smithi133.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-08T16:10:57.625 INFO:teuthology.orchestra.run.smithi190.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-08T16:10:57.736 INFO:teuthology.orchestra.run.smithi133.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-08T16:10:57.839 INFO:teuthology.orchestra.run.smithi190.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-08T16:10:57.926 INFO:teuthology.orchestra.run.smithi133.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.61178.log.gz 2023-10-08T16:10:57.943 INFO:teuthology.orchestra.run.smithi133.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-08T16:10:58.466 INFO:teuthology.orchestra.run.smithi190.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-08T16:10:58.506 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-10-08T16:10:58.506 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2023-10-08T16:10:58.513 INFO:teuthology.orchestra.run.smithi133.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-08T16:10:58.914 INFO:teuthology.orchestra.run.smithi190.stderr: 94.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-08T16:10:58.915 INFO:teuthology.orchestra.run.smithi190.stderr: 2023-10-08T16:10:58.915 INFO:teuthology.orchestra.run.smithi190.stderr:real 0m2.571s 2023-10-08T16:10:58.916 INFO:teuthology.orchestra.run.smithi190.stderr:user 0m7.674s 2023-10-08T16:10:58.916 INFO:teuthology.orchestra.run.smithi190.stderr:sys 0m0.309s 2023-10-08T16:10:58.979 INFO:teuthology.orchestra.run.smithi133.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-08T16:10:59.410 INFO:teuthology.orchestra.run.smithi133.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.41026.log.gz 2023-10-08T16:11:11.051 INFO:teuthology.orchestra.run.smithi133.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-08T16:11:11.052 INFO:teuthology.orchestra.run.smithi133.stderr: 2023-10-08T16:11:11.052 INFO:teuthology.orchestra.run.smithi133.stderr:real 0m14.722s 2023-10-08T16:11:11.052 INFO:teuthology.orchestra.run.smithi133.stderr:user 0m26.770s 2023-10-08T16:11:11.052 INFO:teuthology.orchestra.run.smithi133.stderr:sys 0m0.973s 2023-10-08T16:11:11.053 INFO:tasks.ceph:Archiving logs... 2023-10-08T16:11:11.054 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418300/remote/smithi133/log 2023-10-08T16:11:11.055 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T16:11:14.583 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418300/remote/smithi190/log 2023-10-08T16:11:14.584 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T16:11:15.629 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-08T16:11:15.638 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-08T16:11:15.638 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T16:11:15.641 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T16:11:15.728 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-08T16:11:15.737 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-08T16:11:15.738 DEBUG:teuthology.orchestra.run.smithi133:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T16:11:15.740 DEBUG:teuthology.orchestra.run.smithi190:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T16:11:15.760 INFO:teuthology.orchestra.run.smithi133.stdout: remote refid st t when poll reach delay offset jitter 2023-10-08T16:11:15.760 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================== 2023-10-08T16:11:15.760 INFO:teuthology.orchestra.run.smithi133.stdout:*hv01.front.sepi 44.4.53.2 2 u - 64 377 0.082 0.062 0.667 2023-10-08T16:11:15.760 INFO:teuthology.orchestra.run.smithi133.stdout:+hv02.front.sepi 63.231.80.2 3 u 3 64 377 0.090 1.085 0.478 2023-10-08T16:11:15.760 INFO:teuthology.orchestra.run.smithi133.stdout:+hv03.front.sepi 74.6.168.72 3 u 61 64 377 0.072 0.260 0.425 2023-10-08T16:11:15.760 INFO:teuthology.orchestra.run.smithi133.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2023-10-08T16:11:15.762 INFO:teuthology.orchestra.run.smithi190.stdout: remote refid st t when poll reach delay offset jitter 2023-10-08T16:11:15.762 INFO:teuthology.orchestra.run.smithi190.stdout:============================================================================== 2023-10-08T16:11:15.762 INFO:teuthology.orchestra.run.smithi190.stdout:*hv01.front.sepi 44.4.53.2 2 u 58 64 377 0.059 1.809 0.905 2023-10-08T16:11:15.762 INFO:teuthology.orchestra.run.smithi190.stdout:+hv02.front.sepi 63.231.80.2 3 u 62 64 377 0.075 1.329 0.527 2023-10-08T16:11:15.763 INFO:teuthology.orchestra.run.smithi190.stdout:+hv03.front.sepi 74.6.168.72 3 u 63 64 377 0.076 0.973 0.461 2023-10-08T16:11:15.763 INFO:teuthology.orchestra.run.smithi190.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2023-10-08T16:11:15.764 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-08T16:11:15.772 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-08T16:11:15.773 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-08T16:11:15.782 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-08T16:11:15.790 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-08T16:11:15.799 INFO:teuthology.task.internal:Duration was 1021.014491 seconds 2023-10-08T16:11:15.799 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-08T16:11:15.847 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-08T16:11:15.848 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T16:11:15.850 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T16:11:15.903 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-08T16:11:15.903 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi133.front.sepia.ceph.com 2023-10-08T16:11:15.903 DEBUG:teuthology.orchestra.run.smithi133:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T16:11:15.913 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi190.front.sepia.ceph.com 2023-10-08T16:11:15.914 DEBUG:teuthology.orchestra.run.smithi190:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T16:11:15.925 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-08T16:11:15.925 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T16:11:15.927 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T16:11:15.955 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-08T16:11:15.955 DEBUG:teuthology.orchestra.run.smithi133:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T16:11:15.957 DEBUG:teuthology.orchestra.run.smithi190:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T16:11:16.064 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-08T16:11:16.075 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-08T16:11:16.075 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T16:11:16.090 DEBUG:teuthology.orchestra.run.smithi190:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T16:11:16.107 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-08T16:11:16.117 DEBUG:teuthology.orchestra.run.smithi133:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T16:11:16.136 DEBUG:teuthology.orchestra.run.smithi190:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T16:11:16.147 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = core 2023-10-08T16:11:16.151 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = core 2023-10-08T16:11:16.174 DEBUG:teuthology.orchestra.run.smithi133:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T16:11:16.179 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:11:16.180 DEBUG:teuthology.orchestra.run.smithi190:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T16:11:16.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:11:16.222 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-08T16:11:16.232 INFO:teuthology.task.internal:Transferring archived files... 2023-10-08T16:11:16.232 DEBUG:teuthology.misc:Transferring archived files from smithi133:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418300/remote/smithi133 2023-10-08T16:11:16.233 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T16:11:16.254 DEBUG:teuthology.misc:Transferring archived files from smithi190:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418300/remote/smithi190 2023-10-08T16:11:16.254 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T16:11:16.277 INFO:teuthology.task.internal:Removing archive directory... 2023-10-08T16:11:16.277 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T16:11:16.295 DEBUG:teuthology.orchestra.run.smithi190:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T16:11:16.322 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-08T16:11:16.333 INFO:teuthology.task.internal:Not uploading archives. 2023-10-08T16:11:16.333 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-08T16:11:16.343 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-08T16:11:16.343 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T16:11:16.345 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T16:11:16.351 INFO:teuthology.orchestra.run.smithi133.stdout: 924112 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 8 16:11 /home/ubuntu/cephtest 2023-10-08T16:11:16.351 INFO:teuthology.orchestra.run.smithi133.stdout: 941534 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Oct 8 16:04 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:11:16.351 INFO:teuthology.orchestra.run.smithi133.stdout: 941535 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Oct 8 16:05 /home/ubuntu/cephtest/mnt.0/client.0 2023-10-08T16:11:16.351 INFO:teuthology.orchestra.run.smithi133.stdout: 1318031 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Oct 8 16:05 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-08T16:11:16.352 INFO:teuthology.orchestra.run.smithi133.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-08T16:11:16.353 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:11:16.353 INFO:teuthology.orchestra.run.smithi190.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 16:11 /home/ubuntu/cephtest 2023-10-08T16:11:16.354 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi133 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-08T16:11:16.362 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-08T16:11:16.372 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-08T16:11:16.382 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi133 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-08T16:11:16.382 INFO:teuthology.nuke:Checking targets against current locks 2023-10-08T16:11:16.412 DEBUG:teuthology.nuke:shortname: smithi133 2023-10-08T16:11:16.412 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T16:11:16.437 DEBUG:teuthology.nuke:shortname: smithi190 2023-10-08T16:11:16.437 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T16:11:16.440 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418300', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 15:43:40.219147', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-08T16:11:16.459 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418300', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 15:43:40.217400', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-08T16:11:16.491 INFO:teuthology.orchestra.console.smithi133:Power off 2023-10-08T16:11:16.491 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T16:11:16.509 INFO:teuthology.orchestra.console.smithi190:Power off 2023-10-08T16:11:16.510 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T16:11:16.518 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2023-10-08T16:11:16.519 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T16:11:16.531 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-10-08T16:11:16.532 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T16:11:16.541 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-10-08T16:11:16.555 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-10-08T16:11:20.543 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T16:11:20.557 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T16:11:20.655 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-10-08T16:11:20.667 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-10-08T16:11:24.656 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T16:11:24.668 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T16:11:24.766 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-10-08T16:11:24.777 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-10-08T16:11:24.867 INFO:teuthology.orchestra.console.smithi133:Power off completed 2023-10-08T16:11:24.878 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-10-08T16:11:24.983 INFO:teuthology.run:Summary data: description: fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs/{frag test}} duration: 1021.0144913196564 failure_reason: 'Command failed (workunit test libcephfs/test.sh) on smithi133 with status 127: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=abf19fc7a04fe4fceab4e98d4013ae1da7c06006 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=a2c82665bc154a9dbbbc6299ced23cbe status: fail success: false 2023-10-08T16:11:24.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T16:11:25.065 INFO:teuthology.run:FAIL